2024-09-22T01:19:18.084 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-22T01:19:18.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T01:19:18.186 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619 branch: squid description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} email: ceph-qa@ceph.com first_in_suite: false job_id: '7914619' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: rbd cache: true rbd cache max dirty: 0 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 1478 sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 sleep_before_teardown: 0 subset: 24/128 suite: rbd suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGIf2GngkMgzOESKRi/TdAZTwM1+8TnchNIwKFgJ1fVLQOyclVhr/Et27KDBW4AgDZCYpXcDqY5Pm3mAZPcadXg= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO8/YGO1Px/ienr0T1JAl+rPAG+R0Zj/KNris1G9L0vbGKW2i8YULDVJ7sjmekIetlTG+iP9+SmI7GSz1vJkXkA= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_21:16:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-22T01:19:18.186 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-22T01:19:18.187 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-22T01:19:18.187 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-22T01:19:18.189 INFO:teuthology.task.internal:Checking packages... 2024-09-22T01:19:18.209 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4e45e6b490e6cbe082cdf155fea780438ec53fc7' 2024-09-22T01:19:18.209 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-22T01:19:18.209 INFO:teuthology.packaging:ref: None 2024-09-22T01:19:18.209 INFO:teuthology.packaging:tag: None 2024-09-22T01:19:18.209 INFO:teuthology.packaging:branch: squid 2024-09-22T01:19:18.209 INFO:teuthology.packaging:sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T01:19:18.209 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-22T01:19:18.414 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373-g4e45e6b4-1jammy 2024-09-22T01:19:18.415 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-22T01:19:18.421 INFO:teuthology.task.internal:no buildpackages task found 2024-09-22T01:19:18.421 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-22T01:19:18.480 INFO:teuthology.task.internal:Saving configuration 2024-09-22T01:19:18.493 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-22T01:19:18.505 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-22T01:19:18.527 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 01:13:51.145183', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINoqWRhriY271JMH3k4YT/1Zp53a4aW/3yAgRWEiyzPw'} 2024-09-22T01:19:18.547 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 01:13:51.146664', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII96xpwxDddwJ4mLtKYuXwj5/mPdTPQpCtTuV4W9v83k'} 2024-09-22T01:19:18.547 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-22T01:19:18.553 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-22T01:19:18.553 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-22T01:19:18.553 INFO:teuthology.run_tasks:Running task console_log... 2024-09-22T01:19:18.636 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f327e5e3880>, signals=[15]) 2024-09-22T01:19:18.637 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-22T01:19:18.641 INFO:teuthology.task.internal:Opening connections... 2024-09-22T01:19:18.642 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:19:18.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T01:19:18.723 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:19:18.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T01:19:18.798 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-22T01:19:18.805 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-22T01:19:18.810 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-22T01:19:18.811 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-22T01:19:18.860 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-22T01:19:18.860 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Ubuntu" 2024-09-22T01:19:18.861 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="22.04" 2024-09-22T01:19:18.861 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-22T01:19:18.861 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_CODENAME=jammy 2024-09-22T01:19:18.861 INFO:teuthology.orchestra.run.smithi018.stdout:ID=ubuntu 2024-09-22T01:19:18.861 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE=debian 2024-09-22T01:19:18.861 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-22T01:19:18.861 INFO:teuthology.orchestra.run.smithi018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-22T01:19:18.861 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-22T01:19:18.861 INFO:teuthology.orchestra.run.smithi018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-22T01:19:18.861 INFO:teuthology.orchestra.run.smithi018.stdout:UBUNTU_CODENAME=jammy 2024-09-22T01:19:18.862 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-22T01:19:18.890 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-09-22T01:19:18.895 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-09-22T01:19:18.895 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu" 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04" 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-22T01:19:18.945 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy 2024-09-22T01:19:18.946 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-09-22T01:19:18.964 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-22T01:19:18.972 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-22T01:19:18.996 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-22T01:19:18.996 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-22T01:19:18.998 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-09-22T01:19:19.003 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-22T01:19:19.021 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-22T01:19:19.021 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-22T01:19:19.044 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-09-22T01:19:19.051 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-22T01:19:19.112 INFO:teuthology.run_tasks:Running task kernel... 2024-09-22T01:19:19.125 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-22T01:19:19.125 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-22T01:19:19.125 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T01:19:19.126 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T01:19:19.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:19:19.130 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-22T01:19:19.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:19:19.131 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-09-22T01:19:19.176 INFO:teuthology.orchestra.run.smithi018.stdout:5.15.0-56-generic 2024-09-22T01:19:19.176 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.15.0-56-generic 2024-09-22T01:19:19.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get clean 2024-09-22T01:19:19.177 INFO:teuthology.orchestra.run.smithi179.stdout:5.15.0-56-generic 2024-09-22T01:19:19.177 INFO:teuthology.task.kernel:Running kernel on smithi179: 5.15.0-56-generic 2024-09-22T01:19:19.177 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get clean 2024-09-22T01:19:19.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2024-09-22T01:19:19.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-09-22T01:19:19.441 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-22T01:19:19.550 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-22T01:19:19.633 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-22T01:19:19.633 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-22T01:19:19.636 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-22T01:19:19.653 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-22T01:19:19.684 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-22T01:19:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-22T01:19:19.759 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-22T01:19:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-22T01:19:19.761 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-22T01:19:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-22T01:19:19.781 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-22T01:19:19.785 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-22T01:19:19.785 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-22T01:19:19.792 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-22T01:19:19.797 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-22T01:19:19.799 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-22T01:19:19.799 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-22T01:19:19.799 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-22T01:19:19.799 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-22T01:19:19.812 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-22T01:19:19.987 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-22T01:19:20.040 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-22T01:19:20.057 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-22T01:19:20.125 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-22T01:19:20.178 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-22T01:19:20.445 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-22T01:19:20.480 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-22T01:19:20.494 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-22T01:19:20.495 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-22T01:19:20.498 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-22T01:19:20.499 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-22T01:19:20.514 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-22T01:19:20.522 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-22T01:19:20.523 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-22T01:19:20.525 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-22T01:19:20.533 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-22T01:19:20.547 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-22T01:19:20.548 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-22T01:19:20.549 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-22T01:19:20.564 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-22T01:19:20.568 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-22T01:19:20.584 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-22T01:19:20.585 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-22T01:19:20.605 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-22T01:19:20.620 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-22T01:19:20.633 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-22T01:19:20.638 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-22T01:19:20.639 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-22T01:19:20.641 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-22T01:19:20.679 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-22T01:19:20.679 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-22T01:19:20.679 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-22T01:19:20.687 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-22T01:19:20.688 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-22T01:19:20.691 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-22T01:19:20.691 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-22T01:19:20.692 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-22T01:19:20.692 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-22T01:19:20.693 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-22T01:19:20.694 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-22T01:19:20.699 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-22T01:19:20.711 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-22T01:19:20.716 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-22T01:19:20.716 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-22T01:19:20.716 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-22T01:19:20.717 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-22T01:19:20.718 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-22T01:19:20.719 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-22T01:19:20.720 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-22T01:19:20.721 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-22T01:19:20.721 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-22T01:19:20.745 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-22T01:19:20.764 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-22T01:19:20.772 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-22T01:19:20.772 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-22T01:19:20.773 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-22T01:19:20.774 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-22T01:19:20.774 INFO:teuthology.orchestra.run.smithi018.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-22T01:19:20.799 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-22T01:19:20.800 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-22T01:19:20.801 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-22T01:19:20.802 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-22T01:19:20.802 INFO:teuthology.orchestra.run.smithi179.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-22T01:19:20.827 INFO:teuthology.orchestra.run.smithi179.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-22T01:19:20.828 INFO:teuthology.orchestra.run.smithi179.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-22T01:19:20.828 INFO:teuthology.orchestra.run.smithi179.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-22T01:19:26.570 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 16.3 MB in 2s (7,326 kB/s) 2024-09-22T01:19:26.750 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 16.3 MB in 3s (5,721 kB/s) 2024-09-22T01:19:27.945 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-22T01:19:27.962 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-22T01:19:28.017 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-22T01:19:28.210 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-09-22T01:19:28.210 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-09-22T01:19:28.223 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-22T01:19:28.241 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-22T01:19:28.305 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-22T01:19:28.386 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-09-22T01:19:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-22T01:19:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-22T01:19:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-22T01:19:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-22T01:19:28.387 INFO:teuthology.orchestra.run.smithi018.stdout: python2.7-minimal 2024-09-22T01:19:28.387 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-22T01:19:28.388 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2024-09-22T01:19:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-22T01:19:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-22T01:19:28.389 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-22T01:19:28.390 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2024-09-22T01:19:28.390 INFO:teuthology.orchestra.run.smithi018.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-22T01:19:28.391 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2024-09-22T01:19:28.391 INFO:teuthology.orchestra.run.smithi018.stdout: thermald 2024-09-22T01:19:28.432 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2024-09-22T01:19:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-22T01:19:28.432 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-22T01:19:28.433 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-22T01:19:28.434 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages will be upgraded: 2024-09-22T01:19:28.435 INFO:teuthology.orchestra.run.smithi018.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-22T01:19:28.486 INFO:teuthology.orchestra.run.smithi018.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-22T01:19:28.486 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 113 MB of archives. 2024-09-22T01:19:28.486 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-22T01:19:28.486 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-22T01:19:28.518 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-09-22T01:19:28.519 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-09-22T01:19:28.709 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-09-22T01:19:28.710 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-22T01:19:28.710 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-22T01:19:28.710 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-22T01:19:28.710 INFO:teuthology.orchestra.run.smithi179.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-22T01:19:28.710 INFO:teuthology.orchestra.run.smithi179.stdout: python2.7-minimal 2024-09-22T01:19:28.711 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-22T01:19:28.712 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2024-09-22T01:19:28.712 INFO:teuthology.orchestra.run.smithi179.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-22T01:19:28.712 INFO:teuthology.orchestra.run.smithi179.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-22T01:19:28.712 INFO:teuthology.orchestra.run.smithi179.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-22T01:19:28.713 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2024-09-22T01:19:28.714 INFO:teuthology.orchestra.run.smithi179.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-22T01:19:28.714 INFO:teuthology.orchestra.run.smithi179.stdout:Recommended packages: 2024-09-22T01:19:28.714 INFO:teuthology.orchestra.run.smithi179.stdout: thermald 2024-09-22T01:19:28.759 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2024-09-22T01:19:28.759 INFO:teuthology.orchestra.run.smithi179.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-22T01:19:28.759 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-22T01:19:28.760 INFO:teuthology.orchestra.run.smithi179.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-22T01:19:28.761 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages will be upgraded: 2024-09-22T01:19:28.762 INFO:teuthology.orchestra.run.smithi179.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-22T01:19:28.812 INFO:teuthology.orchestra.run.smithi179.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-22T01:19:28.812 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 113 MB of archives. 2024-09-22T01:19:28.812 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-22T01:19:28.812 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-22T01:19:28.937 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-22T01:19:29.050 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-22T01:19:29.255 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-22T01:19:29.344 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-22T01:19:30.032 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-22T01:19:30.032 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-22T01:19:30.032 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-22T01:19:30.163 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-22T01:19:30.171 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-22T01:19:30.171 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-22T01:19:30.171 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-22T01:19:30.185 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-22T01:19:30.296 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-22T01:19:30.317 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-22T01:19:30.586 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 113 MB in 2s (65.0 MB/s) 2024-09-22T01:19:30.717 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 113 MB in 2s (73.2 MB/s) 2024-09-22T01:19:30.897 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-22T01:19:30.897 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-22T01:19:32.885 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-22T01:19:32.889 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-22T01:19:32.956 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-22T01:19:32.960 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-22T01:19:33.010 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:33.044 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:35.044 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-22T01:19:35.065 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-22T01:19:35.144 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:35.287 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-22T01:19:35.308 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-22T01:19:35.388 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:35.747 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-22T01:19:35.767 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-22T01:19:35.830 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:35.865 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-22T01:19:35.885 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-22T01:19:35.915 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:42.587 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-22T01:19:42.713 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-22T01:19:42.823 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-22T01:19:42.925 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-22T01:19:43.004 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-22T01:19:43.116 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-22T01:19:43.251 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-22T01:19:43.379 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-22T01:19:43.394 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-22T01:19:43.405 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-22T01:19:43.444 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-22T01:19:43.698 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-22T01:19:43.720 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-22T01:19:43.764 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-22T01:19:49.285 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-22T01:19:49.322 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-22T01:19:49.359 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:49.724 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-22T01:19:49.762 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-22T01:19:49.799 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:52.174 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-22T01:19:52.296 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-22T01:19:52.501 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-22T01:19:52.629 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-22T01:19:52.635 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-22T01:19:52.751 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:52.877 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-22T01:19:52.977 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-22T01:19:53.006 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:53.073 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:53.191 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-22T01:19:53.345 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:54.356 INFO:teuthology.orchestra.run.smithi018.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-22T01:19:54.356 INFO:teuthology.orchestra.run.smithi018.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-22T01:19:54.356 INFO:teuthology.orchestra.run.smithi018.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-22T01:19:54.356 INFO:teuthology.orchestra.run.smithi018.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-22T01:19:54.507 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:54.676 INFO:teuthology.orchestra.run.smithi179.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-22T01:19:54.676 INFO:teuthology.orchestra.run.smithi179.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-22T01:19:54.676 INFO:teuthology.orchestra.run.smithi179.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-22T01:19:54.676 INFO:teuthology.orchestra.run.smithi179.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-22T01:19:54.839 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:56.350 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-22T01:19:56.398 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-22T01:19:56.476 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-22T01:19:56.516 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-22T01:19:56.603 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:56.642 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:58.027 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:58.037 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-22T01:19:58.086 INFO:teuthology.orchestra.run.smithi179.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-22T01:19:58.086 INFO:teuthology.orchestra.run.smithi179.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-22T01:19:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-22T01:19:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-22T01:20:12.328 INFO:teuthology.orchestra.run.smithi179.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-22T01:20:12.328 INFO:teuthology.orchestra.run.smithi179.stdout:Sourcing file `/etc/default/grub' 2024-09-22T01:20:12.342 INFO:teuthology.orchestra.run.smithi179.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-22T01:20:12.365 INFO:teuthology.orchestra.run.smithi179.stdout:Generating grub configuration file ... 2024-09-22T01:20:12.666 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-22T01:20:12.680 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-22T01:20:12.840 INFO:teuthology.orchestra.run.smithi018.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-22T01:20:12.841 INFO:teuthology.orchestra.run.smithi018.stdout:Sourcing file `/etc/default/grub' 2024-09-22T01:20:12.853 INFO:teuthology.orchestra.run.smithi018.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-22T01:20:12.882 INFO:teuthology.orchestra.run.smithi018.stdout:Generating grub configuration file ... 2024-09-22T01:20:12.952 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-22T01:20:12.959 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-22T01:20:13.031 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-22T01:20:13.037 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-22T01:20:13.160 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-22T01:20:13.180 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-22T01:20:13.190 INFO:teuthology.orchestra.run.smithi179.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-22T01:20:13.190 INFO:teuthology.orchestra.run.smithi179.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-22T01:20:13.190 INFO:teuthology.orchestra.run.smithi179.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-22T01:20:13.242 INFO:teuthology.orchestra.run.smithi179.stdout:done 2024-09-22T01:20:13.503 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-22T01:20:13.508 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-22T01:20:13.582 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-22T01:20:13.588 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-22T01:20:13.739 DEBUG:teuthology.orchestra.run.smithi179:> dpkg -s linux-image-generic 2024-09-22T01:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-22T01:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-22T01:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-22T01:20:13.769 INFO:teuthology.orchestra.run.smithi179.stdout:Package: linux-image-generic 2024-09-22T01:20:13.769 INFO:teuthology.orchestra.run.smithi179.stdout:Status: install ok installed 2024-09-22T01:20:13.769 INFO:teuthology.orchestra.run.smithi179.stdout:Priority: optional 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout:Section: kernel 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout:Installed-Size: 21 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout:Maintainer: Ubuntu Kernel Team 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: amd64 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout:Source: linux-meta 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout:Version: 5.15.0.122.122 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout:Recommends: thermald 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout:Description: Generic Linux kernel image 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: This package will always depend on the latest generic kernel image 2024-09-22T01:20:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: available. 2024-09-22T01:20:13.770 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-22T01:20:13.771 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T01:20:13.771 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T01:20:13.771 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-22T01:20:13.771 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T01:20:13.771 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get clean 2024-09-22T01:20:13.804 INFO:teuthology.orchestra.run.smithi018.stdout:done 2024-09-22T01:20:13.930 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-09-22T01:20:14.043 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-22T01:20:14.052 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-22T01:20:14.069 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-22T01:20:14.165 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-22T01:20:14.283 DEBUG:teuthology.orchestra.run.smithi018:> dpkg -s linux-image-generic 2024-09-22T01:20:14.302 INFO:teuthology.orchestra.run.smithi018.stdout:Package: linux-image-generic 2024-09-22T01:20:14.302 INFO:teuthology.orchestra.run.smithi018.stdout:Status: install ok installed 2024-09-22T01:20:14.302 INFO:teuthology.orchestra.run.smithi018.stdout:Priority: optional 2024-09-22T01:20:14.302 INFO:teuthology.orchestra.run.smithi018.stdout:Section: kernel 2024-09-22T01:20:14.302 INFO:teuthology.orchestra.run.smithi018.stdout:Installed-Size: 21 2024-09-22T01:20:14.302 INFO:teuthology.orchestra.run.smithi018.stdout:Maintainer: Ubuntu Kernel Team 2024-09-22T01:20:14.302 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: amd64 2024-09-22T01:20:14.302 INFO:teuthology.orchestra.run.smithi018.stdout:Source: linux-meta 2024-09-22T01:20:14.303 INFO:teuthology.orchestra.run.smithi018.stdout:Version: 5.15.0.122.122 2024-09-22T01:20:14.303 INFO:teuthology.orchestra.run.smithi018.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-22T01:20:14.303 INFO:teuthology.orchestra.run.smithi018.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-22T01:20:14.303 INFO:teuthology.orchestra.run.smithi018.stdout:Recommends: thermald 2024-09-22T01:20:14.303 INFO:teuthology.orchestra.run.smithi018.stdout:Description: Generic Linux kernel image 2024-09-22T01:20:14.303 INFO:teuthology.orchestra.run.smithi018.stdout: This package will always depend on the latest generic kernel image 2024-09-22T01:20:14.303 INFO:teuthology.orchestra.run.smithi018.stdout: available. 2024-09-22T01:20:14.304 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-22T01:20:14.304 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T01:20:14.304 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T01:20:14.304 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-22T01:20:14.304 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T01:20:14.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get clean 2024-09-22T01:20:14.472 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2024-09-22T01:20:14.591 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-22T01:20:14.601 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-22T01:20:14.618 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-22T01:20:14.712 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-22T01:20:15.492 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-22T01:20:15.511 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-22T01:20:15.573 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-22T01:20:15.762 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-09-22T01:20:15.762 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-09-22T01:20:15.930 INFO:teuthology.orchestra.run.smithi179.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-22T01:20:15.930 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-09-22T01:20:15.930 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-22T01:20:15.931 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-22T01:20:15.931 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-22T01:20:15.931 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-22T01:20:15.931 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-22T01:20:15.931 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-22T01:20:15.973 INFO:teuthology.orchestra.run.smithi179.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-22T01:20:15.975 DEBUG:teuthology.orchestra.run.smithi179:> dpkg -s linux-image-generic 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Package: linux-image-generic 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Status: install ok installed 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Priority: optional 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Section: kernel 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Installed-Size: 21 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Maintainer: Ubuntu Kernel Team 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: amd64 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Source: linux-meta 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Version: 5.15.0.122.122 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Recommends: thermald 2024-09-22T01:20:15.990 INFO:teuthology.orchestra.run.smithi179.stdout:Description: Generic Linux kernel image 2024-09-22T01:20:15.991 INFO:teuthology.orchestra.run.smithi179.stdout: This package will always depend on the latest generic kernel image 2024-09-22T01:20:15.991 INFO:teuthology.orchestra.run.smithi179.stdout: available. 2024-09-22T01:20:15.991 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-09-22T01:20:16.036 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.AvsKfXcOVV 2024-09-22T01:20:16.036 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub/grub.cfg /tmp/tmp.AvsKfXcOVV 2024-09-22T01:20:16.076 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-22T01:20:16.090 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.AvsKfXcOVV 2024-09-22T01:20:16.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-22T01:20:16.150 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-22T01:20:16.199 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.AvsKfXcOVV is 10KB 2024-09-22T01:20:16.212 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.AvsKfXcOVV 2024-09-22T01:20:16.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-22T01:20:16.270 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:20:16.270 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-22T01:20:16.270 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-22T01:20:16.340 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-09-22T01:20:16.341 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-09-22T01:20:16.351 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-22T01:20:16.351 DEBUG:teuthology.orchestra.run.smithi179:> sudo update-grub 2024-09-22T01:20:16.518 INFO:teuthology.orchestra.run.smithi018.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-22T01:20:16.518 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-09-22T01:20:16.518 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-22T01:20:16.518 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-22T01:20:16.518 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-22T01:20:16.518 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-22T01:20:16.519 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-22T01:20:16.519 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-22T01:20:16.560 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-22T01:20:16.562 DEBUG:teuthology.orchestra.run.smithi018:> dpkg -s linux-image-generic 2024-09-22T01:20:16.622 INFO:teuthology.orchestra.run.smithi018.stdout:Package: linux-image-generic 2024-09-22T01:20:16.622 INFO:teuthology.orchestra.run.smithi018.stdout:Status: install ok installed 2024-09-22T01:20:16.622 INFO:teuthology.orchestra.run.smithi018.stdout:Priority: optional 2024-09-22T01:20:16.622 INFO:teuthology.orchestra.run.smithi018.stdout:Section: kernel 2024-09-22T01:20:16.622 INFO:teuthology.orchestra.run.smithi018.stdout:Installed-Size: 21 2024-09-22T01:20:16.622 INFO:teuthology.orchestra.run.smithi018.stdout:Maintainer: Ubuntu Kernel Team 2024-09-22T01:20:16.622 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: amd64 2024-09-22T01:20:16.623 INFO:teuthology.orchestra.run.smithi018.stdout:Source: linux-meta 2024-09-22T01:20:16.623 INFO:teuthology.orchestra.run.smithi018.stdout:Version: 5.15.0.122.122 2024-09-22T01:20:16.623 INFO:teuthology.orchestra.run.smithi018.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-22T01:20:16.623 INFO:teuthology.orchestra.run.smithi018.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-22T01:20:16.623 INFO:teuthology.orchestra.run.smithi018.stdout:Recommends: thermald 2024-09-22T01:20:16.623 INFO:teuthology.orchestra.run.smithi018.stdout:Description: Generic Linux kernel image 2024-09-22T01:20:16.623 INFO:teuthology.orchestra.run.smithi018.stdout: This package will always depend on the latest generic kernel image 2024-09-22T01:20:16.623 INFO:teuthology.orchestra.run.smithi018.stdout: available. 2024-09-22T01:20:16.623 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-22T01:20:16.671 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.kzysBCquUo 2024-09-22T01:20:16.672 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kzysBCquUo 2024-09-22T01:20:16.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.kzysBCquUo 2024-09-22T01:20:16.845 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.kzysBCquUo is 10KB 2024-09-22T01:20:16.857 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.kzysBCquUo 2024-09-22T01:20:16.863 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-22T01:20:16.919 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:20:16.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-22T01:20:16.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-22T01:20:17.003 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-22T01:20:17.003 DEBUG:teuthology.orchestra.run.smithi018:> sudo update-grub 2024-09-22T01:20:17.601 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub' 2024-09-22T01:20:17.602 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-22T01:20:17.604 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-09-22T01:20:17.762 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-22T01:20:17.768 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-22T01:20:18.006 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-22T01:20:18.010 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-22T01:20:18.052 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-22T01:20:18.057 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-22T01:20:18.183 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-22T01:20:18.183 INFO:teuthology.orchestra.run.smithi179.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-22T01:20:18.183 INFO:teuthology.orchestra.run.smithi179.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-22T01:20:18.198 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-09-22T01:20:18.207 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-09-22T01:20:18.230 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub' 2024-09-22T01:20:18.231 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-22T01:20:18.233 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-09-22T01:20:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-22T01:20:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-22T01:20:18.619 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-22T01:20:18.625 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-22T01:20:18.669 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-22T01:20:18.674 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-22T01:20:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-22T01:20:18.802 INFO:teuthology.orchestra.run.smithi018.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-22T01:20:18.803 INFO:teuthology.orchestra.run.smithi018.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-22T01:20:18.830 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-09-22T01:20:18.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-09-22T01:20:48.237 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-22T01:20:48.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-22T01:20:48.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T01:20:48.842 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-22T01:20:48.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-22T01:20:48.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T01:21:03.797 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-22T01:21:07.311 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-09-22T01:21:07.869 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-22T01:21:14.979 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-22T01:21:16.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-22T01:21:16.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T01:21:40.406 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-22T01:21:53.474 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-22T01:22:09.585 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ED25519, bits=256, fp=SHA256:NYPTr5tD1Dl01I4UDSg+9a5XbXEJiZAV7s7u0JaVmSE), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAII96xpwxDddwJ4mLtKYuXwj5/mPdTPQpCtTuV4W9v83k', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-22T01:22:16.314 DEBUG:teuthology.orchestra.remote:timed out 2024-09-22T01:22:28.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-22T01:22:28.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T01:22:28.506 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-22T01:22:28.610 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ED25519, bits=256, fp=SHA256:NYPTr5tD1Dl01I4UDSg+9a5XbXEJiZAV7s7u0JaVmSE), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAII96xpwxDddwJ4mLtKYuXwj5/mPdTPQpCtTuV4W9v83k', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-22T01:22:29.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-22T01:22:29.127 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-22T01:22:29.127 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-22T01:22:29.173 INFO:teuthology.orchestra.run.smithi018.stdout:5.15.0-122-generic 2024-09-22T01:22:29.173 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-22T01:22:29.173 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T01:22:29.173 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-22T01:22:30.174 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-22T01:22:30.174 DEBUG:teuthology.orchestra.run.smithi018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T01:22:30.267 INFO:teuthology.orchestra.run.smithi018.stdout:ttyS1 2024-09-22T01:22:30.291 DEBUG:teuthology.parallel:result is None 2024-09-22T01:22:50.634 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ED25519, bits=256, fp=SHA256:NYPTr5tD1Dl01I4UDSg+9a5XbXEJiZAV7s7u0JaVmSE), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAII96xpwxDddwJ4mLtKYuXwj5/mPdTPQpCtTuV4W9v83k', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-22T01:23:15.659 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ED25519, bits=256, fp=SHA256:NYPTr5tD1Dl01I4UDSg+9a5XbXEJiZAV7s7u0JaVmSE), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAII96xpwxDddwJ4mLtKYuXwj5/mPdTPQpCtTuV4W9v83k', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-22T01:23:43.683 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ED25519, bits=256, fp=SHA256:NYPTr5tD1Dl01I4UDSg+9a5XbXEJiZAV7s7u0JaVmSE), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAII96xpwxDddwJ4mLtKYuXwj5/mPdTPQpCtTuV4W9v83k', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-22T01:23:43.684 DEBUG:teuthology.orchestra.remote:'connect to smithi179.front.sepia.ceph.com' reached maximum tries (10) after waiting for 145 seconds 2024-09-22T01:23:52.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-22T01:23:52.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T01:23:53.151 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-22T01:23:54.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-22T01:23:54.158 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-22T01:23:54.158 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-09-22T01:23:54.203 INFO:teuthology.orchestra.run.smithi179.stdout:5.15.0-122-generic 2024-09-22T01:23:54.204 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-22T01:23:54.204 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T01:23:54.204 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-22T01:23:55.205 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-22T01:23:55.205 DEBUG:teuthology.orchestra.run.smithi179:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T01:23:55.557 INFO:teuthology.orchestra.run.smithi179.stdout:ttyS1 2024-09-22T01:23:55.578 DEBUG:teuthology.parallel:result is None 2024-09-22T01:23:55.578 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-22T01:23:55.584 INFO:teuthology.task.internal:Creating test directory... 2024-09-22T01:23:55.584 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T01:23:55.587 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T01:23:55.592 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-22T01:23:55.609 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-22T01:23:55.651 INFO:teuthology.task.internal:Creating archive directory... 2024-09-22T01:23:55.651 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T01:23:55.653 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T01:23:55.681 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-22T01:23:55.692 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-22T01:23:55.693 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T01:23:55.710 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T01:23:55.735 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T01:23:55.738 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T01:23:55.743 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T01:23:55.746 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T01:23:55.748 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-22T01:23:55.754 INFO:teuthology.task.internal:Configuring sudo... 2024-09-22T01:23:55.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T01:23:55.790 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T01:23:55.802 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-22T01:23:55.810 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-22T01:23:55.810 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T01:23:55.846 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T01:23:55.851 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T01:23:55.898 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T01:23:55.945 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:23:55.945 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T01:23:56.012 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T01:23:56.018 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T01:23:56.065 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:23:56.065 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T01:23:56.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-22T01:23:56.140 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-09-22T01:23:56.207 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-22T01:23:56.215 INFO:teuthology.task.internal:Starting timer... 2024-09-22T01:23:56.215 INFO:teuthology.run_tasks:Running task pcp... 2024-09-22T01:23:56.246 INFO:teuthology.run_tasks:Running task selinux... 2024-09-22T01:23:56.287 DEBUG:teuthology.task.selinux:Excluding smithi018: OS 'ubuntu' does not support SELinux 2024-09-22T01:23:56.287 DEBUG:teuthology.task.selinux:Excluding smithi179: OS 'ubuntu' does not support SELinux 2024-09-22T01:23:56.287 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-22T01:23:56.287 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-22T01:23:56.287 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-22T01:23:56.288 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-22T01:23:56.328 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-22T01:23:56.332 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-22T01:23:56.456 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-22T01:23:56.481 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-22T01:23:56.482 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-22T01:31:27.481 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-09-22T01:31:27.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-22T01:31:27.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T01:31:27.562 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-22T01:31:27.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-22T01:31:27.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-22T01:31:27.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T01:31:27.720 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-22T01:31:27.802 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-22T01:31:27.802 INFO:teuthology.run_tasks:Running task clock... 2024-09-22T01:31:27.813 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-22T01:31:27.813 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T01:31:27.813 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T01:31:27.816 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T01:31:27.816 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T01:31:27.839 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-22T01:31:27.839 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: Command line: ntpd -gq 2024-09-22T01:31:27.840 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: ---------------------------------------------------- 2024-09-22T01:31:27.840 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: ntp-4 is maintained by Network Time Foundation, 2024-09-22T01:31:27.840 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-22T01:31:27.840 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: corporation. Support and training for ntp-4 are 2024-09-22T01:31:27.840 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: available at https://www.nwtime.org/support 2024-09-22T01:31:27.840 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: ---------------------------------------------------- 2024-09-22T01:31:27.841 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: proto: precision = 0.048 usec (-24) 2024-09-22T01:31:27.841 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: basedate set to 2022-02-04 2024-09-22T01:31:27.841 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: gps base set to 2022-02-06 (week 2196) 2024-09-22T01:31:27.841 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-22T01:31:27.841 INFO:teuthology.orchestra.run.smithi018.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-22T01:31:27.841 INFO:teuthology.orchestra.run.smithi018.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-22T01:31:27.842 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: restrict ::: KOD does nothing without LIMITED. 2024-09-22T01:31:27.842 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: Listen and drop on 0 v6wildcard [::]:123 2024-09-22T01:31:27.842 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-22T01:31:27.842 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: Listen normally on 2 lo 127.0.0.1:123 2024-09-22T01:31:27.842 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: Listen normally on 3 ens1f0 172.21.15.18:123 2024-09-22T01:31:27.842 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: Listen normally on 4 lo [::1]:123 2024-09-22T01:31:27.843 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1362%4]:123 2024-09-22T01:31:27.843 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:27 ntpd[18377]: Listening on routing socket on fd #22 for interface updates 2024-09-22T01:31:27.869 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-22T01:31:27.869 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: Command line: ntpd -gq 2024-09-22T01:31:27.869 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: ---------------------------------------------------- 2024-09-22T01:31:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: ntp-4 is maintained by Network Time Foundation, 2024-09-22T01:31:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-22T01:31:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: corporation. Support and training for ntp-4 are 2024-09-22T01:31:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: available at https://www.nwtime.org/support 2024-09-22T01:31:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: ---------------------------------------------------- 2024-09-22T01:31:27.870 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: proto: precision = 0.064 usec (-24) 2024-09-22T01:31:27.871 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: basedate set to 2022-02-04 2024-09-22T01:31:27.871 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: gps base set to 2022-02-06 (week 2196) 2024-09-22T01:31:27.871 INFO:teuthology.orchestra.run.smithi179.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-22T01:31:27.871 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-22T01:31:27.872 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: restrict ::: KOD does nothing without LIMITED. 2024-09-22T01:31:27.872 INFO:teuthology.orchestra.run.smithi179.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-22T01:31:27.873 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: Listen and drop on 0 v6wildcard [::]:123 2024-09-22T01:31:27.873 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-22T01:31:27.873 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: Listen normally on 2 lo 127.0.0.1:123 2024-09-22T01:31:27.873 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: Listen normally on 3 enp3s0f1 172.21.15.179:123 2024-09-22T01:31:27.873 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: Listen normally on 4 lo [::1]:123 2024-09-22T01:31:27.873 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:725b%5]:123 2024-09-22T01:31:27.874 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:27 ntpd[18550]: Listening on routing socket on fd #22 for interface updates 2024-09-22T01:31:28.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:28 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:28.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:28 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:29.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:29 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:29.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:29 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:29.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:29 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:29.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:29 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:29.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:29 ntpd[18550]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:29.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:29 ntpd[18550]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:30.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:30 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:30.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:30 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:30.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:30 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:30.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:30 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:30.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:30 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:30.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:30 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:30.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:30 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:30.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:30 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:30.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:30 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:30.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:30 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:30.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:30 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:30.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:30 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:30.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:30 ntpd[18550]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:30.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:30 ntpd[18550]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:31.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:31 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:31 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:31 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:31 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:31 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:31 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:31.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:31 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:31.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:31 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:31.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:31 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:31.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:31 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:31.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:31 ntpd[18550]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:31.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:31 ntpd[18550]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:32.842 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:32.842 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:32.842 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:32.842 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:32 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:32.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:32.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:32 ntpd[18550]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:33.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:33 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:33.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:33 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:33.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:33 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:33.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:33 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:33.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:33 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:33 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:33.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:33 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:33.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:33 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:33.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:33 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:33.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:33 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:33.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:33 ntpd[18550]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:33.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:33 ntpd[18550]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:34.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:34 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:34.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:34.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:34.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:34.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:34.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:34.872 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:34.872 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:34.872 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:34.872 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:34.872 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:34.872 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:34.872 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:34 ntpd[18550]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:35.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:35 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:35.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:35 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:35.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:35 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:35.840 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:35 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:35.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:35 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:35.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:35 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:35.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:35 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:35.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:35 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:35.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:35 ntpd[18550]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:35.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:35 ntpd[18550]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:35.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:35 ntpd[18550]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:35.870 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:35 ntpd[18550]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:35.870 INFO:teuthology.orchestra.run.smithi179.stdout:22 Sep 01:31:35 ntpd[18550]: ntpd: time slew -0.002426 s 2024-09-22T01:31:35.871 INFO:teuthology.orchestra.run.smithi179.stdout:ntpd: time slew -0.002426s 2024-09-22T01:31:35.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:35 ntpd[18550]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-22T01:31:35.871 INFO:teuthology.orchestra.run.smithi179.stderr:22 Sep 01:31:35 ntpd[18550]: can't open /var/log/ntpstats/loopstats.20240922: Permission denied 2024-09-22T01:31:35.916 INFO:teuthology.orchestra.run.smithi179.stdout: remote refid st t when poll reach delay offset jitter 2024-09-22T01:31:35.916 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================== 2024-09-22T01:31:35.916 INFO:teuthology.orchestra.run.smithi179.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-22T01:31:35.916 INFO:teuthology.orchestra.run.smithi179.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-22T01:31:35.916 INFO:teuthology.orchestra.run.smithi179.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-22T01:31:35.916 INFO:teuthology.orchestra.run.smithi179.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240922: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-22T01:31:36.841 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240922: Permission denied 2024-09-22T01:31:36.842 INFO:teuthology.orchestra.run.smithi018.stdout:22 Sep 01:31:36 ntpd[18377]: ntpd: time slew +0.000282 s 2024-09-22T01:31:36.842 INFO:teuthology.orchestra.run.smithi018.stdout:ntpd: time slew +0.000282s 2024-09-22T01:31:36.842 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-22T01:31:36.842 INFO:teuthology.orchestra.run.smithi018.stderr:22 Sep 01:31:36 ntpd[18377]: can't open /var/log/ntpstats/loopstats.20240922: Permission denied 2024-09-22T01:31:36.893 INFO:teuthology.orchestra.run.smithi018.stdout: remote refid st t when poll reach delay offset jitter 2024-09-22T01:31:36.894 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================== 2024-09-22T01:31:36.894 INFO:teuthology.orchestra.run.smithi018.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-22T01:31:36.894 INFO:teuthology.orchestra.run.smithi018.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-22T01:31:36.894 INFO:teuthology.orchestra.run.smithi018.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-22T01:31:36.894 INFO:teuthology.orchestra.run.smithi018.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-22T01:31:36.895 INFO:teuthology.run_tasks:Running task install... 2024-09-22T01:31:36.903 DEBUG:teuthology.task.install:project ceph 2024-09-22T01:31:36.903 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-22T01:31:36.903 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'} 2024-09-22T01:31:36.903 INFO:teuthology.task.install:Using flavor: default 2024-09-22T01:31:36.908 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-22T01:31:36.908 INFO:teuthology.task.install:extra packages: [] 2024-09-22T01:31:36.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-key list | grep Ceph 2024-09-22T01:31:36.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-key list | grep Ceph 2024-09-22T01:31:36.967 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-22T01:31:36.992 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-22T01:31:36.994 INFO:teuthology.orchestra.run.smithi179.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-22T01:31:36.994 INFO:teuthology.orchestra.run.smithi179.stdout:uid [ unknown] Ceph.com (release key) 2024-09-22T01:31:36.994 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-22T01:31:36.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T01:31:37.019 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-22T01:31:37.019 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph.com (release key) 2024-09-22T01:31:37.020 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-22T01:31:37.020 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T01:31:37.143 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default/ 2024-09-22T01:31:37.143 INFO:teuthology.task.install.deb:Package version is 19.1.1-373-g4e45e6b4-1jammy 2024-09-22T01:31:37.164 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default/ 2024-09-22T01:31:37.164 INFO:teuthology.task.install.deb:Package version is 19.1.1-373-g4e45e6b4-1jammy 2024-09-22T01:31:37.459 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:31:37.459 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-22T01:31:37.473 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-09-22T01:31:37.476 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:31:37.476 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-22T01:31:37.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2024-09-22T01:31:37.640 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-22T01:31:37.640 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-22T01:31:37.651 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-22T01:31:37.669 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-22T01:31:37.669 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-22T01:31:37.677 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-22T01:31:37.695 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-22T01:31:37.789 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-22T01:31:37.900 INFO:teuthology.orchestra.run.smithi179.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy InRelease 2024-09-22T01:31:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy InRelease 2024-09-22T01:31:37.972 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-22T01:31:38.000 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-22T01:31:38.047 INFO:teuthology.orchestra.run.smithi179.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-22T01:31:38.074 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-22T01:31:38.121 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-22T01:31:38.147 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-22T01:31:38.206 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2024-09-22T01:31:38.232 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2024-09-22T01:31:38.302 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 28.9 kB in 1s (46.4 kB/s) 2024-09-22T01:31:38.327 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 28.9 kB in 1s (46.1 kB/s) 2024-09-22T01:31:39.357 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-22T01:31:39.374 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-373-g4e45e6b4-1jammy cephadm=19.1.1-373-g4e45e6b4-1jammy ceph-mds=19.1.1-373-g4e45e6b4-1jammy ceph-mgr=19.1.1-373-g4e45e6b4-1jammy ceph-common=19.1.1-373-g4e45e6b4-1jammy ceph-fuse=19.1.1-373-g4e45e6b4-1jammy ceph-test=19.1.1-373-g4e45e6b4-1jammy ceph-volume=19.1.1-373-g4e45e6b4-1jammy radosgw=19.1.1-373-g4e45e6b4-1jammy python3-rados=19.1.1-373-g4e45e6b4-1jammy python3-rgw=19.1.1-373-g4e45e6b4-1jammy python3-cephfs=19.1.1-373-g4e45e6b4-1jammy python3-rbd=19.1.1-373-g4e45e6b4-1jammy libcephfs2=19.1.1-373-g4e45e6b4-1jammy libcephfs-dev=19.1.1-373-g4e45e6b4-1jammy librados2=19.1.1-373-g4e45e6b4-1jammy librbd1=19.1.1-373-g4e45e6b4-1jammy rbd-fuse=19.1.1-373-g4e45e6b4-1jammy 2024-09-22T01:31:39.403 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-22T01:31:39.421 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-373-g4e45e6b4-1jammy cephadm=19.1.1-373-g4e45e6b4-1jammy ceph-mds=19.1.1-373-g4e45e6b4-1jammy ceph-mgr=19.1.1-373-g4e45e6b4-1jammy ceph-common=19.1.1-373-g4e45e6b4-1jammy ceph-fuse=19.1.1-373-g4e45e6b4-1jammy ceph-test=19.1.1-373-g4e45e6b4-1jammy ceph-volume=19.1.1-373-g4e45e6b4-1jammy radosgw=19.1.1-373-g4e45e6b4-1jammy python3-rados=19.1.1-373-g4e45e6b4-1jammy python3-rgw=19.1.1-373-g4e45e6b4-1jammy python3-cephfs=19.1.1-373-g4e45e6b4-1jammy python3-rbd=19.1.1-373-g4e45e6b4-1jammy libcephfs2=19.1.1-373-g4e45e6b4-1jammy libcephfs-dev=19.1.1-373-g4e45e6b4-1jammy librados2=19.1.1-373-g4e45e6b4-1jammy librbd1=19.1.1-373-g4e45e6b4-1jammy rbd-fuse=19.1.1-373-g4e45e6b4-1jammy 2024-09-22T01:31:39.434 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-09-22T01:31:39.484 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-09-22T01:31:39.630 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-09-22T01:31:39.631 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-09-22T01:31:39.698 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-09-22T01:31:39.699 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-09-22T01:31:39.816 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-09-22T01:31:39.816 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-22T01:31:39.817 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-22T01:31:39.817 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-22T01:31:39.817 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-22T01:31:39.817 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-22T01:31:39.817 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-22T01:31:39.818 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2024-09-22T01:31:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-22T01:31:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-22T01:31:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-22T01:31:39.818 INFO:teuthology.orchestra.run.smithi179.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-22T01:31:39.819 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-22T01:31:39.820 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet zip 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-22T01:31:39.821 INFO:teuthology.orchestra.run.smithi179.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-22T01:31:39.822 INFO:teuthology.orchestra.run.smithi179.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-22T01:31:39.822 INFO:teuthology.orchestra.run.smithi179.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-22T01:31:39.822 INFO:teuthology.orchestra.run.smithi179.stdout:Recommended packages: 2024-09-22T01:31:39.822 INFO:teuthology.orchestra.run.smithi179.stdout: btrfs-tools 2024-09-22T01:31:39.918 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-09-22T01:31:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-22T01:31:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-22T01:31:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-22T01:31:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-22T01:31:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-22T01:31:39.920 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-22T01:31:39.920 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2024-09-22T01:31:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-22T01:31:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-22T01:31:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-22T01:31:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-22T01:31:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-22T01:31:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-22T01:31:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-22T01:31:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-22T01:31:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-22T01:31:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-22T01:31:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-22T01:31:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-22T01:31:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-22T01:31:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-22T01:31:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-22T01:31:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-22T01:31:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-22T01:31:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-22T01:31:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-22T01:31:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-22T01:31:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-22T01:31:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-22T01:31:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-22T01:31:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet zip 2024-09-22T01:31:39.924 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2024-09-22T01:31:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-22T01:31:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-22T01:31:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-22T01:31:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-22T01:31:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-22T01:31:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-22T01:31:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-22T01:31:39.924 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2024-09-22T01:31:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: btrfs-tools 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-22T01:31:39.926 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-22T01:31:39.927 INFO:teuthology.orchestra.run.smithi179.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-22T01:31:39.983 INFO:teuthology.orchestra.run.smithi179.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-22T01:31:39.983 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 181 MB of archives. 2024-09-22T01:31:39.983 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-22T01:31:39.983 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-22T01:31:40.032 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2024-09-22T01:31:40.033 INFO:teuthology.orchestra.run.smithi018.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-22T01:31:40.033 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-22T01:31:40.033 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-22T01:31:40.033 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-22T01:31:40.033 INFO:teuthology.orchestra.run.smithi018.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-22T01:31:40.033 INFO:teuthology.orchestra.run.smithi018.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-22T01:31:40.034 INFO:teuthology.orchestra.run.smithi018.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-22T01:31:40.034 INFO:teuthology.orchestra.run.smithi018.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-22T01:31:40.034 INFO:teuthology.orchestra.run.smithi018.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-22T01:31:40.034 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-22T01:31:40.034 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-22T01:31:40.035 INFO:teuthology.orchestra.run.smithi018.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-22T01:31:40.036 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-22T01:31:40.036 INFO:teuthology.orchestra.run.smithi018.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-22T01:31:40.070 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-22T01:31:40.073 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-22T01:31:40.089 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-22T01:31:40.096 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 118 newly installed, 0 to remove and 332 not upgraded. 2024-09-22T01:31:40.096 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 181 MB of archives. 2024-09-22T01:31:40.096 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 830 MB of additional disk space will be used. 2024-09-22T01:31:40.096 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-22T01:31:40.148 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-22T01:31:40.153 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-22T01:31:40.165 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-22T01:31:40.169 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-22T01:31:40.169 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-22T01:31:40.170 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-22T01:31:40.179 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-22T01:31:40.180 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-22T01:31:40.183 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-22T01:31:40.184 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-22T01:31:40.186 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-22T01:31:40.188 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-22T01:31:40.190 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-22T01:31:40.193 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-22T01:31:40.202 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-22T01:31:40.204 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-22T01:31:40.204 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-22T01:31:40.205 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-22T01:31:40.206 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-22T01:31:40.206 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-22T01:31:40.206 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-22T01:31:40.207 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-22T01:31:40.211 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-22T01:31:40.220 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-22T01:31:40.220 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-22T01:31:40.238 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-22T01:31:40.240 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-22T01:31:40.241 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-22T01:31:40.241 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-22T01:31:40.241 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-22T01:31:40.242 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-22T01:31:40.243 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-22T01:31:40.243 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-22T01:31:40.255 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-22T01:31:40.255 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-22T01:31:40.270 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-22T01:31:40.272 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-22T01:31:40.275 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-22T01:31:40.277 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-22T01:31:40.281 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-22T01:31:40.288 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-22T01:31:40.291 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-22T01:31:40.292 INFO:teuthology.orchestra.run.smithi179.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-22T01:31:40.293 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-22T01:31:40.293 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-22T01:31:40.294 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-22T01:31:40.295 INFO:teuthology.orchestra.run.smithi179.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-22T01:31:40.297 INFO:teuthology.orchestra.run.smithi179.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-22T01:31:40.297 INFO:teuthology.orchestra.run.smithi179.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-22T01:31:40.299 INFO:teuthology.orchestra.run.smithi179.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-22T01:31:40.299 INFO:teuthology.orchestra.run.smithi179.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-22T01:31:40.303 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-22T01:31:40.305 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-22T01:31:40.307 INFO:teuthology.orchestra.run.smithi179.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-22T01:31:40.308 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-22T01:31:40.308 INFO:teuthology.orchestra.run.smithi179.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-22T01:31:40.309 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-22T01:31:40.310 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-22T01:31:40.312 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-22T01:31:40.325 INFO:teuthology.orchestra.run.smithi179.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-22T01:31:40.327 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-22T01:31:40.327 INFO:teuthology.orchestra.run.smithi179.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-22T01:31:40.329 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-22T01:31:40.329 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-22T01:31:40.330 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-22T01:31:40.331 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-22T01:31:40.331 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-22T01:31:40.336 INFO:teuthology.orchestra.run.smithi179.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-373-g4e45e6b4-1jammy [3,592 kB] 2024-09-22T01:31:40.345 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-22T01:31:40.345 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-22T01:31:40.345 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-22T01:31:40.346 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-22T01:31:40.362 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-22T01:31:40.365 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-22T01:31:40.365 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-22T01:31:40.366 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-22T01:31:40.366 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-22T01:31:40.367 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-22T01:31:40.379 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-22T01:31:40.380 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-22T01:31:40.380 INFO:teuthology.orchestra.run.smithi179.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-22T01:31:40.381 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-22T01:31:40.381 INFO:teuthology.orchestra.run.smithi179.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-22T01:31:40.382 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-22T01:31:40.382 INFO:teuthology.orchestra.run.smithi179.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-22T01:31:40.382 INFO:teuthology.orchestra.run.smithi179.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-22T01:31:40.383 INFO:teuthology.orchestra.run.smithi179.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-22T01:31:40.397 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-22T01:31:40.401 INFO:teuthology.orchestra.run.smithi179.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-22T01:31:40.402 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-22T01:31:40.402 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-22T01:31:40.403 INFO:teuthology.orchestra.run.smithi179.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-22T01:31:40.403 INFO:teuthology.orchestra.run.smithi179.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-22T01:31:40.403 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-22T01:31:40.404 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-22T01:31:40.405 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-22T01:31:40.414 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-22T01:31:40.415 INFO:teuthology.orchestra.run.smithi018.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-22T01:31:40.416 INFO:teuthology.orchestra.run.smithi018.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-22T01:31:40.417 INFO:teuthology.orchestra.run.smithi179.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-22T01:31:40.417 INFO:teuthology.orchestra.run.smithi179.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-22T01:31:40.417 INFO:teuthology.orchestra.run.smithi179.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-22T01:31:40.417 INFO:teuthology.orchestra.run.smithi018.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-22T01:31:40.418 INFO:teuthology.orchestra.run.smithi179.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-22T01:31:40.418 INFO:teuthology.orchestra.run.smithi179.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-22T01:31:40.419 INFO:teuthology.orchestra.run.smithi179.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-22T01:31:40.431 INFO:teuthology.orchestra.run.smithi018.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-22T01:31:40.432 INFO:teuthology.orchestra.run.smithi018.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-22T01:31:40.433 INFO:teuthology.orchestra.run.smithi018.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-22T01:31:40.434 INFO:teuthology.orchestra.run.smithi179.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-22T01:31:40.435 INFO:teuthology.orchestra.run.smithi179.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-22T01:31:40.435 INFO:teuthology.orchestra.run.smithi018.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-22T01:31:40.438 INFO:teuthology.orchestra.run.smithi179.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-22T01:31:40.454 INFO:teuthology.orchestra.run.smithi179.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-22T01:31:40.454 INFO:teuthology.orchestra.run.smithi179.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-22T01:31:40.454 INFO:teuthology.orchestra.run.smithi179.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-22T01:31:40.454 INFO:teuthology.orchestra.run.smithi018.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-373-g4e45e6b4-1jammy [3,592 kB] 2024-09-22T01:31:40.457 INFO:teuthology.orchestra.run.smithi179.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-22T01:31:40.459 INFO:teuthology.orchestra.run.smithi179.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-22T01:31:40.459 INFO:teuthology.orchestra.run.smithi179.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-22T01:31:40.460 INFO:teuthology.orchestra.run.smithi179.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-22T01:31:40.470 INFO:teuthology.orchestra.run.smithi179.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-22T01:31:40.470 INFO:teuthology.orchestra.run.smithi179.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-22T01:31:40.473 INFO:teuthology.orchestra.run.smithi179.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-22T01:31:40.487 INFO:teuthology.orchestra.run.smithi179.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-22T01:31:40.488 INFO:teuthology.orchestra.run.smithi179.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-22T01:31:40.488 INFO:teuthology.orchestra.run.smithi179.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-22T01:31:40.489 INFO:teuthology.orchestra.run.smithi179.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-22T01:31:40.490 INFO:teuthology.orchestra.run.smithi018.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-22T01:31:40.490 INFO:teuthology.orchestra.run.smithi179.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-22T01:31:40.491 INFO:teuthology.orchestra.run.smithi018.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-22T01:31:40.492 INFO:teuthology.orchestra.run.smithi018.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-22T01:31:40.492 INFO:teuthology.orchestra.run.smithi018.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-22T01:31:40.493 INFO:teuthology.orchestra.run.smithi018.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-22T01:31:40.496 INFO:teuthology.orchestra.run.smithi179.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-22T01:31:40.496 INFO:teuthology.orchestra.run.smithi179.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-22T01:31:40.504 INFO:teuthology.orchestra.run.smithi179.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-22T01:31:40.506 INFO:teuthology.orchestra.run.smithi179.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-22T01:31:40.506 INFO:teuthology.orchestra.run.smithi179.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-22T01:31:40.511 INFO:teuthology.orchestra.run.smithi018.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-22T01:31:40.513 INFO:teuthology.orchestra.run.smithi018.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-22T01:31:40.513 INFO:teuthology.orchestra.run.smithi018.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-22T01:31:40.528 INFO:teuthology.orchestra.run.smithi018.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-22T01:31:40.528 INFO:teuthology.orchestra.run.smithi018.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-22T01:31:40.528 INFO:teuthology.orchestra.run.smithi018.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-22T01:31:40.529 INFO:teuthology.orchestra.run.smithi018.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-22T01:31:40.529 INFO:teuthology.orchestra.run.smithi018.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-22T01:31:40.530 INFO:teuthology.orchestra.run.smithi018.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-22T01:31:40.545 INFO:teuthology.orchestra.run.smithi018.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-22T01:31:40.546 INFO:teuthology.orchestra.run.smithi018.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-22T01:31:40.549 INFO:teuthology.orchestra.run.smithi018.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-22T01:31:40.562 INFO:teuthology.orchestra.run.smithi018.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-22T01:31:40.564 INFO:teuthology.orchestra.run.smithi018.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-22T01:31:40.564 INFO:teuthology.orchestra.run.smithi018.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-22T01:31:40.567 INFO:teuthology.orchestra.run.smithi018.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-22T01:31:40.569 INFO:teuthology.orchestra.run.smithi018.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-22T01:31:40.570 INFO:teuthology.orchestra.run.smithi018.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-22T01:31:40.570 INFO:teuthology.orchestra.run.smithi018.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-22T01:31:40.579 INFO:teuthology.orchestra.run.smithi018.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-22T01:31:40.580 INFO:teuthology.orchestra.run.smithi018.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-22T01:31:40.583 INFO:teuthology.orchestra.run.smithi018.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-22T01:31:40.596 INFO:teuthology.orchestra.run.smithi018.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-22T01:31:40.597 INFO:teuthology.orchestra.run.smithi018.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-22T01:31:40.597 INFO:teuthology.orchestra.run.smithi018.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-22T01:31:40.599 INFO:teuthology.orchestra.run.smithi018.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-22T01:31:40.599 INFO:teuthology.orchestra.run.smithi018.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-22T01:31:40.605 INFO:teuthology.orchestra.run.smithi018.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-22T01:31:40.605 INFO:teuthology.orchestra.run.smithi018.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-22T01:31:40.614 INFO:teuthology.orchestra.run.smithi018.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-22T01:31:40.616 INFO:teuthology.orchestra.run.smithi018.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-22T01:31:40.617 INFO:teuthology.orchestra.run.smithi018.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-22T01:31:41.182 INFO:teuthology.orchestra.run.smithi179.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-373-g4e45e6b4-1jammy [3,241 kB] 2024-09-22T01:31:41.592 INFO:teuthology.orchestra.run.smithi179.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-373-g4e45e6b4-1jammy [719 kB] 2024-09-22T01:31:41.663 INFO:teuthology.orchestra.run.smithi179.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-373-g4e45e6b4-1jammy [356 kB] 2024-09-22T01:31:41.729 INFO:teuthology.orchestra.run.smithi179.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-373-g4e45e6b4-1jammy [32.8 kB] 2024-09-22T01:31:41.730 INFO:teuthology.orchestra.run.smithi179.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-373-g4e45e6b4-1jammy [180 kB] 2024-09-22T01:31:41.734 INFO:teuthology.orchestra.run.smithi179.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-373-g4e45e6b4-1jammy [67.8 kB] 2024-09-22T01:31:41.736 INFO:teuthology.orchestra.run.smithi179.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-373-g4e45e6b4-1jammy [333 kB] 2024-09-22T01:31:41.800 INFO:teuthology.orchestra.run.smithi179.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-373-g4e45e6b4-1jammy [6,875 kB] 2024-09-22T01:31:42.054 INFO:teuthology.orchestra.run.smithi018.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-373-g4e45e6b4-1jammy [3,241 kB] 2024-09-22T01:31:42.660 INFO:teuthology.orchestra.run.smithi179.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-373-g4e45e6b4-1jammy [112 kB] 2024-09-22T01:31:42.663 INFO:teuthology.orchestra.run.smithi179.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-373-g4e45e6b4-1jammy [472 kB] 2024-09-22T01:31:42.732 INFO:teuthology.orchestra.run.smithi179.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-373-g4e45e6b4-1jammy [25.9 MB] 2024-09-22T01:31:43.212 INFO:teuthology.orchestra.run.smithi018.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-373-g4e45e6b4-1jammy [719 kB] 2024-09-22T01:31:43.376 INFO:teuthology.orchestra.run.smithi018.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-373-g4e45e6b4-1jammy [356 kB] 2024-09-22T01:31:43.483 INFO:teuthology.orchestra.run.smithi018.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-373-g4e45e6b4-1jammy [32.8 kB] 2024-09-22T01:31:43.485 INFO:teuthology.orchestra.run.smithi018.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-373-g4e45e6b4-1jammy [180 kB] 2024-09-22T01:31:43.538 INFO:teuthology.orchestra.run.smithi018.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-373-g4e45e6b4-1jammy [67.8 kB] 2024-09-22T01:31:43.540 INFO:teuthology.orchestra.run.smithi018.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-373-g4e45e6b4-1jammy [333 kB] 2024-09-22T01:31:43.647 INFO:teuthology.orchestra.run.smithi018.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-373-g4e45e6b4-1jammy [6,875 kB] 2024-09-22T01:31:45.165 INFO:teuthology.orchestra.run.smithi179.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-373-g4e45e6b4-1jammy [5,145 kB] 2024-09-22T01:31:45.402 INFO:teuthology.orchestra.run.smithi018.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-373-g4e45e6b4-1jammy [112 kB] 2024-09-22T01:31:45.454 INFO:teuthology.orchestra.run.smithi018.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-373-g4e45e6b4-1jammy [472 kB] 2024-09-22T01:31:45.511 INFO:teuthology.orchestra.run.smithi179.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-373-g4e45e6b4-1jammy [245 kB] 2024-09-22T01:31:45.562 INFO:teuthology.orchestra.run.smithi179.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-373-g4e45e6b4-1jammy [124 kB] 2024-09-22T01:31:45.562 INFO:teuthology.orchestra.run.smithi179.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-373-g4e45e6b4-1jammy [1,555 kB] 2024-09-22T01:31:45.570 INFO:teuthology.orchestra.run.smithi018.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-373-g4e45e6b4-1jammy [25.9 MB] 2024-09-22T01:31:45.682 INFO:teuthology.orchestra.run.smithi179.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-373-g4e45e6b4-1jammy [6,142 kB] 2024-09-22T01:31:46.207 INFO:teuthology.orchestra.run.smithi179.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-373-g4e45e6b4-1jammy [22.8 MB] 2024-09-22T01:31:48.295 INFO:teuthology.orchestra.run.smithi179.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-373-g4e45e6b4-1jammy [14.1 kB] 2024-09-22T01:31:48.296 INFO:teuthology.orchestra.run.smithi179.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-373-g4e45e6b4-1jammy [877 kB] 2024-09-22T01:31:48.313 INFO:teuthology.orchestra.run.smithi179.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-373-g4e45e6b4-1jammy [2,462 kB] 2024-09-22T01:31:48.535 INFO:teuthology.orchestra.run.smithi179.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-373-g4e45e6b4-1jammy [794 kB] 2024-09-22T01:31:48.609 INFO:teuthology.orchestra.run.smithi179.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-373-g4e45e6b4-1jammy [152 kB] 2024-09-22T01:31:48.612 INFO:teuthology.orchestra.run.smithi179.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-373-g4e45e6b4-1jammy [2,347 kB] 2024-09-22T01:31:48.775 INFO:teuthology.orchestra.run.smithi179.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-373-g4e45e6b4-1jammy [8,625 kB] 2024-09-22T01:31:49.304 INFO:teuthology.orchestra.run.smithi179.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-373-g4e45e6b4-1jammy [14.2 kB] 2024-09-22T01:31:49.309 INFO:teuthology.orchestra.run.smithi179.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-373-g4e45e6b4-1jammy [51.4 MB] 2024-09-22T01:31:51.162 INFO:teuthology.orchestra.run.smithi018.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-373-g4e45e6b4-1jammy [5,145 kB] 2024-09-22T01:31:51.945 INFO:teuthology.orchestra.run.smithi018.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-373-g4e45e6b4-1jammy [245 kB] 2024-09-22T01:31:51.995 INFO:teuthology.orchestra.run.smithi018.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-373-g4e45e6b4-1jammy [124 kB] 2024-09-22T01:31:52.008 INFO:teuthology.orchestra.run.smithi018.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-373-g4e45e6b4-1jammy [1,555 kB] 2024-09-22T01:31:52.233 INFO:teuthology.orchestra.run.smithi018.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-373-g4e45e6b4-1jammy [6,142 kB] 2024-09-22T01:31:53.146 INFO:teuthology.orchestra.run.smithi018.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-373-g4e45e6b4-1jammy [22.8 MB] 2024-09-22T01:31:53.281 INFO:teuthology.orchestra.run.smithi179.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-373-g4e45e6b4-1jammy [130 kB] 2024-09-22T01:31:53.351 INFO:teuthology.orchestra.run.smithi179.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-373-g4e45e6b4-1jammy [39.0 kB] 2024-09-22T01:31:53.352 INFO:teuthology.orchestra.run.smithi179.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-373-g4e45e6b4-1jammy [13.6 MB] 2024-09-22T01:31:54.291 INFO:teuthology.orchestra.run.smithi179.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-373-g4e45e6b4-1jammy [91.4 kB] 2024-09-22T01:31:54.871 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 181 MB in 14s (12.6 MB/s) 2024-09-22T01:31:55.057 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-22T01:31:55.157 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-22T01:31:55.163 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-22T01:31:55.247 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-22T01:31:55.584 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-22T01:31:55.610 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-22T01:31:55.650 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-22T01:31:55.782 INFO:teuthology.orchestra.run.smithi018.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-373-g4e45e6b4-1jammy [14.1 kB] 2024-09-22T01:31:55.783 INFO:teuthology.orchestra.run.smithi018.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-373-g4e45e6b4-1jammy [877 kB] 2024-09-22T01:31:55.838 INFO:teuthology.orchestra.run.smithi018.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-373-g4e45e6b4-1jammy [2,462 kB] 2024-09-22T01:31:55.945 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-22T01:31:55.972 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-22T01:31:56.011 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-22T01:31:56.029 INFO:teuthology.orchestra.run.smithi018.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-373-g4e45e6b4-1jammy [794 kB] 2024-09-22T01:31:56.083 INFO:teuthology.orchestra.run.smithi018.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-373-g4e45e6b4-1jammy [152 kB] 2024-09-22T01:31:56.086 INFO:teuthology.orchestra.run.smithi018.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-373-g4e45e6b4-1jammy [2,347 kB] 2024-09-22T01:31:56.251 INFO:teuthology.orchestra.run.smithi018.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-373-g4e45e6b4-1jammy [8,625 kB] 2024-09-22T01:31:56.440 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-22T01:31:56.467 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-22T01:31:56.515 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:31:56.797 INFO:teuthology.orchestra.run.smithi018.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-373-g4e45e6b4-1jammy [14.2 kB] 2024-09-22T01:31:56.847 INFO:teuthology.orchestra.run.smithi018.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-373-g4e45e6b4-1jammy [51.4 MB] 2024-09-22T01:31:56.952 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-22T01:31:56.978 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-22T01:31:57.018 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:31:57.330 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-22T01:31:57.356 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-22T01:31:57.388 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:31:57.724 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-22T01:31:57.750 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-22T01:31:57.791 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-22T01:31:58.111 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librados2. 2024-09-22T01:31:58.137 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../007-librados2_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:31:58.177 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librados2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:31:58.630 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librbd1. 2024-09-22T01:31:58.656 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../008-librbd1_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:31:58.696 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librbd1 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:31:59.091 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs2. 2024-09-22T01:31:59.106 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:31:59.309 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:31:59.593 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rados. 2024-09-22T01:31:59.620 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../010-python3-rados_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:31:59.676 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rados (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:31:59.963 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-22T01:31:59.989 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:00.021 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-ceph-argparse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:00.057 INFO:teuthology.orchestra.run.smithi018.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-373-g4e45e6b4-1jammy [130 kB] 2024-09-22T01:32:00.060 INFO:teuthology.orchestra.run.smithi018.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-373-g4e45e6b4-1jammy [39.0 kB] 2024-09-22T01:32:00.061 INFO:teuthology.orchestra.run.smithi018.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-373-g4e45e6b4-1jammy [13.6 MB] 2024-09-22T01:32:00.265 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cephfs. 2024-09-22T01:32:00.280 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:00.323 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cephfs (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:00.626 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-22T01:32:00.652 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:00.701 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-ceph-common (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:00.801 INFO:teuthology.orchestra.run.smithi018.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-373-g4e45e6b4-1jammy [91.4 kB] 2024-09-22T01:32:01.021 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-22T01:32:01.047 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-22T01:32:01.087 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-22T01:32:01.382 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-prettytable. 2024-09-22T01:32:01.402 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 181 MB in 21s (8,721 kB/s) 2024-09-22T01:32:01.408 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-22T01:32:01.523 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-22T01:32:01.599 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-22T01:32:01.694 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-22T01:32:01.699 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-22T01:32:01.759 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rbd. 2024-09-22T01:32:01.780 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-22T01:32:01.786 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:01.834 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rbd (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:02.126 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-22T01:32:02.153 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-22T01:32:02.179 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-22T01:32:02.192 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-22T01:32:02.205 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-22T01:32:02.245 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-22T01:32:02.503 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-22T01:32:02.523 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-22T01:32:02.530 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-22T01:32:02.550 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-22T01:32:02.570 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-22T01:32:02.589 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-22T01:32:02.867 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-22T01:32:02.894 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-22T01:32:02.925 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-22T01:32:02.948 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-22T01:32:02.976 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-22T01:32:03.024 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:32:03.246 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua5.1. 2024-09-22T01:32:03.272 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-22T01:32:03.312 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-22T01:32:03.435 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-22T01:32:03.462 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-22T01:32:03.501 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:32:03.624 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-any. 2024-09-22T01:32:03.650 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-22T01:32:03.690 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-22T01:32:03.829 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-22T01:32:03.856 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-22T01:32:03.896 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:32:03.934 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package zip. 2024-09-22T01:32:03.949 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-22T01:32:03.994 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking zip (3.0-12build2) ... 2024-09-22T01:32:04.199 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-22T01:32:04.225 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-22T01:32:04.265 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-22T01:32:04.354 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package unzip. 2024-09-22T01:32:04.380 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-22T01:32:04.421 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-22T01:32:04.585 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librados2. 2024-09-22T01:32:04.612 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../007-librados2_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:04.651 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librados2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:04.775 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package luarocks. 2024-09-22T01:32:04.801 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-22T01:32:04.833 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-22T01:32:05.096 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librbd1. 2024-09-22T01:32:05.122 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../008-librbd1_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:05.154 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librbd1 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:05.199 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librgw2. 2024-09-22T01:32:05.226 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../025-librgw2_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:05.265 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librgw2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:05.590 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs2. 2024-09-22T01:32:05.617 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:05.656 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:05.809 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rgw. 2024-09-22T01:32:05.825 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:05.867 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rgw (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:05.943 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rados. 2024-09-22T01:32:05.958 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../010-python3-rados_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:06.001 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rados (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:06.196 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-22T01:32:06.222 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-22T01:32:06.262 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-22T01:32:06.520 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-22T01:32:06.523 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libradosstriper1. 2024-09-22T01:32:06.547 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:06.550 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:06.586 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-argparse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:06.590 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libradosstriper1 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:06.822 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cephfs. 2024-09-22T01:32:06.838 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:06.872 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cephfs (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:07.018 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-common. 2024-09-22T01:32:07.045 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../029-ceph-common_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:07.085 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-common (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:07.141 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-22T01:32:07.158 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:07.199 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-common (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:07.519 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-22T01:32:07.546 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-22T01:32:07.586 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-22T01:32:07.905 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-prettytable. 2024-09-22T01:32:07.932 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-22T01:32:07.972 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-22T01:32:08.232 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rbd. 2024-09-22T01:32:08.249 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:08.291 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rbd (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:08.473 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-base. 2024-09-22T01:32:08.500 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../030-ceph-base_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-base (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:08.610 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-22T01:32:08.637 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-22T01:32:08.677 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-22T01:32:08.955 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-22T01:32:08.981 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-22T01:32:09.021 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-22T01:32:09.180 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-22T01:32:09.206 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-22T01:32:09.246 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-22T01:32:09.323 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-22T01:32:09.340 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-22T01:32:09.382 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-22T01:32:09.716 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cheroot. 2024-09-22T01:32:09.718 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua5.1. 2024-09-22T01:32:09.742 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-22T01:32:09.745 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-22T01:32:09.783 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-22T01:32:09.785 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-22T01:32:10.080 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-any. 2024-09-22T01:32:10.103 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-22T01:32:10.106 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-22T01:32:10.129 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-22T01:32:10.146 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-22T01:32:10.169 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-22T01:32:10.398 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package zip. 2024-09-22T01:32:10.414 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-22T01:32:10.431 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-22T01:32:10.457 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking zip (3.0-12build2) ... 2024-09-22T01:32:10.457 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-22T01:32:10.498 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-22T01:32:10.801 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-22T01:32:10.810 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package unzip. 2024-09-22T01:32:10.827 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-22T01:32:10.837 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-22T01:32:10.867 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-22T01:32:10.876 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-22T01:32:11.179 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-tempora. 2024-09-22T01:32:11.205 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-22T01:32:11.239 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package luarocks. 2024-09-22T01:32:11.246 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-22T01:32:11.265 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-22T01:32:11.305 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-22T01:32:11.507 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-portend. 2024-09-22T01:32:11.533 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-22T01:32:11.565 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-22T01:32:11.854 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librgw2. 2024-09-22T01:32:11.881 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../025-librgw2_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:11.920 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librgw2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:12.490 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rgw. 2024-09-22T01:32:12.517 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:12.556 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rgw (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:12.586 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-22T01:32:12.612 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-22T01:32:12.652 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-22T01:32:12.948 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-22T01:32:12.974 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-22T01:32:13.014 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-22T01:32:13.368 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-natsort. 2024-09-22T01:32:13.394 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-22T01:32:13.434 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-22T01:32:13.710 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-22T01:32:13.737 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-22T01:32:13.768 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-22T01:32:13.771 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-logutils. 2024-09-22T01:32:13.798 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-22T01:32:13.838 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-22T01:32:14.037 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libradosstriper1. 2024-09-22T01:32:14.064 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:14.104 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libradosstriper1 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:14.166 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-22T01:32:14.193 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-22T01:32:14.233 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-22T01:32:14.511 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-mako. 2024-09-22T01:32:14.524 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-common. 2024-09-22T01:32:14.526 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-22T01:32:14.550 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../029-ceph-common_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:14.569 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-22T01:32:14.590 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-common (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:14.923 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-22T01:32:14.950 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-22T01:32:14.990 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-22T01:32:15.293 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-22T01:32:15.319 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-22T01:32:15.359 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-22T01:32:15.671 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-webob. 2024-09-22T01:32:15.697 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-22T01:32:15.738 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-22T01:32:15.970 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-base. 2024-09-22T01:32:15.997 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../030-ceph-base_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:16.033 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-waitress. 2024-09-22T01:32:16.047 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-base (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:16.059 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-22T01:32:16.094 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-22T01:32:16.386 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-tempita. 2024-09-22T01:32:16.412 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-22T01:32:16.452 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-22T01:32:16.624 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-22T01:32:16.651 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-22T01:32:16.691 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-22T01:32:16.764 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-paste. 2024-09-22T01:32:16.791 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-22T01:32:16.831 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-22T01:32:16.944 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cheroot. 2024-09-22T01:32:16.971 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-22T01:32:17.002 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-22T01:32:17.142 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-22T01:32:17.158 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-22T01:32:17.201 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-22T01:32:17.290 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-22T01:32:17.315 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-22T01:32:17.354 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-22T01:32:17.487 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-22T01:32:17.514 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-22T01:32:17.553 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-22T01:32:17.657 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-22T01:32:17.684 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-22T01:32:17.724 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-22T01:32:17.816 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-webtest. 2024-09-22T01:32:17.831 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-22T01:32:17.865 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-22T01:32:18.035 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-22T01:32:18.062 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-22T01:32:18.102 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-22T01:32:18.177 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pecan. 2024-09-22T01:32:18.204 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-22T01:32:18.243 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-22T01:32:18.371 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempora. 2024-09-22T01:32:18.398 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-22T01:32:18.429 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-22T01:32:18.591 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-certifi. 2024-09-22T01:32:18.618 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-22T01:32:18.657 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-22T01:32:18.715 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-portend. 2024-09-22T01:32:18.742 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-22T01:32:18.782 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-22T01:32:18.969 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-idna. 2024-09-22T01:32:18.996 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-22T01:32:19.035 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-22T01:32:19.085 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-22T01:32:19.112 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-22T01:32:19.151 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-22T01:32:19.347 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-urllib3. 2024-09-22T01:32:19.374 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-22T01:32:19.405 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-22T01:32:19.454 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-22T01:32:19.481 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-22T01:32:19.520 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-22T01:32:19.701 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-requests. 2024-09-22T01:32:19.716 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-22T01:32:19.750 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-22T01:32:19.849 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-natsort. 2024-09-22T01:32:19.866 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-22T01:32:19.924 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-22T01:32:20.214 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-logutils. 2024-09-22T01:32:20.214 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-22T01:32:20.229 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-22T01:32:20.239 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-22T01:32:20.271 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-22T01:32:20.279 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-22T01:32:20.524 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-22T01:32:20.540 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:20.548 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-22T01:32:20.575 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-22T01:32:20.582 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-modules-core (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:20.615 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-22T01:32:20.901 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-mako. 2024-09-22T01:32:20.918 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-22T01:32:20.929 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-22T01:32:20.956 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:20.959 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-22T01:32:20.996 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:21.283 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-22T01:32:21.296 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-22T01:32:21.310 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-22T01:32:21.321 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-22T01:32:21.349 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-22T01:32:21.362 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-22T01:32:21.640 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-22T01:32:21.652 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-openssl. 2024-09-22T01:32:21.667 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-22T01:32:21.678 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-22T01:32:21.719 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-22T01:32:21.819 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-22T01:32:22.072 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr. 2024-09-22T01:32:22.099 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:22.139 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:22.176 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webob. 2024-09-22T01:32:22.203 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-22T01:32:22.243 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-22T01:32:22.509 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mon. 2024-09-22T01:32:22.535 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:22.575 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mon (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:22.596 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-waitress. 2024-09-22T01:32:22.623 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-22T01:32:22.658 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-22T01:32:22.916 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempita. 2024-09-22T01:32:22.942 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-22T01:32:22.982 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-22T01:32:23.238 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-osd. 2024-09-22T01:32:23.264 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:23.285 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-paste. 2024-09-22T01:32:23.304 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-osd (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:23.312 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-22T01:32:23.351 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-22T01:32:23.680 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-22T01:32:23.707 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-22T01:32:23.746 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-22T01:32:24.024 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-22T01:32:24.051 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-22T01:32:24.082 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-22T01:32:24.333 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph. 2024-09-22T01:32:24.348 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../066-ceph_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:24.360 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webtest. 2024-09-22T01:32:24.383 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:24.388 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-22T01:32:24.427 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-22T01:32:24.703 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-fuse. 2024-09-22T01:32:24.729 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:24.769 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-fuse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:24.772 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pecan. 2024-09-22T01:32:24.799 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-22T01:32:24.838 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-22T01:32:25.185 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-certifi. 2024-09-22T01:32:25.212 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-22T01:32:25.251 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-22T01:32:25.256 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mds. 2024-09-22T01:32:25.283 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:25.314 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mds (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:25.579 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-idna. 2024-09-22T01:32:25.607 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-22T01:32:25.646 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-22T01:32:25.676 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephadm. 2024-09-22T01:32:25.703 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../069-cephadm_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:25.742 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephadm (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:25.924 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-urllib3. 2024-09-22T01:32:25.951 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-22T01:32:25.990 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-22T01:32:26.054 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-22T01:32:26.081 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-22T01:32:26.120 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-22T01:32:26.285 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests. 2024-09-22T01:32:26.313 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-22T01:32:26.351 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-22T01:32:26.407 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-22T01:32:26.430 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-22T01:32:26.473 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-22T01:32:26.671 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-22T01:32:26.699 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-22T01:32:26.738 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-22T01:32:26.991 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-22T01:32:27.007 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:27.049 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-modules-core (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:27.547 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-babel. 2024-09-22T01:32:27.574 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-22T01:32:27.580 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-22T01:32:27.606 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:27.613 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-22T01:32:27.638 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:27.932 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-22T01:32:27.950 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jinja2. 2024-09-22T01:32:27.959 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-22T01:32:27.977 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-22T01:32:27.998 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-22T01:32:28.008 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-22T01:32:28.301 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-openssl. 2024-09-22T01:32:28.320 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-22T01:32:28.328 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-22T01:32:28.335 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:28.368 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-22T01:32:28.370 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-cephadm (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:28.674 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-22T01:32:28.689 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-22T01:32:28.696 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr. 2024-09-22T01:32:28.723 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:28.732 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-22T01:32:28.763 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:29.035 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-routes. 2024-09-22T01:32:29.062 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-22T01:32:29.101 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-22T01:32:29.144 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mon. 2024-09-22T01:32:29.171 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:29.207 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mon (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:29.422 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-22T01:32:29.449 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:29.489 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-dashboard (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:29.803 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-osd. 2024-09-22T01:32:29.830 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:29.869 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-osd (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:30.811 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-22T01:32:30.838 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-22T01:32:30.877 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-22T01:32:30.931 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph. 2024-09-22T01:32:30.958 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../066-ceph_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:30.997 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:31.275 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-fuse. 2024-09-22T01:32:31.302 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:31.333 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-fuse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:31.357 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-joblib. 2024-09-22T01:32:31.383 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-22T01:32:31.423 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-22T01:32:31.678 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mds. 2024-09-22T01:32:31.705 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:31.744 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mds (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:31.785 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-22T01:32:31.813 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-22T01:32:31.851 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-22T01:32:32.139 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephadm. 2024-09-22T01:32:32.166 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../069-cephadm_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:32.171 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-sklearn. 2024-09-22T01:32:32.198 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-22T01:32:32.238 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-22T01:32:32.272 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephadm (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:32.809 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-22T01:32:32.836 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-22T01:32:32.875 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-22T01:32:32.948 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-22T01:32:32.975 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:33.092 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:33.186 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-22T01:32:33.202 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-22T01:32:33.236 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-22T01:32:34.088 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cachetools. 2024-09-22T01:32:34.114 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-22T01:32:34.154 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-22T01:32:34.225 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-babel. 2024-09-22T01:32:34.252 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-22T01:32:34.291 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-22T01:32:34.466 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-22T01:32:34.493 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-22T01:32:34.532 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-22T01:32:34.594 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jinja2. 2024-09-22T01:32:34.621 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-22T01:32:34.660 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-22T01:32:34.845 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-22T01:32:34.871 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-22T01:32:34.911 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-22T01:32:34.980 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-22T01:32:35.008 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:35.038 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-cephadm (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:35.189 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rsa. 2024-09-22T01:32:35.216 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-22T01:32:35.367 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-22T01:32:35.394 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-22T01:32:35.433 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-22T01:32:35.439 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-22T01:32:35.703 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-routes. 2024-09-22T01:32:35.730 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-22T01:32:35.736 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-google-auth. 2024-09-22T01:32:35.762 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-22T01:32:35.769 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-22T01:32:35.803 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-22T01:32:36.081 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-22T01:32:36.108 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:36.122 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-22T01:32:36.147 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-dashboard (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:36.149 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-22T01:32:36.188 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-22T01:32:36.517 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-websocket. 2024-09-22T01:32:36.544 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-22T01:32:36.583 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-22T01:32:36.887 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-22T01:32:36.914 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-22T01:32:36.953 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-22T01:32:37.311 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-22T01:32:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-22T01:32:37.368 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-22T01:32:37.593 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-22T01:32:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:37.643 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:37.873 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-joblib. 2024-09-22T01:32:37.889 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-22T01:32:37.931 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-22T01:32:37.946 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-22T01:32:37.974 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-22T01:32:38.013 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-22T01:32:38.293 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-22T01:32:38.320 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-22T01:32:38.358 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-22T01:32:38.386 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-22T01:32:38.392 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-22T01:32:38.433 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-22T01:32:38.686 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package jq. 2024-09-22T01:32:38.686 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn. 2024-09-22T01:32:38.702 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-22T01:32:38.714 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-22T01:32:38.736 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-22T01:32:38.753 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-22T01:32:38.955 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package socat. 2024-09-22T01:32:38.971 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-22T01:32:39.013 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-22T01:32:39.326 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package xmlstarlet. 2024-09-22T01:32:39.354 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-22T01:32:39.392 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-22T01:32:39.445 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-22T01:32:39.473 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:39.597 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:39.722 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-test. 2024-09-22T01:32:39.750 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../097-ceph-test_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:39.788 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-test (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:40.551 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cachetools. 2024-09-22T01:32:40.578 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-22T01:32:40.617 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-22T01:32:40.928 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-22T01:32:40.956 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-22T01:32:40.995 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-22T01:32:41.332 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-22T01:32:41.360 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-22T01:32:41.398 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-22T01:32:41.660 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rsa. 2024-09-22T01:32:41.687 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-22T01:32:41.726 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-22T01:32:42.047 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-google-auth. 2024-09-22T01:32:42.075 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-22T01:32:42.113 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-22T01:32:42.244 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-volume. 2024-09-22T01:32:42.271 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:42.310 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-volume (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:42.433 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-22T01:32:42.461 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-22T01:32:42.499 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-22T01:32:42.631 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-22T01:32:42.659 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:42.697 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs-dev (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:42.811 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-websocket. 2024-09-22T01:32:42.839 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-22T01:32:42.877 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-22T01:32:42.959 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-22T01:32:42.975 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-22T01:32:43.017 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-22T01:32:43.214 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-22T01:32:43.242 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-22T01:32:43.280 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-22T01:32:43.347 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-22T01:32:43.375 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-22T01:32:43.414 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-22T01:32:43.777 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package nvme-cli. 2024-09-22T01:32:43.805 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-22T01:32:43.843 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-22T01:32:43.970 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-22T01:32:43.998 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:44.036 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:44.216 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package pkg-config. 2024-09-22T01:32:44.232 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-22T01:32:44.274 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-22T01:32:44.373 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-22T01:32:44.400 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-22T01:32:44.439 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-22T01:32:44.535 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-22T01:32:44.552 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-22T01:32:44.594 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-22T01:32:44.725 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-22T01:32:44.741 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-22T01:32:44.775 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-22T01:32:44.986 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package jq. 2024-09-22T01:32:45.002 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-22T01:32:45.006 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-22T01:32:45.034 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-22T01:32:45.044 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-22T01:32:45.072 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-22T01:32:45.305 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package socat. 2024-09-22T01:32:45.323 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-22T01:32:45.364 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-22T01:32:45.384 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pastescript. 2024-09-22T01:32:45.412 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-22T01:32:45.450 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-22T01:32:45.659 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package xmlstarlet. 2024-09-22T01:32:45.686 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-22T01:32:45.725 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-22T01:32:45.787 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pluggy. 2024-09-22T01:32:45.815 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-22T01:32:45.854 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-22T01:32:46.055 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-test. 2024-09-22T01:32:46.072 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../097-ceph-test_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:46.104 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-test (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:46.151 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-psutil. 2024-09-22T01:32:46.178 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-22T01:32:46.217 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-22T01:32:46.546 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-py. 2024-09-22T01:32:46.574 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-22T01:32:46.612 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-22T01:32:46.924 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pygments. 2024-09-22T01:32:46.952 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-22T01:32:46.990 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-22T01:32:47.470 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-22T01:32:47.487 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-22T01:32:47.528 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-22T01:32:47.790 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-toml. 2024-09-22T01:32:47.818 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-22T01:32:47.856 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-22T01:32:48.168 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pytest. 2024-09-22T01:32:48.196 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-22T01:32:48.234 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-22T01:32:48.547 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-simplejson. 2024-09-22T01:32:48.567 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-volume. 2024-09-22T01:32:48.575 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-22T01:32:48.595 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-373-g4e45e6b4-1jammy_all.deb ... 2024-09-22T01:32:48.613 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-22T01:32:48.633 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-volume (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:48.899 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-22T01:32:48.927 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-22T01:32:48.946 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-22T01:32:48.962 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:48.966 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-22T01:32:48.996 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs-dev (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:49.290 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-22T01:32:49.318 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-22T01:32:49.357 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-22T01:32:49.654 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package radosgw. 2024-09-22T01:32:49.678 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-22T01:32:49.682 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../116-radosgw_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:49.706 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-22T01:32:49.720 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking radosgw (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:49.745 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-22T01:32:50.107 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package nvme-cli. 2024-09-22T01:32:50.123 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-22T01:32:50.156 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-22T01:32:50.529 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package pkg-config. 2024-09-22T01:32:50.557 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package rbd-fuse. 2024-09-22T01:32:50.557 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-22T01:32:50.570 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:50.586 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-22T01:32:50.615 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking rbd-fuse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:50.832 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-22T01:32:50.848 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-22T01:32:50.889 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-22T01:32:50.903 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-22T01:32:51.154 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-22T01:32:51.281 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-22T01:32:51.301 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-22T01:32:51.326 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-22T01:32:51.367 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-22T01:32:51.548 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-22T01:32:51.670 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastescript. 2024-09-22T01:32:51.699 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-22T01:32:51.737 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-22T01:32:51.858 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-22T01:32:52.057 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pluggy. 2024-09-22T01:32:52.085 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-22T01:32:52.123 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-22T01:32:52.259 INFO:teuthology.orchestra.run.smithi179.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-22T01:32:52.324 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephadm (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:52.460 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-psutil. 2024-09-22T01:32:52.488 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-22T01:32:52.527 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-22T01:32:52.850 INFO:teuthology.orchestra.run.smithi179.stdout:Adding system user cephadm....done 2024-09-22T01:32:52.879 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-py. 2024-09-22T01:32:52.907 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-22T01:32:52.971 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-22T01:32:53.006 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-22T01:32:53.291 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pygments. 2024-09-22T01:32:53.291 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-22T01:32:53.319 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-22T01:32:53.357 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-22T01:32:53.535 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-22T01:32:53.652 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-22T01:32:53.820 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-22T01:32:53.848 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-22T01:32:53.886 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-22T01:32:53.912 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-22T01:32:54.146 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-22T01:32:54.164 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-toml. 2024-09-22T01:32:54.192 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-22T01:32:54.222 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-22T01:32:54.247 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-22T01:32:54.517 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pytest. 2024-09-22T01:32:54.546 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-22T01:32:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-22T01:32:54.583 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-22T01:32:54.894 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-22T01:32:54.920 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplejson. 2024-09-22T01:32:54.948 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-22T01:32:54.978 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-22T01:32:55.170 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-22T01:32:55.231 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-22T01:32:55.248 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-22T01:32:55.281 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-22T01:32:55.429 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-22T01:32:55.681 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-22T01:32:55.932 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-22T01:32:55.943 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package radosgw. 2024-09-22T01:32:55.960 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../116-radosgw_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:55.993 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking radosgw (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:56.192 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-22T01:32:56.443 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-ceph-argparse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:56.711 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-22T01:32:56.829 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package rbd-fuse. 2024-09-22T01:32:56.837 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-22T01:32:56.858 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-373-g4e45e6b4-1jammy_amd64.deb ... 2024-09-22T01:32:56.904 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking rbd-fuse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:56.938 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-22T01:32:57.039 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-22T01:32:57.201 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-22T01:32:57.299 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-22T01:32:57.443 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-22T01:32:57.568 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-22T01:32:57.663 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-22T01:32:57.688 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-22T01:32:57.753 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-22T01:32:57.837 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-22T01:32:57.879 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-22T01:32:58.155 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-22T01:32:58.239 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-22T01:32:58.348 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-22T01:32:58.602 INFO:teuthology.orchestra.run.smithi018.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-22T01:32:58.624 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-22T01:32:58.892 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-22T01:32:58.948 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephadm (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:32:59.194 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up zip (3.0-12build2) ... 2024-09-22T01:32:59.320 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-22T01:32:59.465 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user cephadm....done 2024-09-22T01:32:59.621 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-22T01:32:59.880 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-22T01:33:00.014 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-22T01:33:00.157 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-22T01:33:00.256 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-22T01:33:00.283 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-22T01:33:00.383 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-22T01:33:00.509 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-22T01:33:00.551 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-22T01:33:00.810 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-22T01:33:00.819 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-22T01:33:00.936 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-22T01:33:01.228 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-22T01:33:01.247 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-22T01:33:01.471 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-22T01:33:01.590 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-22T01:33:01.831 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-22T01:33:01.833 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-22T01:33:02.117 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-22T01:33:02.124 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-22T01:33:02.419 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-22T01:33:02.493 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-22T01:33:02.678 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-22T01:33:02.752 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-22T01:33:02.878 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-ceph-common (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:02.984 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-22T01:33:03.163 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-22T01:33:03.297 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-argparse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:03.465 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-22T01:33:03.565 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-22T01:33:03.691 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-22T01:33:03.817 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-22T01:33:03.943 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-22T01:33:04.202 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-22T01:33:04.637 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-22T01:33:04.719 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-22T01:33:04.749 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-22T01:33:04.806 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-22T01:33:04.856 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:33:04.915 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-22T01:33:04.990 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-22T01:33:05.250 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-22T01:33:05.283 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-22T01:33:05.376 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-22T01:33:05.409 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-22T01:33:05.502 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-22T01:33:05.685 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-22T01:33:05.829 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-22T01:33:05.961 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-22T01:33:06.287 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up zip (3.0-12build2) ... 2024-09-22T01:33:06.372 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-22T01:33:06.413 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-22T01:33:06.615 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:33:06.741 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-22T01:33:07.042 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-22T01:33:07.132 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-22T01:33:07.310 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-22T01:33:07.391 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-22T01:33:07.517 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-22T01:33:07.578 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-22T01:33:07.643 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-22T01:33:07.830 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-22T01:33:07.961 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-22T01:33:08.064 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-22T01:33:08.340 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-22T01:33:08.370 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-22T01:33:08.466 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-22T01:33:08.621 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-22T01:33:08.773 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-22T01:33:08.902 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-22T01:33:08.998 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-22T01:33:09.187 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-22T01:33:09.283 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-22T01:33:09.463 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-22T01:33:09.642 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-22T01:33:09.714 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-22T01:33:09.840 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-22T01:33:09.902 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-22T01:33:09.966 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-22T01:33:10.028 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-common (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:10.056 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-22T01:33:10.302 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-22T01:33:10.346 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-22T01:33:10.428 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-22T01:33:10.663 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-22T01:33:10.830 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-22T01:33:11.089 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-22T01:33:11.215 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-22T01:33:11.475 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:33:11.610 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-22T01:33:11.819 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-22T01:33:11.928 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-22T01:33:12.079 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:33:12.205 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-22T01:33:12.220 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-22T01:33:12.465 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-22T01:33:12.472 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-22T01:33:12.573 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-22T01:33:12.574 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-22T01:33:12.700 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-22T01:33:12.849 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-22T01:33:13.002 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-22T01:33:13.117 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-22T01:33:13.269 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-22T01:33:13.488 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-22T01:33:13.528 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:33:13.655 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-22T01:33:13.849 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-22T01:33:13.948 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-22T01:33:14.133 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-22T01:33:14.199 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-22T01:33:14.458 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-22T01:33:14.469 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-22T01:33:14.595 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librados2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:14.696 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libsqlite3-mod-ceph (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:14.718 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-22T01:33:14.797 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-22T01:33:14.977 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-22T01:33:15.126 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:15.252 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libradosstriper1 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:15.261 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-22T01:33:15.378 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-22T01:33:15.387 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-22T01:33:15.663 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-22T01:33:15.672 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librbd1 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:15.773 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-22T01:33:15.773 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-modules-core (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:15.899 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-fuse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:16.041 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-22T01:33:16.104 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-22T01:33:16.104 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-22T01:33:16.342 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-22T01:33:16.559 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs-dev (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:16.601 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-22T01:33:16.685 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rados (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:16.727 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-22T01:33:16.811 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librgw2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:16.853 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-22T01:33:16.937 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-22T01:33:16.943 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-22T01:33:17.222 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-22T01:33:17.331 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-22T01:33:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-22T01:33:17.975 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-22T01:33:18.083 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rbd (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:18.101 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-22T01:33:18.209 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up rbd-fuse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:18.336 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rgw (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:18.369 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-22T01:33:18.437 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cephfs (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:18.478 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-22T01:33:18.555 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-common (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:18.788 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-22T01:33:19.098 INFO:teuthology.orchestra.run.smithi179.stdout:Adding group ceph....done 2024-09-22T01:33:19.216 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-22T01:33:19.475 INFO:teuthology.orchestra.run.smithi179.stdout:Adding system user ceph....done 2024-09-22T01:33:19.635 INFO:teuthology.orchestra.run.smithi179.stdout:Setting system user ceph properties....done 2024-09-22T01:33:19.647 INFO:teuthology.orchestra.run.smithi179.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-22T01:33:19.764 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-22T01:33:19.782 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-22T01:33:19.908 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-22T01:33:20.099 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-22T01:33:20.192 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-22T01:33:20.477 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-22T01:33:20.549 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-test (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:20.675 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up radosgw (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:20.822 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-22T01:33:21.127 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-22T01:33:21.127 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-22T01:33:21.207 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-22T01:33:21.500 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-22T01:33:21.577 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-base (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:21.869 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-22T01:33:21.970 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librados2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:21.971 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-22T01:33:22.072 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libsqlite3-mod-ceph (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:22.198 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-22T01:33:22.534 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:22.547 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mds (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:22.685 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libradosstriper1 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:22.803 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-22T01:33:22.804 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-22T01:33:22.811 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-22T01:33:23.087 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librbd1 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:23.213 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-modules-core (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:23.282 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:23.315 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-fuse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:23.502 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-22T01:33:23.502 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-22T01:33:23.526 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-22T01:33:23.526 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-22T01:33:23.967 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-osd (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:24.024 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs-dev (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:24.150 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rados (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:24.249 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-22T01:33:24.249 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-22T01:33:24.276 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librgw2 (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:24.402 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-22T01:33:24.702 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-k8sevents (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:24.812 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:24.963 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mon (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:25.168 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-22T01:33:25.168 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-22T01:33:25.581 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-cephadm (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:25.664 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rbd (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:25.732 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:25.790 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up rbd-fuse (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:25.858 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-dashboard (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:25.916 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rgw (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:26.018 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-volume (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:26.042 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cephfs (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:26.168 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-common (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:26.346 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-22T01:33:26.455 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-22T01:33:26.608 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-22T01:33:26.712 INFO:teuthology.orchestra.run.smithi018.stdout:Adding group ceph....done 2024-09-22T01:33:27.004 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user ceph....done 2024-09-22T01:33:27.174 INFO:teuthology.orchestra.run.smithi018.stdout:Setting system user ceph properties....done 2024-09-22T01:33:27.190 INFO:teuthology.orchestra.run.smithi018.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-22T01:33:27.336 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-22T01:33:27.625 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-22T01:33:27.890 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-22T01:33:28.120 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-test (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:28.229 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up radosgw (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:28.478 INFO:teuthology.orchestra.run.smithi179.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-22T01:33:28.483 DEBUG:teuthology.parallel:result is None 2024-09-22T01:33:28.720 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-22T01:33:28.721 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-22T01:33:29.201 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-base (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:29.702 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-22T01:33:30.176 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mds (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-22T01:33:30.410 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-22T01:33:30.895 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:31.132 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-22T01:33:31.132 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-22T01:33:31.621 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-osd (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:31.905 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-22T01:33:31.906 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-22T01:33:32.423 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-k8sevents (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:32.549 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:32.691 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mon (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:32.904 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-22T01:33:32.904 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-22T01:33:33.376 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-cephadm (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:33.519 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:33.678 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-dashboard (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:33.829 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-volume (19.1.1-373-g4e45e6b4-1jammy) ... 2024-09-22T01:33:34.274 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-22T01:33:34.400 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-22T01:33:34.544 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-22T01:33:35.561 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-22T01:33:36.231 INFO:teuthology.orchestra.run.smithi018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-22T01:33:36.235 DEBUG:teuthology.parallel:result is None 2024-09-22T01:33:36.235 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T01:33:36.372 DEBUG:teuthology.orchestra.run.smithi018:> dpkg-query -W -f '${Version}' ceph 2024-09-22T01:33:36.390 INFO:teuthology.orchestra.run.smithi018.stdout:19.1.1-373-g4e45e6b4-1jammy 2024-09-22T01:33:36.391 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373-g4e45e6b4-1jammy 2024-09-22T01:33:36.391 INFO:teuthology.task.install:The correct ceph version 19.1.1-373-g4e45e6b4-1jammy is installed. 2024-09-22T01:33:36.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T01:33:36.523 DEBUG:teuthology.orchestra.run.smithi179:> dpkg-query -W -f '${Version}' ceph 2024-09-22T01:33:36.542 INFO:teuthology.orchestra.run.smithi179.stdout:19.1.1-373-g4e45e6b4-1jammy 2024-09-22T01:33:36.542 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373-g4e45e6b4-1jammy 2024-09-22T01:33:36.542 INFO:teuthology.task.install:The correct ceph version 19.1.1-373-g4e45e6b4-1jammy is installed. 2024-09-22T01:33:36.544 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-22T01:33:36.545 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:33:36.545 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T01:33:36.560 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:33:36.560 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T01:33:36.598 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-22T01:33:36.598 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:33:36.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T01:33:36.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T01:33:36.671 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:33:36.671 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T01:33:36.685 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T01:33:36.741 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-22T01:33:36.741 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:33:36.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T01:33:36.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T01:33:36.806 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:33:36.807 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T01:33:36.819 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T01:33:36.872 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-22T01:33:36.872 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:33:36.872 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T01:33:36.887 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T01:33:36.942 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:33:36.943 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T01:33:36.955 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T01:33:37.009 INFO:teuthology.run_tasks:Running task ceph... 2024-09-22T01:33:37.094 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-22T01:33:37.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2024-09-22T01:33:37.096 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2024-09-22T01:33:37.108 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-22T01:33:37.109 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T01:33:37.152 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T01:33:37.164 INFO:tasks.ceph:Creating extra log directories... 2024-09-22T01:33:37.164 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T01:33:37.208 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T01:33:37.232 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-22T01:33:37.232 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd cache max dirty': 0}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-22T01:33:37.233 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619', 'branch': 'squid', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7914619', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache max dirty': 0}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1478, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'sleep_before_teardown': 0, 'subset': '24/128', 'suite': 'rbd', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'targets': {'smithi018.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGIf2GngkMgzOESKRi/TdAZTwM1+8TnchNIwKFgJ1fVLQOyclVhr/Et27KDBW4AgDZCYpXcDqY5Pm3mAZPcadXg=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO8/YGO1Px/ienr0T1JAl+rPAG+R0Zj/KNris1G9L0vbGKW2i8YULDVJ7sjmekIetlTG+iP9+SmI7GSz1vJkXkA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-21_21:16:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-22T01:33:37.233 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T01:33:37.264 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T01:33:37.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T01:33:37.312 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T01:33:37.325 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:33:37.325 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T01:33:37.371 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T01:33:37.372 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-22T01:33:37.420 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T01:33:37.420 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T01:33:37.420 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 871 Links: 1 2024-09-22T01:33:37.420 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T01:33:37.420 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-22 01:27:55.258979905 +0000 2024-09-22T01:33:37.420 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-22 01:27:54.902983086 +0000 2024-09-22T01:33:37.420 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-22 01:27:54.902983086 +0000 2024-09-22T01:33:37.420 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-09-22T01:33:37.420 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T01:33:37.474 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-22T01:33:37.474 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-22T01:33:37.474 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000329427 s, 1.6 MB/s 2024-09-22T01:33:37.475 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T01:33:37.525 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-22T01:33:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T01:33:37.571 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T01:33:37.572 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-22T01:33:37.572 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T01:33:37.572 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-22 01:27:55.706975904 +0000 2024-09-22T01:33:37.572 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-22 01:27:55.462978083 +0000 2024-09-22T01:33:37.572 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-22 01:27:55.462978083 +0000 2024-09-22T01:33:37.573 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-09-22T01:33:37.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T01:33:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-22T01:33:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-22T01:33:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000296261 s, 1.7 MB/s 2024-09-22T01:33:37.627 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T01:33:37.676 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-22T01:33:37.723 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T01:33:37.723 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T01:33:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-09-22T01:33:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T01:33:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-22 01:27:56.210971403 +0000 2024-09-22T01:33:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-22 01:27:55.950973725 +0000 2024-09-22T01:33:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-22 01:27:55.950973725 +0000 2024-09-22T01:33:37.724 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-09-22T01:33:37.724 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T01:33:37.777 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-22T01:33:37.777 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-22T01:33:37.778 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000278819 s, 1.8 MB/s 2024-09-22T01:33:37.779 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T01:33:37.829 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-22T01:33:37.875 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T01:33:37.876 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T01:33:37.876 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-22T01:33:37.876 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T01:33:37.876 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-22 01:27:56.670967294 +0000 2024-09-22T01:33:37.876 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-22 01:27:56.434969402 +0000 2024-09-22T01:33:37.876 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-22 01:27:56.434969402 +0000 2024-09-22T01:33:37.876 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-09-22T01:33:37.876 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T01:33:37.930 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-22T01:33:37.930 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-22T01:33:37.930 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000314017 s, 1.6 MB/s 2024-09-22T01:33:37.931 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T01:33:37.980 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T01:33:37.980 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:33:37.981 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T01:33:37.986 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T01:33:37.986 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-09-22T01:33:38.034 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T01:33:38.034 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T01:33:38.034 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-09-22T01:33:38.034 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T01:33:38.034 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-22 01:27:52.667878801 +0000 2024-09-22T01:33:38.034 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-22 01:27:52.395881230 +0000 2024-09-22T01:33:38.034 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-22 01:27:52.395881230 +0000 2024-09-22T01:33:38.034 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-09-22T01:33:38.035 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T01:33:38.088 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-22T01:33:38.088 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-22T01:33:38.088 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000384312 s, 1.3 MB/s 2024-09-22T01:33:38.089 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T01:33:38.139 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-09-22T01:33:38.185 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T01:33:38.186 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T01:33:38.186 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-22T01:33:38.186 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T01:33:38.186 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-22 01:27:53.167874334 +0000 2024-09-22T01:33:38.186 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-22 01:27:52.915876586 +0000 2024-09-22T01:33:38.186 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-22 01:27:52.915876586 +0000 2024-09-22T01:33:38.186 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-09-22T01:33:38.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T01:33:38.240 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-22T01:33:38.240 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-22T01:33:38.240 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000443994 s, 1.2 MB/s 2024-09-22T01:33:38.241 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T01:33:38.291 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-09-22T01:33:38.338 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T01:33:38.338 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T01:33:38.338 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-22T01:33:38.338 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T01:33:38.338 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-22 01:27:53.655869976 +0000 2024-09-22T01:33:38.338 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-22 01:27:53.415872119 +0000 2024-09-22T01:33:38.338 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-22 01:27:53.415872119 +0000 2024-09-22T01:33:38.338 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-09-22T01:33:38.339 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T01:33:38.392 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-22T01:33:38.392 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-22T01:33:38.392 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000412604 s, 1.2 MB/s 2024-09-22T01:33:38.393 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T01:33:38.443 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-09-22T01:33:38.490 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T01:33:38.490 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T01:33:38.490 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-22T01:33:38.490 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T01:33:38.490 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-22 01:27:54.135865689 +0000 2024-09-22T01:33:38.490 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-22 01:27:53.883867939 +0000 2024-09-22T01:33:38.490 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-22 01:27:53.883867939 +0000 2024-09-22T01:33:38.490 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-09-22T01:33:38.490 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T01:33:38.543 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-22T01:33:38.543 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-22T01:33:38.544 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000282918 s, 1.8 MB/s 2024-09-22T01:33:38.545 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T01:33:38.595 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T01:33:38.595 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-22T01:33:38.595 INFO:tasks.ceph:Generating config... 2024-09-22T01:33:38.596 INFO:tasks.ceph:[client] rbd cache = True 2024-09-22T01:33:38.596 INFO:tasks.ceph:[client] rbd cache max dirty = 0 2024-09-22T01:33:38.596 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-22T01:33:38.596 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-22T01:33:38.596 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-22T01:33:38.596 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-22T01:33:38.596 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-22T01:33:38.597 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-22T01:33:38.597 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-22T01:33:38.597 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-22T01:33:38.597 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-22T01:33:38.598 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-22T01:33:38.598 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-22T01:33:38.598 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-22T01:33:38.598 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-22T01:33:38.598 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-22T01:33:38.598 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-22T01:33:38.598 INFO:tasks.ceph:Setting up mon.a... 2024-09-22T01:33:38.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-22T01:33:38.633 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.keyring 2024-09-22T01:33:38.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-22T01:33:38.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T01:33:38.783 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.18'), ('mon.c', '[v2:172.21.15.18:3301,v1:172.21.15.18:6790]'), ('mon.b', '172.21.15.179')] 2024-09-22T01:33:38.784 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.179', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd cache max dirty': 0}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-22T01:33:38.784 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:33:38.784 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T01:33:38.831 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --addv c '[v2:172.21.15.18:3301,v1:172.21.15.18:6790]' --add b 172.21.15.179 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:33:38.919 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:33:38.919 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid 2d4626ba-577e-46d9-ad53-8451e5733f43 2024-09-22T01:33:38.919 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-09-22T01:33:38.919 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2024-09-22T01:33:38.920 INFO:teuthology.orchestra.run.smithi018.stdout:fsid 2d4626ba-577e-46d9-ad53-8451e5733f43 2024-09-22T01:33:38.920 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2024-09-22T01:33:38.920304+0000 2024-09-22T01:33:38.920 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-22T01:33:38.920304+0000 2024-09-22T01:33:38.920 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 17 (quincy) 2024-09-22T01:33:38.920 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2024-09-22T01:33:38.920 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-22T01:33:38.920 INFO:teuthology.orchestra.run.smithi018.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-09-22T01:33:38.920 INFO:teuthology.orchestra.run.smithi018.stdout:2: [v2:172.21.15.18:3301/0,v1:172.21.15.18:6790/0] mon.c 2024-09-22T01:33:38.920 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-22T01:33:38.921 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T01:33:38.926 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2d4626ba-577e-46d9-ad53-8451e5733f43... 2024-09-22T01:33:38.927 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T01:33:38.972 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-09-22T01:33:39.001 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-09-22T01:33:39.002 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.002 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-09-22T01:33:39.002 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-09-22T01:33:39.002 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.002 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T01:33:39.002 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-09-22T01:33:39.002 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.002 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T01:33:39.002 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T01:33:39.003 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.003 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-09-22T01:33:39.003 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.003 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-09-22T01:33:39.003 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-09-22T01:33:39.003 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-09-22T01:33:39.003 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-09-22T01:33:39.003 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-09-22T01:33:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-09-22T01:33:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-09-22T01:33:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T01:33:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T01:33:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-09-22T01:33:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T01:33:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.004 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-09-22T01:33:39.005 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.005 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-09-22T01:33:39.005 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.005 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-09-22T01:33:39.005 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-09-22T01:33:39.005 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-09-22T01:33:39.005 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.179" 2024-09-22T01:33:39.005 INFO:teuthology.orchestra.run.smithi018.stdout: mon client directed command retry = 5 2024-09-22T01:33:39.006 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on pool no app = False 2024-09-22T01:33:39.006 INFO:teuthology.orchestra.run.smithi018.stdout: ms inject socket failures = 5000 2024-09-22T01:33:39.006 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = 2d4626ba-577e-46d9-ad53-8451e5733f43 2024-09-22T01:33:39.006 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.006 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-09-22T01:33:39.006 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-09-22T01:33:39.006 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.006 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-09-22T01:33:39.007 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-09-22T01:33:39.007 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-09-22T01:33:39.007 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.007 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-09-22T01:33:39.007 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-09-22T01:33:39.007 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.007 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-09-22T01:33:39.008 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-09-22T01:33:39.008 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-09-22T01:33:39.008 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-09-22T01:33:39.008 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.008 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-09-22T01:33:39.008 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-09-22T01:33:39.008 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.008 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-09-22T01:33:39.008 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.009 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-09-22T01:33:39.009 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.009 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-09-22T01:33:39.009 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.009 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-09-22T01:33:39.009 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-09-22T01:33:39.009 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.009 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-09-22T01:33:39.010 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-09-22T01:33:39.010 INFO:teuthology.orchestra.run.smithi018.stdout: bdev async discard = True 2024-09-22T01:33:39.010 INFO:teuthology.orchestra.run.smithi018.stdout: bdev enable discard = True 2024-09-22T01:33:39.010 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore allocator = bitmap 2024-09-22T01:33:39.010 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-09-22T01:33:39.010 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-09-22T01:33:39.010 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 1/20 2024-09-22T01:33:39.010 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 1/20 2024-09-22T01:33:39.010 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-22T01:33:39.011 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-09-22T01:33:39.011 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 4/10 2024-09-22T01:33:39.011 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T01:33:39.011 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-09-22T01:33:39.011 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-09-22T01:33:39.011 INFO:teuthology.orchestra.run.smithi018.stdout: osd blocked scrub grace period = 3600 2024-09-22T01:33:39.011 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-09-22T01:33:39.011 INFO:teuthology.orchestra.run.smithi018.stdout: osd max markdown count = 1000 2024-09-22T01:33:39.011 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-09-22T01:33:39.012 INFO:teuthology.orchestra.run.smithi018.stdout: osd shutdown pgref assert = True 2024-09-22T01:33:39.012 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.012 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-09-22T01:33:39.012 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-22T01:33:39.012 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-09-22T01:33:39.012 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-09-22T01:33:39.012 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-09-22T01:33:39.012 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-09-22T01:33:39.012 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-09-22T01:33:39.012 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-09-22T01:33:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.013 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-09-22T01:33:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-22T01:33:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-09-22T01:33:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-09-22T01:33:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-09-22T01:33:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-09-22T01:33:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-09-22T01:33:39.013 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T01:33:39.014 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: rbd cache = True 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout: rbd cache max dirty = 0 2024-09-22T01:33:39.015 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-09-22T01:33:39.016 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-09-22T01:33:39.016 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-09-22T01:33:39.017 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-09-22T01:33:39.017 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-09-22T01:33:39.017 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T01:33:39.018 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T01:33:39.019 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.179" 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: mon client directed command retry = 5 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on pool no app = False 2024-09-22T01:33:39.020 INFO:teuthology.orchestra.run.smithi179.stdout: ms inject socket failures = 5000 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 2d4626ba-577e-46d9-ad53-8451e5733f43 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-09-22T01:33:39.021 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-09-22T01:33:39.022 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T01:33:39.023 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: osd blocked scrub grace period = 3600 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: osd max markdown count = 1000 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: osd shutdown pgref assert = True 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-09-22T01:33:39.024 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T01:33:39.025 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-09-22T01:33:39.026 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T01:33:39.027 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T01:33:39.027 INFO:teuthology.orchestra.run.smithi179.stdout: rbd cache = True 2024-09-22T01:33:39.027 INFO:teuthology.orchestra.run.smithi179.stdout: rbd cache max dirty = 0 2024-09-22T01:33:39.027 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-09-22T01:33:39.027 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-09-22T01:33:39.027 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-09-22T01:33:39.027 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-22T01:33:39.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-22T01:33:39.112 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-22T01:33:39.112 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:33:39.112 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-22T01:33:39.118 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:33:39.118 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-22T01:33:39.164 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:33:39.164 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:33:39.164 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T01:33:39.164 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T01:33:39.228 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:33:39.228 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:33:39.275 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:33:39.276 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:33:39.276 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T01:33:39.276 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T01:33:39.298 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:33:39.298 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:33:39.345 INFO:tasks.ceph:Setting up mon nodes... 2024-09-22T01:33:39.346 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-22T01:33:39.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-22T01:33:39.391 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-22T01:33:39.394 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T01:33:39.437 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T01:33:39.562 INFO:tasks.ceph:Setting up mds nodes... 2024-09-22T01:33:39.563 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-22T01:33:39.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-22T01:33:39.600 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-22T01:33:39.611 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-22T01:33:39.647 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-22T01:33:39.657 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-22T01:33:39.657 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-22T01:33:39.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-22T01:33:39.671 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T01:33:39.671 INFO:tasks.ceph:role: osd.0 2024-09-22T01:33:39.671 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:33:39.671 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T01:33:39.727 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T01:33:39.727 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T01:33:39.727 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T01:33:39.727 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-22T01:33:39.727 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T01:33:39.728 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-22T01:33:39.728 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T01:33:39.728 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-22T01:33:39.728 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T01:33:39.728 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T01:33:39.751 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-22T01:33:39.753 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-22T01:33:39.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-22T01:33:39.812 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-22T01:33:39.865 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-09-22T01:33:39.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:33:39.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-22T01:33:39.924 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T01:33:39.924 INFO:tasks.ceph:role: osd.1 2024-09-22T01:33:39.924 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:33:39.924 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T01:33:39.979 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T01:33:39.980 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T01:33:39.980 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T01:33:39.980 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-22T01:33:39.980 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T01:33:39.980 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-22T01:33:39.980 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T01:33:39.980 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-22T01:33:39.980 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T01:33:39.980 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T01:33:40.004 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-22T01:33:40.006 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-22T01:33:40.006 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-22T01:33:40.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-22T01:33:40.117 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-09-22T01:33:40.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:33:40.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-22T01:33:40.170 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T01:33:40.171 INFO:tasks.ceph:role: osd.2 2024-09-22T01:33:40.171 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:33:40.171 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T01:33:40.228 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T01:33:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T01:33:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T01:33:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-22T01:33:40.228 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T01:33:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-22T01:33:40.228 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T01:33:40.228 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-22T01:33:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T01:33:40.228 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T01:33:40.252 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-22T01:33:40.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-22T01:33:40.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-22T01:33:40.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-22T01:33:40.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:33:40.364 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-09-22T01:33:40.364 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-22T01:33:40.417 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-22T01:33:40.417 INFO:tasks.ceph:role: osd.3 2024-09-22T01:33:40.417 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:33:40.417 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-22T01:33:40.471 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T01:33:40.472 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T01:33:40.472 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T01:33:40.472 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-22T01:33:40.472 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T01:33:40.472 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-22T01:33:40.472 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T01:33:40.472 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-22T01:33:40.472 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T01:33:40.472 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T01:33:40.496 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-22T01:33:40.497 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-22T01:33:40.497 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-22T01:33:40.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-22T01:33:40.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:33:40.604 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-09-22T01:33:40.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:33:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:40.712+0000 7efdbf79a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-22T01:33:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:40.712+0000 7efdbf79a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-22T01:33:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:40.712+0000 7efdbf79a7c0 -1 bdev(0x55a88fd5b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-22T01:33:40.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:40.712+0000 7efdbf79a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-22T01:33:44.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-22T01:33:44.580 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:33:44.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:44.664+0000 7f47da4367c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-22T01:33:44.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:44.664+0000 7f47da4367c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-22T01:33:44.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:44.664+0000 7f47da4367c0 -1 bdev(0x55e329965800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-22T01:33:44.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:44.664+0000 7f47da4367c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-22T01:33:47.823 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-22T01:33:47.880 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:33:47.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:47.960+0000 7f6d72a3e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-22T01:33:47.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:47.960+0000 7f6d72a3e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-22T01:33:47.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:47.960+0000 7f6d72a3e7c0 -1 bdev(0x563351455800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-22T01:33:47.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:47.960+0000 7f6d72a3e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-22T01:33:51.353 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-22T01:33:51.408 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:33:51.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:51.487+0000 7f1f3bd1a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-22T01:33:51.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:51.487+0000 7f1f3bd1a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-22T01:33:51.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:51.487+0000 7f1f3bd1a7c0 -1 bdev(0x55dd1a6b1800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-22T01:33:51.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-22T01:33:51.487+0000 7f1f3bd1a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-22T01:33:55.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-22T01:33:55.424 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-22T01:33:55.443 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T01:33:55.443 INFO:tasks.ceph:role: osd.4 2024-09-22T01:33:55.443 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:33:55.443 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T01:33:55.505 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T01:33:55.505 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T01:33:55.505 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T01:33:55.505 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-22T01:33:55.505 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T01:33:55.505 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-22T01:33:55.505 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T01:33:55.505 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-22T01:33:55.505 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T01:33:55.505 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T01:33:55.958 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-22T01:33:55.960 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-22T01:33:55.960 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-22T01:33:56.063 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-22T01:33:56.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:33:56.075 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-09-22T01:33:56.075 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-22T01:33:56.129 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T01:33:56.130 INFO:tasks.ceph:role: osd.5 2024-09-22T01:33:56.130 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:33:56.130 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T01:33:56.194 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T01:33:56.194 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T01:33:56.194 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T01:33:56.195 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-22T01:33:56.195 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T01:33:56.195 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-22T01:33:56.195 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T01:33:56.195 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-22T01:33:56.195 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T01:33:56.195 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T01:33:56.668 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-22T01:33:56.671 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-22T01:33:56.671 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-22T01:33:56.816 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-22T01:33:56.827 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-09-22T01:33:56.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:33:56.828 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-22T01:33:56.881 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T01:33:56.881 INFO:tasks.ceph:role: osd.6 2024-09-22T01:33:56.881 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:33:56.881 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-22T01:33:56.945 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T01:33:56.945 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T01:33:56.945 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T01:33:56.945 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-22T01:33:56.946 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T01:33:56.946 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-22T01:33:56.946 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T01:33:56.946 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-22T01:33:56.946 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T01:33:56.946 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T01:33:57.423 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-22T01:33:57.425 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-22T01:33:57.426 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-22T01:33:57.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-22T01:33:57.588 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-09-22T01:33:57.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:33:57.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-22T01:33:57.644 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-22T01:33:57.644 INFO:tasks.ceph:role: osd.7 2024-09-22T01:33:57.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:33:57.644 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-22T01:33:57.704 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T01:33:57.704 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T01:33:57.704 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T01:33:57.704 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-22T01:33:57.704 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T01:33:57.705 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-09-22T01:33:57.705 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T01:33:57.705 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-22T01:33:57.705 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T01:33:57.705 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T01:33:58.136 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-09-22T01:33:58.138 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-09-22T01:33:58.138 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-22T01:33:58.222 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-22T01:33:58.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:33:58.278 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-09-22T01:33:58.278 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:33:58.385 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:33:58.383+0000 7fb6057907c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-22T01:33:58.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:33:58.383+0000 7fb6057907c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-22T01:33:58.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:33:58.383+0000 7fb6057907c0 -1 bdev(0x55aa1e8c3800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-22T01:33:58.387 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:33:58.383+0000 7fb6057907c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-22T01:34:01.521 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-22T01:34:01.535 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:34:01.615 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:01.611+0000 7f053d4b27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-22T01:34:01.616 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:01.611+0000 7f053d4b27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-22T01:34:01.616 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:01.611+0000 7f053d4b27c0 -1 bdev(0x55c9a7a7f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-22T01:34:01.616 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:01.611+0000 7f053d4b27c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-22T01:34:04.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-22T01:34:04.814 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:34:04.897 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:04.895+0000 7fbf47a2c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-22T01:34:04.897 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:04.895+0000 7fbf47a2c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-22T01:34:04.898 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:04.895+0000 7fbf47a2c7c0 -1 bdev(0x556464a91800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-22T01:34:04.898 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:04.895+0000 7fbf47a2c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-22T01:34:08.061 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-22T01:34:08.117 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:34:08.199 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:08.195+0000 7f6d8e4397c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-22T01:34:08.200 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:08.195+0000 7f6d8e4397c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-22T01:34:08.200 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:08.195+0000 7f6d8e4397c0 -1 bdev(0x55fe57f95800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-22T01:34:08.200 INFO:teuthology.orchestra.run.smithi179.stderr:2024-09-22T01:34:08.195+0000 7f6d8e4397c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-22T01:34:11.327 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-22T01:34:11.386 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-22T01:34:11.386 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:34:11.386 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-22T01:34:11.401 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:34:11.401 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-22T01:34:11.456 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:34:11.456 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-22T01:34:11.511 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:34:11.511 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-22T01:34:11.566 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:34:11.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-22T01:34:11.622 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:34:11.622 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-22T01:34:11.636 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:34:11.636 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-22T01:34:11.689 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:34:11.689 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-22T01:34:11.744 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:34:11.744 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-22T01:34:11.800 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:34:11.801 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-22T01:34:11.856 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:34:11.856 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-22T01:34:11.861 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:34:11.862 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-22T01:34:11.901 INFO:tasks.ceph:Adding keys to all mons... 2024-09-22T01:34:11.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T01:34:11.904 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T01:34:11.947 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.y] 2024-09-22T01:34:11.947 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDzc+9m5MhiFxAASsho7O7YXT1ywZHDWlizNg== 2024-09-22T01:34:11.947 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2024-09-22T01:34:11.947 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQD0c+9mBmm/KhAAW7iN1ItikeZyqZI24Qw9yQ== 2024-09-22T01:34:11.947 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2024-09-22T01:34:11.947 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQD4c+9mCKraJxAAqcSPCEvxuKsfxRzPt1wmbQ== 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQD7c+9mxvF4ORAArRVlP71XSkcR4/obZlBlTQ== 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.3] 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQD/c+9m2lphHRAAaJ7GP3OshjrHfDgHtQN77w== 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDzc+9mrXUiGhAAC/QoaXNd1QsSeN3U3sMkYA== 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.4] 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAGdO9mM9ETFxAALy7cRbXMcNF2Jpm9HbH4+w== 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.5] 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAJdO9mEVLCJBAAmG/Gy8aJWK8XZf/GpbRHfg== 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.6] 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAMdO9m3EqONRAAt0N7dj1vMlSomPm8FEWVHA== 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.7] 2024-09-22T01:34:11.948 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAQdO9m/7n6CxAAzL+5SmpuPC6Irg4We96ZQg== 2024-09-22T01:34:11.949 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-22T01:34:11.949 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDzc+9m3GDZIxAAQeyZtZDhHL1yoPfiKWxZ5w== 2024-09-22T01:34:11.949 INFO:teuthology.orchestra.run.smithi018.stdout:[client.1] 2024-09-22T01:34:11.949 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQDzc+9mrvmjJhAAZmwGz8og2Z3tPKMxcx+u9w== 2024-09-22T01:34:11.955 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2024-09-22T01:34:11.956 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDzc+9m5MhiFxAASsho7O7YXT1ywZHDWlizNg== 2024-09-22T01:34:11.956 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2024-09-22T01:34:11.956 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQD0c+9mBmm/KhAAW7iN1ItikeZyqZI24Qw9yQ== 2024-09-22T01:34:11.956 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2024-09-22T01:34:11.956 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQD4c+9mCKraJxAAqcSPCEvxuKsfxRzPt1wmbQ== 2024-09-22T01:34:11.956 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2024-09-22T01:34:11.956 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQD7c+9mxvF4ORAArRVlP71XSkcR4/obZlBlTQ== 2024-09-22T01:34:11.956 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2024-09-22T01:34:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQD/c+9m2lphHRAAaJ7GP3OshjrHfDgHtQN77w== 2024-09-22T01:34:11.957 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2024-09-22T01:34:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDzc+9mrXUiGhAAC/QoaXNd1QsSeN3U3sMkYA== 2024-09-22T01:34:11.957 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2024-09-22T01:34:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAGdO9mM9ETFxAALy7cRbXMcNF2Jpm9HbH4+w== 2024-09-22T01:34:11.957 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2024-09-22T01:34:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAJdO9mEVLCJBAAmG/Gy8aJWK8XZf/GpbRHfg== 2024-09-22T01:34:11.957 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2024-09-22T01:34:11.957 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAMdO9m3EqONRAAt0N7dj1vMlSomPm8FEWVHA== 2024-09-22T01:34:11.958 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2024-09-22T01:34:11.958 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAQdO9m/7n6CxAAzL+5SmpuPC6Irg4We96ZQg== 2024-09-22T01:34:11.958 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2024-09-22T01:34:11.958 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDzc+9m3GDZIxAAQeyZtZDhHL1yoPfiKWxZ5w== 2024-09-22T01:34:11.958 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2024-09-22T01:34:11.958 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDzc+9mrvmjJhAAZmwGz8og2Z3tPKMxcx+u9w== 2024-09-22T01:34:11.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T01:34:11.992 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T01:34:12.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.048 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.132 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.178 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.264 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T01:34:12.348 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T01:34:12.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.432 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.511 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.520 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.608 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T01:34:12.738 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T01:34:12.780 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T01:34:12.827 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T01:34:12.829 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T01:34:12.908 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-22T01:34:12.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-22T01:34:12.920 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T01:34:13.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-22T01:34:13.018 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-22T01:34:13.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T01:34:13.162 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-22T01:34:13.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-22T01:34:13.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T01:34:13.324 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-22T01:34:13.335 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:34:13.338 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T01:34:13.381 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-22T01:34:13.381 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-22T01:34:13.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-22T01:34:13.384 INFO:tasks.ceph.mon.a:Started 2024-09-22T01:34:13.384 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-22T01:34:13.384 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-22T01:34:13.386 INFO:tasks.ceph.mon.c:Started 2024-09-22T01:34:13.387 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-22T01:34:13.387 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-22T01:34:13.426 INFO:tasks.ceph.mon.b:Started 2024-09-22T01:34:13.426 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-22T01:34:13.427 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-22T01:34:13.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-22T01:34:13.429 INFO:tasks.ceph.mgr.y:Started 2024-09-22T01:34:13.429 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-22T01:34:13.429 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-22T01:34:13.431 INFO:tasks.ceph.mgr.x:Started 2024-09-22T01:34:13.432 INFO:tasks.ceph:Setting crush tunables to default 2024-09-22T01:34:13.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd crush tunables default 2024-09-22T01:34:18.901 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-09-22T01:34:18.920 INFO:tasks.ceph:check_enable_crimson: False 2024-09-22T01:34:18.921 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-22T01:34:18.921 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:34:18.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-22T01:34:18.932 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:34:18.932 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-22T01:34:18.985 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:34:18.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-22T01:34:19.010 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:19.007+0000 7fb1b9001180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-22T01:34:19.038 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-22T01:34:19.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-22T01:34:19.071 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:19.067+0000 7f587d15e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-22T01:34:19.083 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:34:19.083 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-22T01:34:19.097 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:34:19.097 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-22T01:34:19.152 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:34:19.153 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-22T01:34:19.212 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-22T01:34:19.212 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-22T01:34:19.267 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 8de621b1-0a3b-4b8b-b982-70e8db073085 0 2024-09-22T01:34:19.517 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:19.515+0000 7fb1b9001180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-22T01:34:19.521 INFO:teuthology.orchestra.run.smithi179.stdout:0 2024-09-22T01:34:19.539 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 798cbd57-ebd4-461a-9bbf-68e683d1049e 1 2024-09-22T01:34:19.601 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:19.599+0000 7f587d15e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-22T01:34:19.710 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:19.707+0000 7fb1b9001180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-22T01:34:19.736 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-22T01:34:19.753 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 9294585f-3dc9-4b04-8cae-f8d78c92791e 2 2024-09-22T01:34:19.861 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:19.859+0000 7f587d15e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-22T01:34:19.948 INFO:teuthology.orchestra.run.smithi179.stdout:2 2024-09-22T01:34:19.965 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 1ff1abf7-fdbb-4f8a-85e5-90f102abcec2 3 2024-09-22T01:34:20.150 INFO:teuthology.orchestra.run.smithi179.stdout:3 2024-09-22T01:34:20.167 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 9aa2579a-ada1-45f3-9341-f46697c28212 4 2024-09-22T01:34:20.292 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:20.287+0000 7fb1b9001180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-22T01:34:20.349 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:20.347+0000 7fb1b9001180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-22T01:34:20.358 INFO:teuthology.orchestra.run.smithi179.stdout:4 2024-09-22T01:34:20.374 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 4a6678eb-28ca-4b05-96ae-e9deeb60ca96 5 2024-09-22T01:34:20.405 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:20.403+0000 7fb1b9001180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-22T01:34:20.485 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:20.483+0000 7f587d15e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-22T01:34:20.486 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:20.483+0000 7fb1b9001180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-22T01:34:20.539 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:20.535+0000 7fb1b9001180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-22T01:34:20.541 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:20.539+0000 7f587d15e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-22T01:34:20.570 INFO:teuthology.orchestra.run.smithi179.stdout:5 2024-09-22T01:34:20.587 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 775b01e8-5705-4b98-a3ab-f15a78271355 6 2024-09-22T01:34:20.597 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:20.595+0000 7f587d15e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-22T01:34:20.619 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:20.615+0000 7fb1b9001180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-22T01:34:20.673 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:20.671+0000 7fb1b9001180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-22T01:34:20.678 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:20.675+0000 7f587d15e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-22T01:34:20.733 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:20.731+0000 7f587d15e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-22T01:34:20.816 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:20.815+0000 7f587d15e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-22T01:34:20.816 INFO:teuthology.orchestra.run.smithi179.stdout:6 2024-09-22T01:34:20.830 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:20.827+0000 7fb1b9001180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-22T01:34:20.833 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 15f6d6c1-8a16-42c6-9e43-f3a92e511735 7 2024-09-22T01:34:20.873 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:20.871+0000 7f587d15e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-22T01:34:20.894 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:20.891+0000 7fb1b9001180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-22T01:34:21.026 INFO:teuthology.orchestra.run.smithi179.stdout:7 2024-09-22T01:34:21.031 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:21.031+0000 7f587d15e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-22T01:34:21.041 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-22T01:34:21.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-22T01:34:21.044 INFO:tasks.ceph.osd.0:Started 2024-09-22T01:34:21.044 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-22T01:34:21.044 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-22T01:34:21.046 INFO:tasks.ceph.osd.1:Started 2024-09-22T01:34:21.047 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-22T01:34:21.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-22T01:34:21.049 INFO:tasks.ceph.osd.2:Started 2024-09-22T01:34:21.049 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-22T01:34:21.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-22T01:34:21.051 INFO:tasks.ceph.osd.3:Started 2024-09-22T01:34:21.052 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-22T01:34:21.052 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-22T01:34:21.053 INFO:tasks.ceph.osd.4:Started 2024-09-22T01:34:21.054 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-22T01:34:21.054 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-22T01:34:21.055 INFO:tasks.ceph.osd.5:Started 2024-09-22T01:34:21.055 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-22T01:34:21.056 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-22T01:34:21.057 INFO:tasks.ceph.osd.6:Started 2024-09-22T01:34:21.057 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-22T01:34:21.058 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-22T01:34:21.059 INFO:tasks.ceph.osd.7:Started 2024-09-22T01:34:21.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T01:34:21.114 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:21.111+0000 7f587d15e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-22T01:34:21.259 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:34:21.259 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"fsid":"2d4626ba-577e-46d9-ad53-8451e5733f43","created":"2024-09-22T01:34:18.722829+0000","modified":"2024-09-22T01:34:21.023265+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T01:34:21.023265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8de621b1-0a3b-4b8b-b982-70e8db073085","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"798cbd57-ebd4-461a-9bbf-68e683d1049e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9294585f-3dc9-4b04-8cae-f8d78c92791e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ff1abf7-fdbb-4f8a-85e5-90f102abcec2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9aa2579a-ada1-45f3-9341-f46697c28212","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4a6678eb-28ca-4b05-96ae-e9deeb60ca96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"775b01e8-5705-4b98-a3ab-f15a78271355","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15f6d6c1-8a16-42c6-9e43-f3a92e511735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T01:34:21.275 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-22T01:34:21.275 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-22T01:34:21.515 INFO:tasks.ceph.mgr.x.smithi179.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-22T01:34:21.515 INFO:tasks.ceph.mgr.x.smithi179.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-22T01:34:21.515 INFO:tasks.ceph.mgr.x.smithi179.stderr: from numpy import show_config as show_numpy_config 2024-09-22T01:34:21.564 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:21.559+0000 7fb1b9001180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-22T01:34:21.698 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:21.695+0000 7fb1b9001180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-22T01:34:21.860 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:21.855+0000 7fb1b9001180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-22T01:34:21.922 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:21.919+0000 7fb1b9001180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-22T01:34:21.928 INFO:tasks.ceph.mgr.y.smithi018.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-22T01:34:21.928 INFO:tasks.ceph.mgr.y.smithi018.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-22T01:34:21.928 INFO:tasks.ceph.mgr.y.smithi018.stderr: from numpy import show_config as show_numpy_config 2024-09-22T01:34:21.995 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:21.995+0000 7f587d15e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-22T01:34:22.056 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:22.051+0000 7fb1b9001180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-22T01:34:22.080 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T01:34:22.151 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:22.151+0000 7f587d15e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-22T01:34:22.295 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-22T01:34:22.295 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":10,"fsid":"2d4626ba-577e-46d9-ad53-8451e5733f43","created":"2024-09-22T01:34:18.722829+0000","modified":"2024-09-22T01:34:21.023265+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T01:34:21.023265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8de621b1-0a3b-4b8b-b982-70e8db073085","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"798cbd57-ebd4-461a-9bbf-68e683d1049e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9294585f-3dc9-4b04-8cae-f8d78c92791e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ff1abf7-fdbb-4f8a-85e5-90f102abcec2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9aa2579a-ada1-45f3-9341-f46697c28212","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4a6678eb-28ca-4b05-96ae-e9deeb60ca96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"775b01e8-5705-4b98-a3ab-f15a78271355","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15f6d6c1-8a16-42c6-9e43-f3a92e511735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T01:34:22.310 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-22T01:34:22.354 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:22.351+0000 7f587d15e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-22T01:34:22.426 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:22.427+0000 7f587d15e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-22T01:34:22.481 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:22.479+0000 7f983fb2c7c0 -1 Falling back to public interface 2024-09-22T01:34:22.520 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:22.519+0000 7fc1bd8cd7c0 -1 Falling back to public interface 2024-09-22T01:34:22.579 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:22.579+0000 7f587d15e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-22T01:34:22.641 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:22.639+0000 7fc6c2df37c0 -1 Falling back to public interface 2024-09-22T01:34:22.659 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:22.655+0000 7fb1b9001180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-22T01:34:22.705 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:22.703+0000 7f8dd86c47c0 -1 Falling back to public interface 2024-09-22T01:34:22.708 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:22.707+0000 7fc38303b7c0 -1 Falling back to public interface 2024-09-22T01:34:22.735 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:22.731+0000 7fb1b9001180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-22T01:34:22.891 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:22.887+0000 7f958515a7c0 -1 Falling back to public interface 2024-09-22T01:34:22.918 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:22.915+0000 7fb1b9001180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-22T01:34:22.992 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:22.987+0000 7fb1b9001180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-22T01:34:23.009 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:23.007+0000 7f29474307c0 -1 Falling back to public interface 2024-09-22T01:34:23.174 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:23.171+0000 7f2df3b3f7c0 -1 Falling back to public interface 2024-09-22T01:34:23.281 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:23.279+0000 7fb1b9001180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-22T01:34:23.343 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:23.339+0000 7fb1b9001180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-22T01:34:23.345 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:23.343+0000 7f587d15e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-22T01:34:23.429 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:23.427+0000 7f587d15e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-22T01:34:23.622 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:23.619+0000 7f587d15e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-22T01:34:23.699 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:23.699+0000 7f587d15e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-22T01:34:24.009 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:24.007+0000 7f587d15e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-22T01:34:24.074 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-22T01:34:24.071+0000 7f587d15e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-22T01:34:24.384 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:24.379+0000 7fb15fb38640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-22T01:34:24.384 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-09-22T01:34:24.379+0000 7fb15fb38640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-22T01:34:26.874 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:26.871+0000 7fc6c2df37c0 -1 osd.7 0 log_to_monitors true 2024-09-22T01:34:26.967 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:26.963+0000 7f8dd86c47c0 -1 osd.6 0 log_to_monitors true 2024-09-22T01:34:27.032 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:27.031+0000 7f983fb2c7c0 -1 osd.1 0 log_to_monitors true 2024-09-22T01:34:27.190 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:27.187+0000 7f958515a7c0 -1 osd.5 0 log_to_monitors true 2024-09-22T01:34:27.272 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:27.271+0000 7fc38303b7c0 -1 osd.2 0 log_to_monitors true 2024-09-22T01:34:27.305 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:27.303+0000 7f29474307c0 -1 osd.0 0 log_to_monitors true 2024-09-22T01:34:27.410 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:27.411+0000 7fc1bd8cd7c0 -1 osd.3 0 log_to_monitors true 2024-09-22T01:34:27.544 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:27.539+0000 7f2df3b3f7c0 -1 osd.4 0 log_to_monitors true 2024-09-22T01:34:29.117 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T01:34:29.470 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-22T01:34:29.471 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":12,"fsid":"2d4626ba-577e-46d9-ad53-8451e5733f43","created":"2024-09-22T01:34:18.722829+0000","modified":"2024-09-22T01:34:28.811520+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T01:34:21.023265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8de621b1-0a3b-4b8b-b982-70e8db073085","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"798cbd57-ebd4-461a-9bbf-68e683d1049e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9294585f-3dc9-4b04-8cae-f8d78c92791e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1ff1abf7-fdbb-4f8a-85e5-90f102abcec2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9aa2579a-ada1-45f3-9341-f46697c28212","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4a6678eb-28ca-4b05-96ae-e9deeb60ca96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"775b01e8-5705-4b98-a3ab-f15a78271355","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"15f6d6c1-8a16-42c6-9e43-f3a92e511735","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T01:34:29.491 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-22T01:34:30.277 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:30.275+0000 7f2943beb640 -1 osd.0 0 waiting for initial osdmap 2024-09-22T01:34:30.303 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:30.303+0000 7f293b1fd640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T01:34:30.339 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:30.339+0000 7fc1b9053640 -1 osd.3 0 waiting for initial osdmap 2024-09-22T01:34:30.363 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:30.363+0000 7fc1b169a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T01:34:30.397 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:30.395+0000 7f983b2b2640 -1 osd.1 0 waiting for initial osdmap 2024-09-22T01:34:30.420 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:30.419+0000 7f98338f9640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T01:34:30.462 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:30.459+0000 7fc37f7f6640 -1 osd.2 0 waiting for initial osdmap 2024-09-22T01:34:30.491 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:30.491+0000 7fc376e08640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T01:34:30.830 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:30.827+0000 7f2df02fa640 -1 osd.4 0 waiting for initial osdmap 2024-09-22T01:34:30.862 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:30.859+0000 7f2de790c640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T01:34:30.911 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:30.907+0000 7f8dd3e4a640 -1 osd.6 0 waiting for initial osdmap 2024-09-22T01:34:30.933 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:30.931+0000 7fc6be579640 -1 osd.7 0 waiting for initial osdmap 2024-09-22T01:34:30.937 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:30.935+0000 7f8dcc491640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T01:34:30.954 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:30.951+0000 7f95808e0640 -1 osd.5 0 waiting for initial osdmap 2024-09-22T01:34:30.957 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:30.955+0000 7fc6b6bc0640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T01:34:30.981 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:30.979+0000 7f9578f27640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-22T01:34:36.297 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T01:34:36.603 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-22T01:34:36.603 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":16,"fsid":"2d4626ba-577e-46d9-ad53-8451e5733f43","created":"2024-09-22T01:34:18.722829+0000","modified":"2024-09-22T01:34:34.298249+0000","last_up_change":"2024-09-22T01:34:31.284224+0000","last_in_change":"2024-09-22T01:34:21.023265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T01:34:31.452919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8de621b1-0a3b-4b8b-b982-70e8db073085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6825","nonce":1213730345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6827","nonce":1213730345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6831","nonce":1213730345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6829","nonce":1213730345}]},"public_addr":"172.21.15.18:6825/1213730345","cluster_addr":"172.21.15.18:6827/1213730345","heartbeat_back_addr":"172.21.15.18:6831/1213730345","heartbeat_front_addr":"172.21.15.18:6829/1213730345","state":["exists","up"]},{"osd":1,"uuid":"798cbd57-ebd4-461a-9bbf-68e683d1049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6801","nonce":3361514324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6803","nonce":3361514324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6807","nonce":3361514324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6805","nonce":3361514324}]},"public_addr":"172.21.15.18:6801/3361514324","cluster_addr":"172.21.15.18:6803/3361514324","heartbeat_back_addr":"172.21.15.18:6807/3361514324","heartbeat_front_addr":"172.21.15.18:6805/3361514324","state":["exists","up"]},{"osd":2,"uuid":"9294585f-3dc9-4b04-8cae-f8d78c92791e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6817","nonce":4002178714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6819","nonce":4002178714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6823","nonce":4002178714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6821","nonce":4002178714}]},"public_addr":"172.21.15.18:6817/4002178714","cluster_addr":"172.21.15.18:6819/4002178714","heartbeat_back_addr":"172.21.15.18:6823/4002178714","heartbeat_front_addr":"172.21.15.18:6821/4002178714","state":["exists","up"]},{"osd":3,"uuid":"1ff1abf7-fdbb-4f8a-85e5-90f102abcec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6809","nonce":2610959301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6811","nonce":2610959301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6815","nonce":2610959301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6813","nonce":2610959301}]},"public_addr":"172.21.15.18:6809/2610959301","cluster_addr":"172.21.15.18:6811/2610959301","heartbeat_back_addr":"172.21.15.18:6815/2610959301","heartbeat_front_addr":"172.21.15.18:6813/2610959301","state":["exists","up"]},{"osd":4,"uuid":"9aa2579a-ada1-45f3-9341-f46697c28212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6825","nonce":482886379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6827","nonce":482886379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6831","nonce":482886379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6829","nonce":482886379}]},"public_addr":"172.21.15.179:6825/482886379","cluster_addr":"172.21.15.179:6827/482886379","heartbeat_back_addr":"172.21.15.179:6831/482886379","heartbeat_front_addr":"172.21.15.179:6829/482886379","state":["exists","up"]},{"osd":5,"uuid":"4a6678eb-28ca-4b05-96ae-e9deeb60ca96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6817","nonce":2695689817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6819","nonce":2695689817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6823","nonce":2695689817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6821","nonce":2695689817}]},"public_addr":"172.21.15.179:6817/2695689817","cluster_addr":"172.21.15.179:6819/2695689817","heartbeat_back_addr":"172.21.15.179:6823/2695689817","heartbeat_front_addr":"172.21.15.179:6821/2695689817","state":["exists","up"]},{"osd":6,"uuid":"775b01e8-5705-4b98-a3ab-f15a78271355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6809","nonce":1840779137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6811","nonce":1840779137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6815","nonce":1840779137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6813","nonce":1840779137}]},"public_addr":"172.21.15.179:6809/1840779137","cluster_addr":"172.21.15.179:6811/1840779137","heartbeat_back_addr":"172.21.15.179:6815/1840779137","heartbeat_front_addr":"172.21.15.179:6813/1840779137","state":["exists","up"]},{"osd":7,"uuid":"15f6d6c1-8a16-42c6-9e43-f3a92e511735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6801","nonce":4222842386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6803","nonce":4222842386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6807","nonce":4222842386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6805","nonce":4222842386}]},"public_addr":"172.21.15.179:6801/4222842386","cluster_addr":"172.21.15.179:6803/4222842386","heartbeat_back_addr":"172.21.15.179:6807/4222842386","heartbeat_front_addr":"172.21.15.179:6805/4222842386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.339566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.065958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.261750+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.463117+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.557372+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.195553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.008891+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:27.839466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T01:34:36.620 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-22T01:34:36.621 INFO:tasks.ceph:Creating RBD pool 2024-09-22T01:34:36.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-22T01:34:37.337 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'rbd' created 2024-09-22T01:34:37.362 DEBUG:teuthology.orchestra.run.smithi018:> rbd --cluster ceph pool init rbd 2024-09-22T01:34:40.392 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-22T01:34:40.393 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-22T01:34:40.393 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-22T01:34:40.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-22T01:34:40.393 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-22T01:34:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:34:40.774 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":2197828546},{"type":"v1","addr":"172.21.15.179:6833","nonce":2197828546}]},"active_addr":"172.21.15.179:6833/2197828546","active_change":"2024-09-22T01:34:23.364478+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":709124374}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":3980030444}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2202970085}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":69441547}]}]} 2024-09-22T01:34:40.778 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-22T01:34:40.778 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T01:34:40.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T01:34:41.085 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:34:41.085 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"fsid":"2d4626ba-577e-46d9-ad53-8451e5733f43","created":"2024-09-22T01:34:18.722829+0000","modified":"2024-09-22T01:34:40.356046+0000","last_up_change":"2024-09-22T01:34:31.284224+0000","last_in_change":"2024-09-22T01:34:21.023265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T01:34:31.452919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T01:34:36.960578+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8de621b1-0a3b-4b8b-b982-70e8db073085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6825","nonce":1213730345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6827","nonce":1213730345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6831","nonce":1213730345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6829","nonce":1213730345}]},"public_addr":"172.21.15.18:6825/1213730345","cluster_addr":"172.21.15.18:6827/1213730345","heartbeat_back_addr":"172.21.15.18:6831/1213730345","heartbeat_front_addr":"172.21.15.18:6829/1213730345","state":["exists","up"]},{"osd":1,"uuid":"798cbd57-ebd4-461a-9bbf-68e683d1049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6801","nonce":3361514324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6803","nonce":3361514324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6807","nonce":3361514324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6805","nonce":3361514324}]},"public_addr":"172.21.15.18:6801/3361514324","cluster_addr":"172.21.15.18:6803/3361514324","heartbeat_back_addr":"172.21.15.18:6807/3361514324","heartbeat_front_addr":"172.21.15.18:6805/3361514324","state":["exists","up"]},{"osd":2,"uuid":"9294585f-3dc9-4b04-8cae-f8d78c92791e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6817","nonce":4002178714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6819","nonce":4002178714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6823","nonce":4002178714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6821","nonce":4002178714}]},"public_addr":"172.21.15.18:6817/4002178714","cluster_addr":"172.21.15.18:6819/4002178714","heartbeat_back_addr":"172.21.15.18:6823/4002178714","heartbeat_front_addr":"172.21.15.18:6821/4002178714","state":["exists","up"]},{"osd":3,"uuid":"1ff1abf7-fdbb-4f8a-85e5-90f102abcec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6809","nonce":2610959301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6811","nonce":2610959301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6815","nonce":2610959301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6813","nonce":2610959301}]},"public_addr":"172.21.15.18:6809/2610959301","cluster_addr":"172.21.15.18:6811/2610959301","heartbeat_back_addr":"172.21.15.18:6815/2610959301","heartbeat_front_addr":"172.21.15.18:6813/2610959301","state":["exists","up"]},{"osd":4,"uuid":"9aa2579a-ada1-45f3-9341-f46697c28212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6825","nonce":482886379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6827","nonce":482886379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6831","nonce":482886379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6829","nonce":482886379}]},"public_addr":"172.21.15.179:6825/482886379","cluster_addr":"172.21.15.179:6827/482886379","heartbeat_back_addr":"172.21.15.179:6831/482886379","heartbeat_front_addr":"172.21.15.179:6829/482886379","state":["exists","up"]},{"osd":5,"uuid":"4a6678eb-28ca-4b05-96ae-e9deeb60ca96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6817","nonce":2695689817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6819","nonce":2695689817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6823","nonce":2695689817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6821","nonce":2695689817}]},"public_addr":"172.21.15.179:6817/2695689817","cluster_addr":"172.21.15.179:6819/2695689817","heartbeat_back_addr":"172.21.15.179:6823/2695689817","heartbeat_front_addr":"172.21.15.179:6821/2695689817","state":["exists","up"]},{"osd":6,"uuid":"775b01e8-5705-4b98-a3ab-f15a78271355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6809","nonce":1840779137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6811","nonce":1840779137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6815","nonce":1840779137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6813","nonce":1840779137}]},"public_addr":"172.21.15.179:6809/1840779137","cluster_addr":"172.21.15.179:6811/1840779137","heartbeat_back_addr":"172.21.15.179:6815/1840779137","heartbeat_front_addr":"172.21.15.179:6813/1840779137","state":["exists","up"]},{"osd":7,"uuid":"15f6d6c1-8a16-42c6-9e43-f3a92e511735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6801","nonce":4222842386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6803","nonce":4222842386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6807","nonce":4222842386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6805","nonce":4222842386}]},"public_addr":"172.21.15.179:6801/4222842386","cluster_addr":"172.21.15.179:6803/4222842386","heartbeat_back_addr":"172.21.15.179:6807/4222842386","heartbeat_front_addr":"172.21.15.179:6805/4222842386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.339566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.065958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.261750+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.463117+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.557372+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.195553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.008891+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:27.839466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T01:34:41.102 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T01:34:41.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T01:34:41.394 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:34:41.394 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"fsid":"2d4626ba-577e-46d9-ad53-8451e5733f43","created":"2024-09-22T01:34:18.722829+0000","modified":"2024-09-22T01:34:40.356046+0000","last_up_change":"2024-09-22T01:34:31.284224+0000","last_in_change":"2024-09-22T01:34:21.023265+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T01:34:31.452919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T01:34:36.960578+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8de621b1-0a3b-4b8b-b982-70e8db073085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6825","nonce":1213730345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6827","nonce":1213730345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6831","nonce":1213730345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6829","nonce":1213730345}]},"public_addr":"172.21.15.18:6825/1213730345","cluster_addr":"172.21.15.18:6827/1213730345","heartbeat_back_addr":"172.21.15.18:6831/1213730345","heartbeat_front_addr":"172.21.15.18:6829/1213730345","state":["exists","up"]},{"osd":1,"uuid":"798cbd57-ebd4-461a-9bbf-68e683d1049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6801","nonce":3361514324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6803","nonce":3361514324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6807","nonce":3361514324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6805","nonce":3361514324}]},"public_addr":"172.21.15.18:6801/3361514324","cluster_addr":"172.21.15.18:6803/3361514324","heartbeat_back_addr":"172.21.15.18:6807/3361514324","heartbeat_front_addr":"172.21.15.18:6805/3361514324","state":["exists","up"]},{"osd":2,"uuid":"9294585f-3dc9-4b04-8cae-f8d78c92791e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6817","nonce":4002178714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6819","nonce":4002178714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6823","nonce":4002178714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6821","nonce":4002178714}]},"public_addr":"172.21.15.18:6817/4002178714","cluster_addr":"172.21.15.18:6819/4002178714","heartbeat_back_addr":"172.21.15.18:6823/4002178714","heartbeat_front_addr":"172.21.15.18:6821/4002178714","state":["exists","up"]},{"osd":3,"uuid":"1ff1abf7-fdbb-4f8a-85e5-90f102abcec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6809","nonce":2610959301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6811","nonce":2610959301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6815","nonce":2610959301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6813","nonce":2610959301}]},"public_addr":"172.21.15.18:6809/2610959301","cluster_addr":"172.21.15.18:6811/2610959301","heartbeat_back_addr":"172.21.15.18:6815/2610959301","heartbeat_front_addr":"172.21.15.18:6813/2610959301","state":["exists","up"]},{"osd":4,"uuid":"9aa2579a-ada1-45f3-9341-f46697c28212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6825","nonce":482886379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6827","nonce":482886379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6831","nonce":482886379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6829","nonce":482886379}]},"public_addr":"172.21.15.179:6825/482886379","cluster_addr":"172.21.15.179:6827/482886379","heartbeat_back_addr":"172.21.15.179:6831/482886379","heartbeat_front_addr":"172.21.15.179:6829/482886379","state":["exists","up"]},{"osd":5,"uuid":"4a6678eb-28ca-4b05-96ae-e9deeb60ca96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6817","nonce":2695689817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6819","nonce":2695689817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6823","nonce":2695689817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6821","nonce":2695689817}]},"public_addr":"172.21.15.179:6817/2695689817","cluster_addr":"172.21.15.179:6819/2695689817","heartbeat_back_addr":"172.21.15.179:6823/2695689817","heartbeat_front_addr":"172.21.15.179:6821/2695689817","state":["exists","up"]},{"osd":6,"uuid":"775b01e8-5705-4b98-a3ab-f15a78271355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6809","nonce":1840779137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6811","nonce":1840779137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6815","nonce":1840779137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6813","nonce":1840779137}]},"public_addr":"172.21.15.179:6809/1840779137","cluster_addr":"172.21.15.179:6811/1840779137","heartbeat_back_addr":"172.21.15.179:6815/1840779137","heartbeat_front_addr":"172.21.15.179:6813/1840779137","state":["exists","up"]},{"osd":7,"uuid":"15f6d6c1-8a16-42c6-9e43-f3a92e511735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6801","nonce":4222842386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6803","nonce":4222842386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6807","nonce":4222842386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6805","nonce":4222842386}]},"public_addr":"172.21.15.179:6801/4222842386","cluster_addr":"172.21.15.179:6803/4222842386","heartbeat_back_addr":"172.21.15.179:6807/4222842386","heartbeat_front_addr":"172.21.15.179:6805/4222842386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.339566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.065958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.261750+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.463117+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.557372+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.195553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.008891+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:27.839466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T01:34:41.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T01:34:41.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T01:34:41.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T01:34:41.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T01:34:41.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-22T01:34:41.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-22T01:34:41.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-22T01:34:41.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-22T01:34:41.674 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-22T01:34:41.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-22T01:34:41.683 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-22T01:34:41.683 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T01:34:41.684 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-22T01:34:41.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T01:34:41.685 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-22T01:34:41.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-22T01:34:41.686 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-09-22T01:34:41.687 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-22T01:34:41.687 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-22T01:34:41.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-22T01:34:41.690 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-22T01:34:41.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T01:34:41.692 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-09-22T01:34:41.693 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T01:34:42.185 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-09-22T01:34:42.198 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-09-22T01:34:42.207 INFO:teuthology.orchestra.run.smithi018.stdout:55834574850 2024-09-22T01:34:42.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-09-22T01:34:42.223 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-22T01:34:42.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-09-22T01:34:42.230 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-09-22T01:34:42.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.7 2024-09-22T01:34:42.235 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-22T01:34:42.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-09-22T01:34:42.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-22T01:34:42.258 INFO:teuthology.orchestra.run.smithi018.stdout:55834574851 2024-09-22T01:34:42.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-09-22T01:34:42.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-09-22T01:34:42.283 INFO:teuthology.orchestra.run.smithi018.stdout:55834574850 2024-09-22T01:34:42.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.2 2024-09-22T01:34:43.216 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-22T01:34:43.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-22T01:34:43.232 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-22T01:34:43.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-22T01:34:43.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T01:34:43.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T01:34:43.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T01:34:43.301 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T01:34:43.759 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-22T01:34:43.773 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-22T01:34:43.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.4 2024-09-22T01:34:43.789 DEBUG:teuthology.parallel:result is None 2024-09-22T01:34:43.791 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-22T01:34:43.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.5 2024-09-22T01:34:43.797 DEBUG:teuthology.parallel:result is None 2024-09-22T01:34:43.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.7 2024-09-22T01:34:43.810 DEBUG:teuthology.parallel:result is None 2024-09-22T01:34:43.824 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-22T01:34:43.824 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-22T01:34:43.834 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-22T01:34:43.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2024-09-22T01:34:43.847 DEBUG:teuthology.parallel:result is None 2024-09-22T01:34:43.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.6 2024-09-22T01:34:43.848 DEBUG:teuthology.parallel:result is None 2024-09-22T01:34:43.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.2 2024-09-22T01:34:43.855 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-22T01:34:43.855 DEBUG:teuthology.parallel:result is None 2024-09-22T01:34:43.864 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-22T01:34:43.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.1 2024-09-22T01:34:43.874 DEBUG:teuthology.parallel:result is None 2024-09-22T01:34:43.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2024-09-22T01:34:43.882 DEBUG:teuthology.parallel:result is None 2024-09-22T01:34:43.882 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T01:34:43.882 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:34:44.210 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:34:44.210 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:34:44.226 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-22T01:34:43.495792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235636,"kb_used_data":2744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739084,"statfs":{"total":773094113280,"available":772852822016,"internally_reserved":0,"allocated":2809856,"data_stored":1720278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.148359"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.008254+0000","last_change":"2024-09-22T01:34:41.008254+0000","last_active":"2024-09-22T01:34:41.008254+0000","last_peered":"2024-09-22T01:34:41.008254+0000","last_clean":"2024-09-22T01:34:41.008254+0000","last_became_active":"2024-09-22T01:34:38.361626+0000","last_became_peered":"2024-09-22T01:34:38.361626+0000","last_unstale":"2024-09-22T01:34:41.008254+0000","last_undegraded":"2024-09-22T01:34:41.008254+0000","last_fullsized":"2024-09-22T01:34:41.008254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:26:46.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.368618+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:34:40.368618+0000","last_peered":"2024-09-22T01:34:40.368618+0000","last_clean":"2024-09-22T01:34:40.368618+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:34:40.368618+0000","last_undegraded":"2024-09-22T01:34:40.368618+0000","last_fullsized":"2024-09-22T01:34:40.368618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.143159+0000","last_change":"2024-09-22T01:34:41.143159+0000","last_active":"2024-09-22T01:34:41.143159+0000","last_peered":"2024-09-22T01:34:41.143159+0000","last_clean":"2024-09-22T01:34:41.143159+0000","last_became_active":"2024-09-22T01:34:38.384953+0000","last_became_peered":"2024-09-22T01:34:38.384953+0000","last_unstale":"2024-09-22T01:34:41.143159+0000","last_undegraded":"2024-09-22T01:34:41.143159+0000","last_fullsized":"2024-09-22T01:34:41.143159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:57:56.085174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.368564+0000","last_change":"2024-09-22T01:34:40.368564+0000","last_active":"2024-09-22T01:34:40.368564+0000","last_peered":"2024-09-22T01:34:40.368564+0000","last_clean":"2024-09-22T01:34:40.368564+0000","last_became_active":"2024-09-22T01:34:38.384177+0000","last_became_peered":"2024-09-22T01:34:38.384177+0000","last_unstale":"2024-09-22T01:34:40.368564+0000","last_undegraded":"2024-09-22T01:34:40.368564+0000","last_fullsized":"2024-09-22T01:34:40.368564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:17:19.882182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011361909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.377667+0000","last_change":"2024-09-22T01:34:40.376225+0000","last_active":"2024-09-22T01:34:40.377667+0000","last_peered":"2024-09-22T01:34:40.377667+0000","last_clean":"2024-09-22T01:34:40.377667+0000","last_became_active":"2024-09-22T01:34:38.360269+0000","last_became_peered":"2024-09-22T01:34:38.360269+0000","last_unstale":"2024-09-22T01:34:40.377667+0000","last_undegraded":"2024-09-22T01:34:40.377667+0000","last_fullsized":"2024-09-22T01:34:40.377667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:12:20.227363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023923949999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.396661+0000","last_change":"2024-09-22T01:34:40.396661+0000","last_active":"2024-09-22T01:34:40.396661+0000","last_peered":"2024-09-22T01:34:40.396661+0000","last_clean":"2024-09-22T01:34:40.396661+0000","last_became_active":"2024-09-22T01:34:38.357518+0000","last_became_peered":"2024-09-22T01:34:38.357518+0000","last_unstale":"2024-09-22T01:34:40.396661+0000","last_undegraded":"2024-09-22T01:34:40.396661+0000","last_fullsized":"2024-09-22T01:34:40.396661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:15.154872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001088058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.142974+0000","last_change":"2024-09-22T01:34:41.142974+0000","last_active":"2024-09-22T01:34:41.142974+0000","last_peered":"2024-09-22T01:34:41.142974+0000","last_clean":"2024-09-22T01:34:41.142974+0000","last_became_active":"2024-09-22T01:34:38.359315+0000","last_became_peered":"2024-09-22T01:34:38.359315+0000","last_unstale":"2024-09-22T01:34:41.142974+0000","last_undegraded":"2024-09-22T01:34:41.142974+0000","last_fullsized":"2024-09-22T01:34:41.142974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:33.395450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094596600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.375058+0000","last_change":"2024-09-22T01:34:40.375058+0000","last_active":"2024-09-22T01:34:40.375058+0000","last_peered":"2024-09-22T01:34:40.375058+0000","last_clean":"2024-09-22T01:34:40.375058+0000","last_became_active":"2024-09-22T01:34:38.358427+0000","last_became_peered":"2024-09-22T01:34:38.358427+0000","last_unstale":"2024-09-22T01:34:40.375058+0000","last_undegraded":"2024-09-22T01:34:40.375058+0000","last_fullsized":"2024-09-22T01:34:40.375058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:11.169948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.141832+0000","last_change":"2024-09-22T01:34:34.158566+0000","last_active":"2024-09-22T01:34:41.141832+0000","last_peered":"2024-09-22T01:34:41.141832+0000","last_clean":"2024-09-22T01:34:41.141832+0000","last_became_active":"2024-09-22T01:34:34.156391+0000","last_became_peered":"2024-09-22T01:34:34.156391+0000","last_unstale":"2024-09-22T01:34:41.141832+0000","last_undegraded":"2024-09-22T01:34:41.141832+0000","last_fullsized":"2024-09-22T01:34:41.141832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:19.482152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":786432,"data_stored":653432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:34:44.227 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:34:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:34:44.525 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:34:44.541 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-22T01:34:43.495792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235636,"kb_used_data":2744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739084,"statfs":{"total":773094113280,"available":772852822016,"internally_reserved":0,"allocated":2809856,"data_stored":1720278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.148359"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.008254+0000","last_change":"2024-09-22T01:34:41.008254+0000","last_active":"2024-09-22T01:34:41.008254+0000","last_peered":"2024-09-22T01:34:41.008254+0000","last_clean":"2024-09-22T01:34:41.008254+0000","last_became_active":"2024-09-22T01:34:38.361626+0000","last_became_peered":"2024-09-22T01:34:38.361626+0000","last_unstale":"2024-09-22T01:34:41.008254+0000","last_undegraded":"2024-09-22T01:34:41.008254+0000","last_fullsized":"2024-09-22T01:34:41.008254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:26:46.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.368618+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:34:40.368618+0000","last_peered":"2024-09-22T01:34:40.368618+0000","last_clean":"2024-09-22T01:34:40.368618+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:34:40.368618+0000","last_undegraded":"2024-09-22T01:34:40.368618+0000","last_fullsized":"2024-09-22T01:34:40.368618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.143159+0000","last_change":"2024-09-22T01:34:41.143159+0000","last_active":"2024-09-22T01:34:41.143159+0000","last_peered":"2024-09-22T01:34:41.143159+0000","last_clean":"2024-09-22T01:34:41.143159+0000","last_became_active":"2024-09-22T01:34:38.384953+0000","last_became_peered":"2024-09-22T01:34:38.384953+0000","last_unstale":"2024-09-22T01:34:41.143159+0000","last_undegraded":"2024-09-22T01:34:41.143159+0000","last_fullsized":"2024-09-22T01:34:41.143159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:57:56.085174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.368564+0000","last_change":"2024-09-22T01:34:40.368564+0000","last_active":"2024-09-22T01:34:40.368564+0000","last_peered":"2024-09-22T01:34:40.368564+0000","last_clean":"2024-09-22T01:34:40.368564+0000","last_became_active":"2024-09-22T01:34:38.384177+0000","last_became_peered":"2024-09-22T01:34:38.384177+0000","last_unstale":"2024-09-22T01:34:40.368564+0000","last_undegraded":"2024-09-22T01:34:40.368564+0000","last_fullsized":"2024-09-22T01:34:40.368564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:17:19.882182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011361909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.377667+0000","last_change":"2024-09-22T01:34:40.376225+0000","last_active":"2024-09-22T01:34:40.377667+0000","last_peered":"2024-09-22T01:34:40.377667+0000","last_clean":"2024-09-22T01:34:40.377667+0000","last_became_active":"2024-09-22T01:34:38.360269+0000","last_became_peered":"2024-09-22T01:34:38.360269+0000","last_unstale":"2024-09-22T01:34:40.377667+0000","last_undegraded":"2024-09-22T01:34:40.377667+0000","last_fullsized":"2024-09-22T01:34:40.377667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:12:20.227363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023923949999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.396661+0000","last_change":"2024-09-22T01:34:40.396661+0000","last_active":"2024-09-22T01:34:40.396661+0000","last_peered":"2024-09-22T01:34:40.396661+0000","last_clean":"2024-09-22T01:34:40.396661+0000","last_became_active":"2024-09-22T01:34:38.357518+0000","last_became_peered":"2024-09-22T01:34:38.357518+0000","last_unstale":"2024-09-22T01:34:40.396661+0000","last_undegraded":"2024-09-22T01:34:40.396661+0000","last_fullsized":"2024-09-22T01:34:40.396661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:15.154872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001088058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.142974+0000","last_change":"2024-09-22T01:34:41.142974+0000","last_active":"2024-09-22T01:34:41.142974+0000","last_peered":"2024-09-22T01:34:41.142974+0000","last_clean":"2024-09-22T01:34:41.142974+0000","last_became_active":"2024-09-22T01:34:38.359315+0000","last_became_peered":"2024-09-22T01:34:38.359315+0000","last_unstale":"2024-09-22T01:34:41.142974+0000","last_undegraded":"2024-09-22T01:34:41.142974+0000","last_fullsized":"2024-09-22T01:34:41.142974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:33.395450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094596600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.375058+0000","last_change":"2024-09-22T01:34:40.375058+0000","last_active":"2024-09-22T01:34:40.375058+0000","last_peered":"2024-09-22T01:34:40.375058+0000","last_clean":"2024-09-22T01:34:40.375058+0000","last_became_active":"2024-09-22T01:34:38.358427+0000","last_became_peered":"2024-09-22T01:34:38.358427+0000","last_unstale":"2024-09-22T01:34:40.375058+0000","last_undegraded":"2024-09-22T01:34:40.375058+0000","last_fullsized":"2024-09-22T01:34:40.375058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:11.169948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.141832+0000","last_change":"2024-09-22T01:34:34.158566+0000","last_active":"2024-09-22T01:34:41.141832+0000","last_peered":"2024-09-22T01:34:41.141832+0000","last_clean":"2024-09-22T01:34:41.141832+0000","last_became_active":"2024-09-22T01:34:34.156391+0000","last_became_peered":"2024-09-22T01:34:34.156391+0000","last_unstale":"2024-09-22T01:34:41.141832+0000","last_undegraded":"2024-09-22T01:34:41.141832+0000","last_fullsized":"2024-09-22T01:34:41.141832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:19.482152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":786432,"data_stored":653432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:34:44.542 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T01:34:44.542 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-22T01:34:44.542 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-22T01:34:44.542 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-22T01:34:44.855 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:34:44.855 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-22T01:34:44.872 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-22T01:34:44.873 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-22T01:34:44.892 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-22T01:34:44.893 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache max dirty': 0}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-22T01:34:44.893 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-22T01:34:44.893 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-22T01:34:45.212 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-22T01:34:45.212 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T01:34:45.213 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:34:45.500 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:34:45.500 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:34:45.518 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-22T01:34:45.377304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235636,"kb_used_data":2744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739084,"statfs":{"total":773094113280,"available":772852822016,"internally_reserved":0,"allocated":2809856,"data_stored":1720278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.027553"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.008254+0000","last_change":"2024-09-22T01:34:41.008254+0000","last_active":"2024-09-22T01:34:41.008254+0000","last_peered":"2024-09-22T01:34:41.008254+0000","last_clean":"2024-09-22T01:34:41.008254+0000","last_became_active":"2024-09-22T01:34:38.361626+0000","last_became_peered":"2024-09-22T01:34:38.361626+0000","last_unstale":"2024-09-22T01:34:41.008254+0000","last_undegraded":"2024-09-22T01:34:41.008254+0000","last_fullsized":"2024-09-22T01:34:41.008254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:26:46.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.368618+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:34:40.368618+0000","last_peered":"2024-09-22T01:34:40.368618+0000","last_clean":"2024-09-22T01:34:40.368618+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:34:40.368618+0000","last_undegraded":"2024-09-22T01:34:40.368618+0000","last_fullsized":"2024-09-22T01:34:40.368618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.143159+0000","last_change":"2024-09-22T01:34:41.143159+0000","last_active":"2024-09-22T01:34:41.143159+0000","last_peered":"2024-09-22T01:34:41.143159+0000","last_clean":"2024-09-22T01:34:41.143159+0000","last_became_active":"2024-09-22T01:34:38.384953+0000","last_became_peered":"2024-09-22T01:34:38.384953+0000","last_unstale":"2024-09-22T01:34:41.143159+0000","last_undegraded":"2024-09-22T01:34:41.143159+0000","last_fullsized":"2024-09-22T01:34:41.143159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:57:56.085174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.368564+0000","last_change":"2024-09-22T01:34:40.368564+0000","last_active":"2024-09-22T01:34:40.368564+0000","last_peered":"2024-09-22T01:34:40.368564+0000","last_clean":"2024-09-22T01:34:40.368564+0000","last_became_active":"2024-09-22T01:34:38.384177+0000","last_became_peered":"2024-09-22T01:34:38.384177+0000","last_unstale":"2024-09-22T01:34:40.368564+0000","last_undegraded":"2024-09-22T01:34:40.368564+0000","last_fullsized":"2024-09-22T01:34:40.368564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:17:19.882182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011361909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.377667+0000","last_change":"2024-09-22T01:34:40.376225+0000","last_active":"2024-09-22T01:34:40.377667+0000","last_peered":"2024-09-22T01:34:40.377667+0000","last_clean":"2024-09-22T01:34:40.377667+0000","last_became_active":"2024-09-22T01:34:38.360269+0000","last_became_peered":"2024-09-22T01:34:38.360269+0000","last_unstale":"2024-09-22T01:34:40.377667+0000","last_undegraded":"2024-09-22T01:34:40.377667+0000","last_fullsized":"2024-09-22T01:34:40.377667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:12:20.227363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023923949999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.396661+0000","last_change":"2024-09-22T01:34:40.396661+0000","last_active":"2024-09-22T01:34:40.396661+0000","last_peered":"2024-09-22T01:34:40.396661+0000","last_clean":"2024-09-22T01:34:40.396661+0000","last_became_active":"2024-09-22T01:34:38.357518+0000","last_became_peered":"2024-09-22T01:34:38.357518+0000","last_unstale":"2024-09-22T01:34:40.396661+0000","last_undegraded":"2024-09-22T01:34:40.396661+0000","last_fullsized":"2024-09-22T01:34:40.396661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:15.154872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001088058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.142974+0000","last_change":"2024-09-22T01:34:41.142974+0000","last_active":"2024-09-22T01:34:41.142974+0000","last_peered":"2024-09-22T01:34:41.142974+0000","last_clean":"2024-09-22T01:34:41.142974+0000","last_became_active":"2024-09-22T01:34:38.359315+0000","last_became_peered":"2024-09-22T01:34:38.359315+0000","last_unstale":"2024-09-22T01:34:41.142974+0000","last_undegraded":"2024-09-22T01:34:41.142974+0000","last_fullsized":"2024-09-22T01:34:41.142974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:33.395450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094596600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.375058+0000","last_change":"2024-09-22T01:34:40.375058+0000","last_active":"2024-09-22T01:34:40.375058+0000","last_peered":"2024-09-22T01:34:40.375058+0000","last_clean":"2024-09-22T01:34:40.375058+0000","last_became_active":"2024-09-22T01:34:38.358427+0000","last_became_peered":"2024-09-22T01:34:38.358427+0000","last_unstale":"2024-09-22T01:34:40.375058+0000","last_undegraded":"2024-09-22T01:34:40.375058+0000","last_fullsized":"2024-09-22T01:34:40.375058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:11.169948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.141832+0000","last_change":"2024-09-22T01:34:34.158566+0000","last_active":"2024-09-22T01:34:41.141832+0000","last_peered":"2024-09-22T01:34:41.141832+0000","last_clean":"2024-09-22T01:34:41.141832+0000","last_became_active":"2024-09-22T01:34:34.156391+0000","last_became_peered":"2024-09-22T01:34:34.156391+0000","last_unstale":"2024-09-22T01:34:41.141832+0000","last_undegraded":"2024-09-22T01:34:41.141832+0000","last_fullsized":"2024-09-22T01:34:41.141832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:19.482152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":786432,"data_stored":653432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:34:45.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:34:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:34:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:34:45.819 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-22T01:34:45.377304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235636,"kb_used_data":2744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739084,"statfs":{"total":773094113280,"available":772852822016,"internally_reserved":0,"allocated":2809856,"data_stored":1720278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.027553"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.008254+0000","last_change":"2024-09-22T01:34:41.008254+0000","last_active":"2024-09-22T01:34:41.008254+0000","last_peered":"2024-09-22T01:34:41.008254+0000","last_clean":"2024-09-22T01:34:41.008254+0000","last_became_active":"2024-09-22T01:34:38.361626+0000","last_became_peered":"2024-09-22T01:34:38.361626+0000","last_unstale":"2024-09-22T01:34:41.008254+0000","last_undegraded":"2024-09-22T01:34:41.008254+0000","last_fullsized":"2024-09-22T01:34:41.008254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:26:46.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.368618+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:34:40.368618+0000","last_peered":"2024-09-22T01:34:40.368618+0000","last_clean":"2024-09-22T01:34:40.368618+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:34:40.368618+0000","last_undegraded":"2024-09-22T01:34:40.368618+0000","last_fullsized":"2024-09-22T01:34:40.368618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.143159+0000","last_change":"2024-09-22T01:34:41.143159+0000","last_active":"2024-09-22T01:34:41.143159+0000","last_peered":"2024-09-22T01:34:41.143159+0000","last_clean":"2024-09-22T01:34:41.143159+0000","last_became_active":"2024-09-22T01:34:38.384953+0000","last_became_peered":"2024-09-22T01:34:38.384953+0000","last_unstale":"2024-09-22T01:34:41.143159+0000","last_undegraded":"2024-09-22T01:34:41.143159+0000","last_fullsized":"2024-09-22T01:34:41.143159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:57:56.085174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.368564+0000","last_change":"2024-09-22T01:34:40.368564+0000","last_active":"2024-09-22T01:34:40.368564+0000","last_peered":"2024-09-22T01:34:40.368564+0000","last_clean":"2024-09-22T01:34:40.368564+0000","last_became_active":"2024-09-22T01:34:38.384177+0000","last_became_peered":"2024-09-22T01:34:38.384177+0000","last_unstale":"2024-09-22T01:34:40.368564+0000","last_undegraded":"2024-09-22T01:34:40.368564+0000","last_fullsized":"2024-09-22T01:34:40.368564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:17:19.882182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011361909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.377667+0000","last_change":"2024-09-22T01:34:40.376225+0000","last_active":"2024-09-22T01:34:40.377667+0000","last_peered":"2024-09-22T01:34:40.377667+0000","last_clean":"2024-09-22T01:34:40.377667+0000","last_became_active":"2024-09-22T01:34:38.360269+0000","last_became_peered":"2024-09-22T01:34:38.360269+0000","last_unstale":"2024-09-22T01:34:40.377667+0000","last_undegraded":"2024-09-22T01:34:40.377667+0000","last_fullsized":"2024-09-22T01:34:40.377667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:12:20.227363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023923949999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.396661+0000","last_change":"2024-09-22T01:34:40.396661+0000","last_active":"2024-09-22T01:34:40.396661+0000","last_peered":"2024-09-22T01:34:40.396661+0000","last_clean":"2024-09-22T01:34:40.396661+0000","last_became_active":"2024-09-22T01:34:38.357518+0000","last_became_peered":"2024-09-22T01:34:38.357518+0000","last_unstale":"2024-09-22T01:34:40.396661+0000","last_undegraded":"2024-09-22T01:34:40.396661+0000","last_fullsized":"2024-09-22T01:34:40.396661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:15.154872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001088058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.142974+0000","last_change":"2024-09-22T01:34:41.142974+0000","last_active":"2024-09-22T01:34:41.142974+0000","last_peered":"2024-09-22T01:34:41.142974+0000","last_clean":"2024-09-22T01:34:41.142974+0000","last_became_active":"2024-09-22T01:34:38.359315+0000","last_became_peered":"2024-09-22T01:34:38.359315+0000","last_unstale":"2024-09-22T01:34:41.142974+0000","last_undegraded":"2024-09-22T01:34:41.142974+0000","last_fullsized":"2024-09-22T01:34:41.142974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:33.395450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094596600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:40.375058+0000","last_change":"2024-09-22T01:34:40.375058+0000","last_active":"2024-09-22T01:34:40.375058+0000","last_peered":"2024-09-22T01:34:40.375058+0000","last_clean":"2024-09-22T01:34:40.375058+0000","last_became_active":"2024-09-22T01:34:38.358427+0000","last_became_peered":"2024-09-22T01:34:38.358427+0000","last_unstale":"2024-09-22T01:34:40.375058+0000","last_undegraded":"2024-09-22T01:34:40.375058+0000","last_fullsized":"2024-09-22T01:34:40.375058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:11.169948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-22T01:34:41.141832+0000","last_change":"2024-09-22T01:34:34.158566+0000","last_active":"2024-09-22T01:34:41.141832+0000","last_peered":"2024-09-22T01:34:41.141832+0000","last_clean":"2024-09-22T01:34:41.141832+0000","last_became_active":"2024-09-22T01:34:34.156391+0000","last_became_peered":"2024-09-22T01:34:34.156391+0000","last_unstale":"2024-09-22T01:34:41.141832+0000","last_undegraded":"2024-09-22T01:34:41.141832+0000","last_fullsized":"2024-09-22T01:34:41.141832+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:19.482152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":786432,"data_stored":653432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:34:45.820 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T01:34:45.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-22T01:34:46.101 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 21 2024-09-22T01:34:46.101 INFO:teuthology.orchestra.run.smithi018.stdout:fsid 2d4626ba-577e-46d9-ad53-8451e5733f43 2024-09-22T01:34:46.101 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-22T01:34:18.722829+0000 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:modified 2024-09-22T01:34:43.480846+0000 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:crush_version 4 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:full_ratio 0.95 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:backfillfull_ratio 0.9 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:nearfull_ratio 0.85 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:require_min_compat_client luminous 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:min_compat_client jewel 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:require_osd_release squid 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:stretch_mode_enabled false 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:max_osd 8 2024-09-22T01:34:46.102 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6824/1213730345,v1:172.21.15.18:6825/1213730345] [v2:172.21.15.18:6826/1213730345,v1:172.21.15.18:6827/1213730345] exists,up 8de621b1-0a3b-4b8b-b982-70e8db073085 2024-09-22T01:34:46.103 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6800/3361514324,v1:172.21.15.18:6801/3361514324] [v2:172.21.15.18:6802/3361514324,v1:172.21.15.18:6803/3361514324] exists,up 798cbd57-ebd4-461a-9bbf-68e683d1049e 2024-09-22T01:34:46.103 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6816/4002178714,v1:172.21.15.18:6817/4002178714] [v2:172.21.15.18:6818/4002178714,v1:172.21.15.18:6819/4002178714] exists,up 9294585f-3dc9-4b04-8cae-f8d78c92791e 2024-09-22T01:34:46.103 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6808/2610959301,v1:172.21.15.18:6809/2610959301] [v2:172.21.15.18:6810/2610959301,v1:172.21.15.18:6811/2610959301] exists,up 1ff1abf7-fdbb-4f8a-85e5-90f102abcec2 2024-09-22T01:34:46.103 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6824/482886379,v1:172.21.15.179:6825/482886379] [v2:172.21.15.179:6826/482886379,v1:172.21.15.179:6827/482886379] exists,up 9aa2579a-ada1-45f3-9341-f46697c28212 2024-09-22T01:34:46.103 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6816/2695689817,v1:172.21.15.179:6817/2695689817] [v2:172.21.15.179:6818/2695689817,v1:172.21.15.179:6819/2695689817] exists,up 4a6678eb-28ca-4b05-96ae-e9deeb60ca96 2024-09-22T01:34:46.103 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6808/1840779137,v1:172.21.15.179:6809/1840779137] [v2:172.21.15.179:6810/1840779137,v1:172.21.15.179:6811/1840779137] exists,up 775b01e8-5705-4b98-a3ab-f15a78271355 2024-09-22T01:34:46.103 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6800/4222842386,v1:172.21.15.179:6801/4222842386] [v2:172.21.15.179:6802/4222842386,v1:172.21.15.179:6803/4222842386] exists,up 15f6d6c1-8a16-42c6-9e43-f3a92e511735 2024-09-22T01:34:46.119 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6824/1213730345,v1:172.21.15.18:6825/1213730345] [v2:172.21.15.18:6826/1213730345,v1:172.21.15.18:6827/1213730345] exists,up 8de621b1-0a3b-4b8b-b982-70e8db073085', 'osd.1 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6800/3361514324,v1:172.21.15.18:6801/3361514324] [v2:172.21.15.18:6802/3361514324,v1:172.21.15.18:6803/3361514324] exists,up 798cbd57-ebd4-461a-9bbf-68e683d1049e', 'osd.2 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6816/4002178714,v1:172.21.15.18:6817/4002178714] [v2:172.21.15.18:6818/4002178714,v1:172.21.15.18:6819/4002178714] exists,up 9294585f-3dc9-4b04-8cae-f8d78c92791e', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6808/2610959301,v1:172.21.15.18:6809/2610959301] [v2:172.21.15.18:6810/2610959301,v1:172.21.15.18:6811/2610959301] exists,up 1ff1abf7-fdbb-4f8a-85e5-90f102abcec2', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6824/482886379,v1:172.21.15.179:6825/482886379] [v2:172.21.15.179:6826/482886379,v1:172.21.15.179:6827/482886379] exists,up 9aa2579a-ada1-45f3-9341-f46697c28212', 'osd.5 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6816/2695689817,v1:172.21.15.179:6817/2695689817] [v2:172.21.15.179:6818/2695689817,v1:172.21.15.179:6819/2695689817] exists,up 4a6678eb-28ca-4b05-96ae-e9deeb60ca96', 'osd.6 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6808/1840779137,v1:172.21.15.179:6809/1840779137] [v2:172.21.15.179:6810/1840779137,v1:172.21.15.179:6811/1840779137] exists,up 775b01e8-5705-4b98-a3ab-f15a78271355', 'osd.7 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.179:6800/4222842386,v1:172.21.15.179:6801/4222842386] [v2:172.21.15.179:6802/4222842386,v1:172.21.15.179:6803/4222842386] exists,up 15f6d6c1-8a16-42c6-9e43-f3a92e511735'] 2024-09-22T01:34:46.119 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-22T01:34:46.231 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "mon.a", 2024-09-22T01:34:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster": "ceph", 2024-09-22T01:34:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-22T01:34:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "admin_socket_mode": "", 2024-09-22T01:34:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-22T01:34:46.231 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_client_required": "cephx, none", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_cluster_required": "cephx", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_debug": "true", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_service_required": "cephx", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_supported": "cephx", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio": "true", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio_poll_ms": "250", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_aio_reap_max": "16", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_async_discard": "false", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_block_size": "4096", 2024-09-22T01:34:46.232 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_aio": "false", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_debug_inflight_ios": "false", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_enable_discard": "false", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_flock_retry": "3", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_inject_crash": "0", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_ioring": "false", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_ioring_hipri": "false", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-22T01:34:46.233 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bdev_type": "", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_alloc_size": "1048576", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_allocator": "hybrid", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_buffered_io": "true", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_check_for_zeros": "false", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_compact_log_sync": "false", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_max_log_runway": "4194304", 2024-09-22T01:34:46.234 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_max_prefetch": "1048576", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_min_flush_size": "524288", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_min_log_runway": "1048576", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_replay_recovery": "false", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_sync_write": "false", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_allocation_from_file": "true", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_allocator": "hybrid", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-22T01:34:46.235 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bdev_label_multi": "true", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_create": "true", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_db_create": "false", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_db_path": "", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_db_size": "0", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_path": "", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_preallocate_file": "false", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_size": "107374182400", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_wal_create": "false", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_wal_path": "", 2024-09-22T01:34:46.236 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_block_wal_size": "100663296", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs": "true", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_autotune": "true", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_size": "0", 2024-09-22T01:34:46.237 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_type": "2q", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_clone_cow": "true", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_mode": "none", 2024-09-22T01:34:46.238 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_csum_type": "crc32c", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_freelist": "false", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-22T01:34:46.239 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_small_allocations": "0", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_default_buffered_read": "true", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_default_buffered_write": "false", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-22T01:34:46.240 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fail_eio": "false", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mount": "false", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_umount": "false", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-22T01:34:46.241 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_ignore_data_csum": "false", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_log_op_age": "5.000000", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_alloc_size": "0", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_blob_size": "0", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-22T01:34:46.242 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_max_deferred_txc": "32", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_min_alloc_size": "0", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_nid_prealloc": "1024", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_retry_disk_reads": "3", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_cf": "true", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-22T01:34:46.243 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_spdk_mem": "512", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-22T01:34:46.244 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_tracing": "false", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_zero_block_detection": "false", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-22T01:34:46.245 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_cluster_require_signatures": "false", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_cluster_require_version": "2", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_require_signatures": "false", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_require_version": "2", 2024-09-22T01:34:46.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_service_require_signatures": "false", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_service_require_version": "2", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "cephx_sign_messages": "true", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "chdir": "", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_acl_type": "", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_asio_thread_count": "2", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_cache_mid": "0.750000", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_cache_size": "16384", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_caps_release_delay": "5", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_check_pool_perm": "true", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_force_sync_read": "false", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_getattr_caps": "false", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_inject_features": "", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_debug_inject_tick_delay": "0", 2024-09-22T01:34:46.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_die_on_failed_remount": "false", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_dirsize_rbytes": "true", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_force_lazyio": "false", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_fs": "", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_inject_release_failure": "false", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_max_inline_size": "4096", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mds_namespace": "", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_metadata": "", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mount_gid": "-1", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mount_timeout": "300", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mount_uid": "-1", 2024-09-22T01:34:46.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_mountpoint": "/", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_notify_timeout": "10", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc": "true", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_max_dirty": "104857600", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_max_objects": "1000", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_size": "209715200", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_oc_target_dirty": "8388608", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_permissions": "true", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_quota": "true", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_quota_df": "true", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_readahead_max_bytes": "0", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_readahead_max_periods": "4", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_readahead_min": "131072", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_reconnect_stale": "false", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_shutdown_timeout": "30", 2024-09-22T01:34:46.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_snapdir": ".snap", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_tick_interval": "1", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_trace": "", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_try_dentry_invalidate": "false", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_use_faked_inos": "false", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_use_random_mds": "false", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_graylog": "false", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_graylog_port": "12201", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_monitors": "default=true", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_syslog": "false", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "clog_to_syslog_level": "info", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "-", 2024-09-22T01:34:46.250 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_network": "", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_network_interface": "", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zlib_isal": "false", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zlib_level": "5", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zlib_winsize": "-15", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "compressor_zstd_level": "1", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_alien_op_num_threads": "6", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_osd_stat_interval": "0", 2024-09-22T01:34:46.251 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_seastar_cpu_cores": "", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "crimson_seastar_num_threads": "0", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_location": "", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_location_hook": "", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_location_hook_timeout": "10", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "daemonize": "false", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "daos_pool": "tank", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_alienstore": "0/5", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_allow_any_pool_priority": "false", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_asok": "1/5", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_asok_assert_abort": "false", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_asserts_on_shutdown": "true", 2024-09-22T01:34:46.252 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_auth": "20/20", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_bdev": "1/3", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_bluefs": "1/5", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_bluestore": "1/5", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_buffer": "0/1", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_ceph_exporter": "1/5", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_cephfs_mirror": "0/5", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_cephsqlite": "0/5", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_client": "0/5", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_compressor": "1/5", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_context": "0/1", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_crimson_interrupt": "0/5", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_crush": "1/1", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_crypto": "1/5", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_cyanstore": "0/5", 2024-09-22T01:34:46.253 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_deliberately_leak_memory": "false", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_disable_randomized_ping": "false", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_dpdk": "1/5", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_eventtrace": "1/5", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_filer": "0/1", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_filestore": "1/3", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_finisher": "1/1", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_fuse": "1/5", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_heartbeat_testing_span": "0", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_heartbeatmap": "1/5", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_javaclient": "1/5", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_journal": "1/3", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_journaler": "0/5", 2024-09-22T01:34:46.254 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_kstore": "1/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_lockdep": "0/1", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mclock": "1/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds": "1/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_balancer": "1/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_locker": "1/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_log": "1/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_log_expire": "1/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_migrator": "1/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mds_quiesce": "3/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_memstore": "1/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mgr": "2/5", 2024-09-22T01:34:46.255 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mgrc": "1/5", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_mon": "20/20", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_monc": "0/10", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_ms": "1/1", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_none": "0/5", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_objclass": "0/5", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_objectcacher": "0/5", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_objecter": "0/1", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_optracker": "0/5", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_osd": "1/5", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_paxos": "20/20", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_perfcounter": "1/5", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_prioritycache": "1/5", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rados": "0/5", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd": "0/5", 2024-09-22T01:34:46.256 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd_mirror": "0/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd_pwl": "0/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rbd_replay": "0/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_refs": "0/0", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_reserver": "1/1", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw": "1/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_access": "1/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_datacache": "1/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_dbstore": "1/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_flight": "1/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rgw_sync": "1/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_rocksdb": "4/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore": "0/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_backref": "0/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_cache": "0/5", 2024-09-22T01:34:46.257 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_cleaner": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_device": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_epm": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_journal": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_lba": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_odata": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_omap": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_onode": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_t": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_seastore_tm": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_striper": "0/1", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_test": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_throttle": "1/1", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_timer": "0/1", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_tp": "0/5", 2024-09-22T01:34:46.258 INFO:teuthology.orchestra.run.smithi018.stdout: "debug_trace": "1/5", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "device_failure_prediction_mode": "none", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_graylog": "false", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_journald": "false", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_stderr": "true", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "err_to_syslog": "false", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event_tracing": "false", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_addr": "0.0.0.0", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_http_port": "9926", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_prio_limit": "5", 2024-09-22T01:34:46.259 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_sort_metrics": "true", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "exporter_stats_period": "5", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "fake_statfs_for_testing": "0", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "fatal_signal_handlers": "true", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filer_max_purge_ops": "10", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filer_max_truncate_ops": "128", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_apply_finisher_threads": "1", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_blackhole": "false", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_btrfs_clone_range": "true", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_btrfs_snap": "true", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_caller_concurrency": "10", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_collect_device_partition_information": "true", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_commit_timeout": "600.000000", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_inject_read_err": "false", 2024-09-22T01:34:46.260 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_omap_check": "false", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_debug_verify_split": "false", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_dump_file": "", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fadvise": "true", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fail_eio": "true", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fd_cache_shards": "16", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fd_cache_size": "128", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fiemap": "false", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fiemap_threshold": "4096", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-22T01:34:46.261 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_inject_stall": "0", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_journal_parallel": "false", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_journal_trailing": "false", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_journal_writeahead": "false", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_kill_at": "0", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs": "0", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-22T01:34:46.262 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size": "0", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_merge_threshold": "-10", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_odsync_write": "false", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_omap_backend": "rocksdb", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_omap_backend_path": "", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_op_thread_timeout": "60", 2024-09-22T01:34:46.263 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_op_threads": "2", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_punch_hole": "false", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_queue_max_ops": "50", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-22T01:34:46.264 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_seek_data_hole": "false", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_sloppy_crc": "false", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_splice": "false", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_split_multiple": "2", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_split_rand_factor": "20", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_update_to": "1000", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_enable": "true", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-22T01:34:46.265 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_xfs_extsize": "false", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "filestore_zfs_snap": "false", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "fio_dir": "/tmp/fio", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "2d4626ba-577e-46d9-ad53-8451e5733f43", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_allow_other": "true", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_atomic_o_trunc": "true", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_big_writes": "true", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_debug": "false", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_default_permissions": "false", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_disable_pagecache": "false", 2024-09-22T01:34:46.266 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_max_write": "0", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_multithreaded": "true", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_require_active_mds": "true", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_set_user_groups": "true", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_splice_move": "true", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_splice_read": "true", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_splice_write": "true", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "fuse_use_invalidate_cb": "true", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "gss_target_name": "ceph", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_file": "", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_inject_failure": "0", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_interval": "5", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "host": "smithi018", 2024-09-22T01:34:46.267 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "inject_early_sigterm": "false", 2024-09-22T01:34:46.268 INFO:teuthology.orchestra.run.smithi018.stdout: "jaeger_agent_port": "6799", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "jaeger_tracing_enable": "false", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_aio": "true", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_align_min_size": "65536", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_block_align": "true", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_block_size": "4096", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_dio": "true", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_discard": "false", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_force_aio": "false", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_ignore_corruption": "false", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_max_write_bytes": "10485760", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_max_write_entries": "100", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_replay_from": "0", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-22T01:34:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_write_header_frequency": "0", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "journal_zero_on_create": "false", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "journaler_prefetch_periods": "10", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "journaler_prezero_periods": "5", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "journaler_write_head_interval": "15", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "keyfile": "", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_backend": "rocksdb", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_default_stripe_size": "65536", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_fsck_on_mount": "false", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-22T01:34:46.270 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_max_bytes": "67108864", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_max_ops": "512", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_nid_prealloc": "1024", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_onode_map_size": "1024", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_sync_submit_transaction": "false", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "kstore_sync_transaction": "false", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "librados_thread_count": "2", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "lockdep": "false", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "lockdep_force_backtrace": "false", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "log_coarse_timestamps": "true", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "log_flush_on_exit": "false", 2024-09-22T01:34:46.271 INFO:teuthology.orchestra.run.smithi018.stdout: "log_graylog_host": "127.0.0.1", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_graylog_port": "12201", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_max_new": "1000", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_max_recent": "10000", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_stderr_prefix": "", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_stop_at_utilization": "0.970000", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_file": "true", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_graylog": "false", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_journald": "false", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_stderr": "false", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "log_to_syslog": "false", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "max_rotating_auth_attempts": "10", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_action_on_write_error": "1", 2024-09-22T01:34:46.272 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_alternate_name_max": "8192", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_asio_thread_count": "2", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_export_pin": "true", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_dirs": "true", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_interval": "5", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_interval": "10", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_max": "-1", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_max_until": "-1", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_merge_size": "50", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_midchunk": "0.300000", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-22T01:34:46.273 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_min_start": "0.200000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_minchunk": "0.001000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_mode": "0", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_need_max": "1.200000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_need_min": "0.800000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_overload_epochs": "2", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_bits": "3", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_size": "10000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_target_decay": "10.000000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_beacon_grace": "15.000000", 2024-09-22T01:34:46.274 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_beacon_interval": "4.000000", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_mid": "0.700000", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_quiesce_delay": "0", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_release_free_interval": "10", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_reservation": "0.050000", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_trim_interval": "1", 2024-09-22T01:34:46.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache_trim_threshold": "262144", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_client_prealloc_inos": "1000", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_connect_bootstrapping": "false", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_damage_table_max_entries": "10000", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_auth_pins": "false", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_frag": "false", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_scatterstat": "false", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_debug_subtrees": "false", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_decay_halflife": "5.000000", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_default_dir_hash": "2", 2024-09-22T01:34:46.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_defer_session_stale": "true", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_deny_all_reconnect": "false", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_keys_per_op": "16384", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_max_commit_size": "10", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_max_entries": "0", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dir_prefetch": "true", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_on_map": "false", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_early_reply": "true", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_enable_op_tracker": "true", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_enforce_unique_name": "true", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-22T01:34:46.277 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_random": "true", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_health_summarize_threshold": "10", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_health_dummy": "false", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-22T01:34:46.278 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_migrator_session_race": "false", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_join_fs": "", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_journal_format": "1", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_create_at": "0", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_export_at": "0", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_import_at": "0", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_journal_at": "0", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_journal_expire_at": "0", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_journal_replay_at": "0", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_link_at": "0", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_mdstable_at": "0", 2024-09-22T01:34:46.279 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_openc_at": "0", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_rename_at": "0", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_kill_shutdown_at": "0", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_event_large_threshold": "524288", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_events_per_segment": "1024", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_max_events": "-1", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_max_segments": "128", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_pause": "false", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_segment_size": "0", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_trim_threshold": "128", 2024-09-22T01:34:46.280 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log_warn_factor": "2.000000", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_caps_per_client": "1048576", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_completed_flushes": "100000", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_completed_requests": "100000", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_export_size": "20971520", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_file_recover": "32", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_purge_files": "64", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_purge_ops": "8192", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_max_snaps_per_dir": "100", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_metrics_update_interval": "2", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_min_caps_per_client": "100", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_min_caps_working_set": "10000", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-22T01:34:46.281 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_numa_node": "-1", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_complaint_time": "30.000000", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_history_duration": "600", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_history_size": "20", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_history_slow_op_size": "20", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_op_log_threshold": "5", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_ping_grace": "15", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_ping_interval": "5", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_max_caps": "30000", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-22T01:34:46.282 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_recall_warning_threshold": "262144", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_replay_interval": "1.000000", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_root_ino_gid": "0", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_root_ino_uid": "0", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-22T01:34:46.283 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_shutdown_check": "0", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_skip_ino": "0", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_snap_max_uid": "4294967294", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_snap_min_uid": "0", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_snap_rstat": "false", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_standby_replay_damaged": "false", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_symlink_recovery": "true", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_thrash_exports": "0", 2024-09-22T01:34:46.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_thrash_fragments": "0", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_tick_interval": "5.000000", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_valgrind_exit": "false", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_verify_backtrace": "1", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_verify_scatter": "false", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_wipe_sessions": "false", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool_debug": "false", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_device_bytes": "1073741824", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_page_set": "false", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "memstore_page_size": "65536", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_client_bytes": "134217728", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_client_messages": "512", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-22T01:34:46.285 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_disabled_modules": "", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_enable_op_tracker": "true", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_max_pg_num_change": "128", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mds_bytes": "134217728", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mds_messages": "128", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mon_bytes": "134217728", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_mon_messages": "128", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-22T01:34:46.286 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_history_duration": "600", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_history_size": "20", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_op_log_threshold": "5", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_osd_bytes": "536870912", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_osd_messages": "8192", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_pool": "true", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_standby_modules": "true", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_stats_period": "5", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_stats_threshold": "5", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_tick_period": "2", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-22T01:34:46.287 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_allow_pool_delete": "true", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_allow_pool_size_one": "true", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_auth_validate_all_caps": "true", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_bytes": "104857600", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_directed_command_retry": "5", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_hunt_parallel": "3", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_log_interval": "1.000000", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-22T01:34:46.288 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_ping_interval": "10.000000", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_client_target_rank": "-1", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_file_level": "debug", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_file": "true", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_journald": "false", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-22T01:34:46.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_compact_on_bootstrap": "false", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_compact_on_start": "false", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_compact_on_trim": "true", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_cpu_threads": "4", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_crush_min_required_version": "hammer", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_daemon_bytes": "419430400", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data_avail_crit": "5", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data_avail_warn": "5", 2024-09-22T01:34:46.290 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_data_size_warn": "16106127360", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_dump_json": "false", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_dump_transactions": "false", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_extra_checks": "false", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_require_reef": "false", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_no_require_squid": "false", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_down_mkfs_grace": "120", 2024-09-22T01:34:46.291 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_down_uptime_grace": "60", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_election_default_strategy": "1", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_election_timeout": "5.000000", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_elector_ping_divisor": "2", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_enable_op_tracker": "true", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_fake_pool_delete": "false", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_force_quorum_join": "false", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_globalid_prealloc": "10000", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_detail_to_clog": "false", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_log_update_period": "5", 2024-09-22T01:34:46.292 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_max_detail": "50", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_to_clog": "true", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_to_clog_interval": "600", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_host": "172.21.15.18,[v2:172.21.15.18:3301,v1:172.21.15.18:6790],172.21.15.179", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_host_override": "", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_initial_members": "", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_lease": "5.000000", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-22T01:34:46.293 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_log_full_interval": "50", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_log_max": "10000", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_log_max_summary": "50", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_log_epochs": "500", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_osd": "10000", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_pg_per_osd": "10000", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_pool_pg_num": "65536", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mds_force_trim_to": "0", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mds_skip_sanity": "false", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_memory_autotune": "true", 2024-09-22T01:34:46.294 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_memory_target": "2147483648", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_beacon_grace": "30", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_digest_period": "5", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_inactive_grace": "60", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_min_osdmap_epochs": "500", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_complaint_time": "30", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_duration": "600", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_size": "20", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_slow_op_size": "20", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_op_log_threshold": "5", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-22T01:34:46.295 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_auto_mark_in": "false", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_cache_size": "500", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_down_out_interval": "600", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_force_trim_to": "0", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-22T01:34:46.296 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_min_down_reporters": "2", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-22T01:34:46.297 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_report_timeout": "900", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_stuck_threshold": "60", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-22T01:34:46.298 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_probe_timeout": "2.000000", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_max_change": "0.050000", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_max_osds": "4", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_interval": "86400", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_max_keys": "100", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_scrub_timeout": "300", 2024-09-22T01:34:46.299 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_session_timeout": "300", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_smart_report_timeout": "5", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stat_smooth_intervals": "6", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_pool_min_size": "2", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_pool_size": "4", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_debug": "false", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_provider_kill_at": "0", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_requester_kill_at": "0", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_sync_timeout": "60.000000", 2024-09-22T01:34:46.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_target_pg_per_osd": "100", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_tick_interval": "5", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_timecheck_interval": "300.000000", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_use_min_delay_socket": "false", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_older_version_delay": "604800", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_misplaced": "false", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-22T01:34:46.301 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_older_version": "true", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "monmap": "", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-22T01:34:46.302 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "motr_tracing_enabled": "false", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_op_threads": "3", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_cm": "false", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_device_name": "", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_dscp": "96", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_local_gid": "", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_port_num": "1", 2024-09-22T01:34:46.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_sl": "3", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_support_srq": "true", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_rdma_type": "ib", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_async_reap_threshold": "5", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_before_connect": "false", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_ipv4": "true", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_ipv6": "false", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_msgr1": "true", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_msgr2": "true", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_port_max": "7568", 2024-09-22T01:34:46.304 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_port_min": "6800", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_retry_count": "3", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_bind_retry_delay": "5", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_client": "false", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_mds": "false", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_mgr": "false", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_mon": "false", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_blackhole_osd": "false", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_client_mode": "crc secure", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_cluster_mode": "crc secure", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_cluster_type": "", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_compress_secure": "false", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_connection_idle_timeout": "900", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_connection_ready_timeout": "10", 2024-09-22T01:34:46.305 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_crc_data": "true", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_crc_header": "true", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_bad_msg": "false", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_bug": "true", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_old_message": "true", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_skipped_message": "false", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_coremask": "0xF", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_enable_tso": "true", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-22T01:34:46.306 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_hugepages": "", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_lro": "true", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_memory_channel": "4", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_pmd": "", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_port_id": "0", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_dump_on_send": "false", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_initial_backoff": "0.200000", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_delay_max": "1.000000", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_delay_type": "", 2024-09-22T01:34:46.307 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_network_congestion": "0", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_inject_socket_failures": "5000", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_learn_addr_from_peer": "true", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_max_accept_failures": "4", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_max_backoff": "15.000000", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_mon_client_mode": "secure crc", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_mon_service_mode": "secure crc", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_osd_compress_min_size": "1024", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_osd_compress_mode": "none", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_pq_min_cost": "65536", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_public_type": "", 2024-09-22T01:34:46.308 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_service_mode": "crc secure", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_listen_backlog": "512", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_nodelay": "true", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_tcp_rcvbuf": "0", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "ms_type": "async+posix", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "no_config_file": "false", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_completion_locks_per_session": "32", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_inflight_ops": "1024", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_tick_interval": "5.000000", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter_timeout": "10.000000", 2024-09-22T01:34:46.309 INFO:teuthology.orchestra.run.smithi018.stdout: "objectstore_blackhole": "false", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "openssl_engine_opts": "", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_delay_time": "5.000000", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_hist_halflife": "1000", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_max_low_ops": "2", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_max_ops": "4", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_agent_slop": "0.020000", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_asio_thread_count": "2", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_async_recovery_min_cost": "100", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-22T01:34:46.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backfill_scan_max": "512", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backfill_scan_min": "64", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backoff_on_degraded": "false", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backoff_on_peering": "false", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_backoff_on_unfound": "true", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_beacon_report_interval": "300", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_duration": "30", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_max_block_size": "67108864", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_blkin_trace_all": "false", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-22T01:34:46.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_check_for_log_corruption": "false", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_class_update_on_start": "true", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_message_cap": "256", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_message_size_cap": "524288000", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_op_priority": "63", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_client_watch_timeout": "30", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_command_max_records": "256", 2024-09-22T01:34:46.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_compact_on_start": "false", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_update_on_start": "true", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_crush_update_weight_set": "true", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_feed_pullee": "-1", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-22T01:34:46.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_misdirected_ops": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_no_acting_change": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_no_purge_strays": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_op_order": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_shutdown": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_trim_objects": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-22T01:34:46.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_snaps": "false", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_keys": "1024", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_stride": "524288", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_default_notify_timeout": "30", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep": "0.000000", 2024-09-22T01:34:46.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_discard_disconnected_ops": "true", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_enable_op_tracker": "true", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_info": "true", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_shutdown": "true", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-22T01:34:46.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_function_tracing": "false", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_grace": "20", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_interval": "6", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_min_peers": "10", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_min_size": "2000", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_stale": "600", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_hit_set_max_size": "100000", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_hit_set_min_size": "1000", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-22T01:34:46.317 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_journal_size": "5120", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_kill_backfill_at": "0", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_cache_size": "50", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_dedup": "true", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_message_max": "40", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_map_share_max_epochs": "40", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_attr_name_len": "100", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_attr_size": "0", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_backfills": "1", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_markdown_count": "5", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_markdown_period": "600", 2024-09-22T01:34:46.318 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_object_name_len": "2048", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_object_namespace_len": "256", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_object_size": "134217728", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pg_blocked_by": "16", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pg_log_entries": "10000", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_pgls": "1024", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_push_cost": "8388608", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_push_objects": "10", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_scrubs": "3", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_trimming_pgs": "2", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_write_op_reply_len": "64", 2024-09-22T01:34:46.319 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_max_write_size": "90", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_profile": "balanced", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-22T01:34:46.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_base": "805306368", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_cache_min": "134217728", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_target": "4294967296", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_target_autotune": "false", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_min_pg_log_entries": "250", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_min_recovery_priority": "0", 2024-09-22T01:34:46.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_report_interval": "5", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_num_cache_shards": "32", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_num_op_tracker_shard": "32", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_numa_auto_affinity": "true", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_numa_node": "-1", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_numa_prefer_iface": "true", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objecter_finishers": "1", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objectstore": "bluestore", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objectstore_fuse": "false", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_objectstore_tracing": "false", 2024-09-22T01:34:46.322 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_complaint_time": "30.000000", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_duration": "600", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_size": "20", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_slow_op_size": "20", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_log_threshold": "5", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_shards": "0", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_shards_hdd": "5", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_shards_ssd": "8", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_pq_min_cost": "65536", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-22T01:34:46.323 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_queue_cut_off": "high", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_op_thread_timeout": "15", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_open_classes_on_start": "true", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_os_flags": "0", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_peering_op_priority": "255", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_delete_cost": "1048576", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_delete_priority": "5", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_log_trim_max": "10000", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_log_trim_min": "100", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-22T01:34:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_crimson": "false", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-22T01:34:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_flags": "0", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_min_size": "0", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_pg_num": "32", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_pgp_num": "0", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_read_ratio": "70", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_size": "2", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_default_type": "replicated", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-22T01:34:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_push_per_object_cost": "1000", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recover_clone_overlap": "true", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_cost": "20971520", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_active": "0", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_max_single_start": "1", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_op_priority": "3", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-22T01:34:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_priority": "5", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep": "0.000000", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_repair_during_recovery": "false", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_requested_scrub_priority": "120", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_auto_repair": "false", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_begin_hour": "0", 2024-09-22T01:34:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_begin_week_day": "0", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_chunk_max": "25", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_chunk_min": "5", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_cost": "52428800", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_during_recovery": "false", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_end_hour": "0", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_end_week_day": "0", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_event_cost": "4096", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_invalid_stats": "true", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_max_preemptions": "5", 2024-09-22T01:34:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_priority": "5", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_scrub_sleep": "0.000000", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_skip_data_digest": "false", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_smart_report_timeout": "5", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_cost": "1048576", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_priority": "5", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-22T01:34:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_target_transaction_size": "30", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-22T01:34:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_tracing": "false", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_use_stale_snap": "false", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "osdc_blkin_trace_all": "false", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_kill_at": "0", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_max_join_drift": "10", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_min": "500", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_min_wait": "0.050000", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_propose_interval": "1.000000", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_service_trim_max": "500", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_service_trim_min": "250", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_stash_full_interval": "25", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_trim_max": "500", 2024-09-22T01:34:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "paxos_trim_min": "250", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "perf": "true", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "-", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrv": "", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "public_bind_addr": "-", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "public_network": "", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "public_network_interface": "", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "qat_compressor_busy_polling": "false", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "qat_compressor_enabled": "false", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "qat_compressor_session_max_number": "256", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "rados_mon_op_timeout": "0", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "rados_osd_op_timeout": "0", 2024-09-22T01:34:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "rados_tracing": "false", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_atime_update_interval": "60", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_balance_parent_reads": "false", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_balance_snap_reads": "false", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_blkin_trace_all": "false", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache": "true", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_policy": "writearound", 2024-09-22T01:34:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_size": "33554432", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_clone_copy_on_read": "false", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_compression_hint": "none", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_concurrent_management_ops": "10", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_clone_format": "auto", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_data_pool": "", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_features": "61", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_format": "2", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_map_options": "", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_order": "22", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_pool": "rbd", 2024-09-22T01:34:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_stripe_count": "0", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_default_stripe_unit": "0", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_enable_alloc_hint": "true", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_io_scheduler": "simple", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-22T01:34:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_order": "24", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_pool": "", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_journal_splay_width": "4", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_localize_parent_reads": "false", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_localize_snap_reads": "false", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-22T01:34:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-22T01:34:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_mtime_update_interval": "60", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_non_blocking_aio": "true", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_op_thread_timeout": "60", 2024-09-22T01:34:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_op_threads": "1", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_parent_cache_enabled": "false", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_plugins": "", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_bps_burst": "0", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_bps_limit": "0", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_exclude_ops": "0", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_iops_burst": "0", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_iops_limit": "0", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-22T01:34:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_read_from_replica_policy": "default", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-22T01:34:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_skip_partial_discard": "true", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_tracing": "false", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_validate_names": "true", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd_validate_pool": "true", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "restapi_base_url": "", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "restapi_log_level": "", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_acl_grants_max_num": "100", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_admin_entry": "admin", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_backend_store": "rados", 2024-09-22T01:34:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_barbican_url": "", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_beast_enable_async": "true", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_counters_cache": "false", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cache_enabled": "true", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cache_expiry_interval": "900", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cache_lru_size": "25000", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_config_store": "rados", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_content_length_compat": "false", 2024-09-22T01:34:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_copy_obj_progress": "true", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cors_rules_max_num": "100", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_cross_domain_policy": "", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_addr": "", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_password": "", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_kmip_username": "", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_require_ssl": "true", 2024-09-22T01:34:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-22T01:34:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_addr": "", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_auth": "token", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_namespace": "", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_prefix": "", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_token_file": "", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_buffersize": "524288", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_low_speed_time": "300", 2024-09-22T01:34:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_d4n_port": "6379", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_changes_size": "1000", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_num_shards": "128", 2024-09-22T01:34:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_log_window": "30", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-22T01:34:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dns_name": "", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dns_s3website_name": "", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_dynamic_resharding": "true", 2024-09-22T01:34:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_gc_threads": "true", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_lc_threads": "true", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_ops_log": "false", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_quota_threads": "true", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_static_website": "false", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enable_usage_log": "false", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_enforce_swift_acls": "true", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_exit_timeout_secs": "120", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_expose_bucket": "false", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_extended_http_attrs": "", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_filter": "none", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-22T01:34:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_frontends": "beast port=7480", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_deferred": "50", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_objs": "32", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_gc_processor_period": "3600", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_init_timeout": "300", 2024-09-22T01:34:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_kafka_connection_idle": "300", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_domain": "", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_password": "", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_password_path": "", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_project": "", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_tenant": "", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_token": "", 2024-09-22T01:34:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_token_path": "", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_admin_user": "", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_api_version": "2", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_domain": "", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_password": "", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_project": "", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_barbican_user": "", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_url": "", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_debug_interval": "-1", 2024-09-22T01:34:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_lock_max_time": "90", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_objs": "32", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_rules": "1000", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_worker": "3", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lc_thread_delay": "0", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_dnattr": "uid", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_searchfilter": "", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ldap_uri": "", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-22T01:34:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_http_headers": "", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_log_object_name_utc": "false", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_attr_name_len": "0", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_attr_size": "0", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_chunk_size": "4194304", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_listing_results": "1000", 2024-09-22T01:34:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_notify_retries": "10", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_put_param_size": "1048576", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_put_size": "5368709120", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_max_slo_entries": "1000", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_md_log_max_shards": "64", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_mp_lock_max_time": "600", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-22T01:34:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_max_gc": "300", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_num_async_rados_threads": "32", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_num_control_oids": "8", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_numa_node": "-1", 2024-09-22T01:34:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_objexp_chunk_size": "100", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_objexp_gc_interval": "600", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_op_thread_timeout": "600", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_op_tracing": "false", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_opa_token": "", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_opa_url": "", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_opa_verify_ssl": "true", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_rados": "false", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_ops_log_socket_path": "", 2024-09-22T01:34:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_push_interval": "2.000000", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_cache_lanes": "3", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_cache_partitions": "3", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_print_continue": "true", 2024-09-22T01:34:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rados_tracing": "false", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_realm": "", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_realm_id": "", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_region": "", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_request_uri": "", 2024-09-22T01:34:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_batch_size": "64", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_max_aio": "128", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_num_logs": "16", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_reshard_thread_interval": "600", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_resolve_cname": "false", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_run_sync_thread": "true", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-22T01:34:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_scheduler_type": "throttler", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_script_uri": "", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_service_provider_name": "", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_client_id": "", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_client_secret": "", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_entry": "sts", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_key": "sts", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_min_session_duration": "900", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sts_token_introspection_url": "", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_account_in_url": "false", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_auth_entry": "auth", 2024-09-22T01:34:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_auth_url": "", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_custom_header": "", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_need_stats": "true", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_tenant_name": "", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_token_expiration": "86400", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_url": "", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_url_prefix": "swift", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_lease_period": "120", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-22T01:34:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_thread_pool_size": "512", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_comment": "", 2024-09-22T01:34:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_createby": "", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_encoding": "", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_flag": "false", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_origin": "", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_torrent_tracker": "", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_trust_forwarded_https": "false", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_max_shards": "32", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_usage_max_user_shards": "1", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_use_opa_authz": "false", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_counters_cache": "false", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-22T01:34:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_max_buckets": "1000", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_policies_max_num": "100", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_user_unique_email": "true", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_verify_ssl": "true", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zone": "", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zone_id": "", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-22T01:34:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zonegroup": "", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zonegroup_id": "", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rgwlc_auto_session_clear": "true", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_block_size": "4096", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_size": "536870912", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-22T01:34:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_index_type": "binary_search", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_partition_filters": "false", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_perf": "false", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "run_dir": "/var/run/ceph", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_block_create": "true", 2024-09-22T01:34:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_cache_lru_size": "67108864", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_default_max_object_size": "16777216", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_device_size": "53687091200", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_full_integrity_check": "false", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_journal_batch_capacity": "16", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_main_device_type": "SSD", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-22T01:34:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "seastore_segment_size": "67108864", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "set_keepcaps": "false", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "setgroup": "", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "setuser": "", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "setuser_match_path": "", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "thp": "false", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "threadpool_default_timeout": "60", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-22T01:34:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "throttler_perf_counter": "true" 2024-09-22T01:34:46.371 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:46.372 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-22T01:34:46.514 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a: {} 2024-09-22T01:34:46.515 INFO:teuthology.orchestra.run.smithi018.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T01:34:46.527 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b: {} 2024-09-22T01:34:46.527 INFO:teuthology.orchestra.run.smithi018.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T01:34:46.538 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c: {} 2024-09-22T01:34:46.538 INFO:teuthology.orchestra.run.smithi018.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T01:34:46.554 DEBUG:teuthology.orchestra.run.smithi018:> type ceph-objectstore-tool 2024-09-22T01:34:46.559 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-22T01:34:46.559 DEBUG:teuthology.orchestra.run.smithi179:> type ceph-objectstore-tool 2024-09-22T01:34:46.564 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-22T01:34:46.564 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-22T01:34:46.581 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-22T01:34:46.581 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-22T01:34:46.581 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:34:46.581 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:34:46.581 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-22T01:34:46.582 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.480524 2024-09-22T01:34:46.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.48052427304686973 2024-09-22T01:34:46.582 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-22T01:34:46.582 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-22T01:34:46.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:34:46.583 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-22T01:34:46.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:34:46.583 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-22T01:34:46.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:34:46.584 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-22T01:34:46.609 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:46.607+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:46.627 INFO:teuthology.orchestra.run.smithi018.stdout:mapped writes DISABLED 2024-09-22T01:34:46.627 INFO:teuthology.orchestra.run.smithi018.stdout:mapped reads DISABLED 2024-09-22T01:34:46.627 INFO:teuthology.orchestra.run.smithi018.stdout:Seed set to 9509 2024-09-22T01:34:46.684 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:46.683+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:46.752 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:34:46.752 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:46.769 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:34:46.769 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:34:46.770 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:34:46.785 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:34:46.786 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:34:46.786 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:46.783+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:34:46.804 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:34:46.804 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:34:46.820 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:34:46.821 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:34:46.842 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:34:46.842 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:34:46.863 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:34:46.863 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:34:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:34:46.883 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:34:46.886 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:46.883+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:46.895 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:46.895 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:46.904 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:34:46.904 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:34:46.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:34:46.987 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:46.987+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:47.078 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:47.078 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:47.087 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:47.083+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:47.092 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:34:47.188 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:47.187+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:47.218 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:47.218 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:47.231 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:34:47.290 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:47.287+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:47.344 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:47.344 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:47.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:34:47.390 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:47.387+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:47.492 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:47.491+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:34:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:34:47.510 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.1 primary-affinity to 0.480524 (8314912) 2024-09-22T01:34:47.529 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:47.529 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:47.543 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:34:47.592 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:47.591+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:47.693 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:47.691+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:47.706 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:47.706 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:47.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:34:47.794 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:47.791+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:47.895 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:47.895+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:47.896 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:47.896 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:47.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:34:47.995 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:47.991+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:48.031 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:48.031 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:48.045 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:34:48.096 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:48.095+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:48.164 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:48.164 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:48.179 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:34:48.197 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:48.195+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:48.298 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:48.299+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:48.351 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:48.351 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:48.366 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:34:48.407 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:48.407+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:48.500 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:48.499+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:48.550 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:48.551 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:48.566 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:34:48.601 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:48.599+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:48.694 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:48.694 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:48.702 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:48.699+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:48.708 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:34:48.803 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:48.799+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:48.827 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:48.827 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:48.841 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:34:48.903 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:48.903+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:48.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:34:49.001 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:49.001 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:49.003 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:48.999+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:49.015 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:34:49.084 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:34:49.084 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:34:49.101 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:34:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:34:49.104 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:49.103+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:49.117 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:34:49.118 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:34:49.136 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:34:49.136 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:34:49.156 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:34:49.156 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:34:49.176 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:34:49.176 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:34:49.180 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:49.180 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:34:49.180 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:34:49.180 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:49.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:34:49.198 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:34:49.198 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:34:49.206 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:49.203+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:49.218 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:34:49.219 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:34:49.307 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:49.307+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:49.311 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:49.312 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:34:49.312 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:34:49.312 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:34:49.312 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:49.325 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:34:49.408 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:49.407+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:49.443 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:49.443 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:34:49.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:34:49.443 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4257.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:38.355118+0000", 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 11.088798597, 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010210565, 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4257", 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/217131071", 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.355118+0000", 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.355118+0000", 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.355127+0000", 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0569999999999999e-06 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.355159+0000", 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2053e-05 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.355219+0000", 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0333e-05 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.355245+0000", 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5953e-05 2024-09-22T01:34:49.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.356078+0000", 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00083302699999999996 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.356109+0000", 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1124999999999998e-05 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.359083+0000", 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0029736889999999998 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.359418+0000", 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033475999999999997 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 2", 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.359768+0000", 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035017099999999998 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.361947+0000", 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0021792859999999999 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.365057+0000", 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031100329999999999 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.365199+0000", 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014199199999999999 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.365329+0000", 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012908599999999999 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop_reply(client.4257.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:38.361707+0000", 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 11.082209128000001, 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00025878499999999998, 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.361707+0000", 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.361707+0000", 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.361709+0000", 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.807e-06 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.361720+0000", 2024-09-22T01:34:49.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1233000000000001e-05 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.361754+0000", 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.361775+0000", 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1520000000000001e-05 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.361920+0000", 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014526900000000001 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.361936+0000", 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5939000000000001e-05 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.361966+0000", 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9807000000000001e-05 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4257.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:38.369408+0000", 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 11.074509015, 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035676099999999998, 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4257", 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/217131071", 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 2 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:49.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.369408+0000", 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.369408+0000", 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.369410+0000", 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1780000000000002e-06 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.369419+0000", 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1060000000000006e-06 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.369441+0000", 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1710999999999999e-05 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.369452+0000", 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1505000000000001e-05 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.369549+0000", 2024-09-22T01:34:49.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6706000000000005e-05 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.369764+0000", 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021555500000000001 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4257.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:38.370224+0000", 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 11.073692828, 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026952500000000001, 2024-09-22T01:34:49.457 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4257", 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/217131071", 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 3 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.370224+0000", 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.370224+0000", 2024-09-22T01:34:49.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.370225+0000", 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.091e-06 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.370231+0000", 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.212e-06 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.370248+0000", 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6503000000000001e-05 2024-09-22T01:34:49.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.370258+0000", 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0139000000000001e-05 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.370326+0000", 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8452000000000001e-05 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:38.370493+0000", 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000167128 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.460 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4257.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:39.355692+0000", 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.088224212, 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010806680000000001, 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4257", 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/217131071", 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 5 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:49.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.355692+0000", 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.355692+0000", 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.355696+0000", 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1860000000000001e-06 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.355711+0000", 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5150000000000001e-05 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.355746+0000", 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5026e-05 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.355792+0000", 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6159999999999999e-05 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.355936+0000", 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144606 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.355947+0000", 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0343000000000001e-05 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.363362+0000", 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0074149489999999997 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.363580+0000", 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000218548 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 1", 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.363804+0000", 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000224076 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.365163+0000", 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001358639 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:49.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366312+0000", 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001148732 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366398+0000", 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6569000000000004e-05 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366499+0000", 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100696 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.466 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop_reply(client.4257.0:5 2.2 e19/17 ondisk, result = 0)", 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:39.366099+0000", 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.077817216, 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00041502299999999999, 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366099+0000", 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366099+0000", 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366101+0000", 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.813e-06 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366110+0000", 2024-09-22T01:34:49.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8829999999999995e-06 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366133+0000", 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3264e-05 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366148+0000", 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4266e-05 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366286+0000", 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013845599999999999 2024-09-22T01:34:49.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366303+0000", 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6883000000000001e-05 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:39.366514+0000", 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021145800000000001 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4257.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:40.370470+0000", 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 9.0734470009999999, 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0073155540000000002, 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4257", 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/217131071", 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 7 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.471 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.370470+0000", 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.370470+0000", 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.370474+0000", 2024-09-22T01:34:49.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8130000000000003e-06 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.370489+0000", 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4993e-05 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.370525+0000", 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5833000000000001e-05 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:49.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.370544+0000", 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8933999999999999e-05 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.370685+0000", 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014091200000000001 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.370696+0000", 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1229999999999999e-05 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.374407+0000", 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037105689999999999 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.374644+0000", 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023745400000000001 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 1", 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.375100+0000", 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00045583599999999999 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.376494+0000", 2024-09-22T01:34:49.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013934660000000001 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377574+0000", 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0010806419999999999 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377664+0000", 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9462000000000005e-05 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377785+0000", 2024-09-22T01:34:49.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012141 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop_reply(client.4257.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:40.377399+0000", 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 9.0665176580000004, 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00039994999999999999, 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:49.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377399+0000", 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377399+0000", 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377400+0000", 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.497e-06 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377409+0000", 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7099999999999996e-06 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377433+0000", 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4389999999999999e-05 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377447+0000", 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3226e-05 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:49.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377548+0000", 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101403 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377562+0000", 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4153e-05 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:40.377799+0000", 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023657100000000001 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:49.480 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:49.481 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:49.481 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:34:49.524 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:49.523+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:49.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:34:49.610 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:49.607+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:49.643 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:34:49.643 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:34:49.643 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:49.659 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:34:49.710 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:49.707+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:49.779 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:49.780 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:34:49.780 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:34:49.780 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:34:49.780 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:49.793 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:34:49.836 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:49.835+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:49.912 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:49.911+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:49.956 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:49.957 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:34:49.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:34:49.957 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [] 2024-09-22T01:34:49.957 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:49.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:34:50.016 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:50.015+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:50.101 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:50.101 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:34:50.101 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:34:50.101 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:50.114 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:50.111+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:50.116 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:34:50.214 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:50.211+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:50.276 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:50.276 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:34:50.276 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:34:50.276 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:34:50.276 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:50.291 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:34:50.332 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:50.331+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:50.416 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:50.415+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:50.456 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:50.456 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 17.144657562999999, 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.457 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:34:50.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.462 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.212510+0000", 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 16.241186420999998, 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011227233, 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 37 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.463 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212510+0000", 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212510+0000", 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212511+0000", 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3799999999999997e-07 2024-09-22T01:34:50.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212517+0000", 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.934e-06 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212536+0000", 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8563000000000002e-05 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212548+0000", 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1471000000000001e-05 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.221623+0000", 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0090758760000000001 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.221758+0000", 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013510900000000001 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.221953+0000", 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019497199999999999 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.222951+0000", 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00099787899999999991 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.223595+0000", 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00064393499999999999 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.223678+0000", 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3053000000000006e-05 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.223737+0000", 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8903000000000002e-05 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.310510+0000", 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 16.143186222000001, 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010601688999999999, 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.468 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 87 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310510+0000", 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310510+0000", 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310512+0000", 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.347e-06 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310672+0000", 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016020499999999999 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310696+0000", 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4669999999999999e-05 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310714+0000", 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7827000000000001e-05 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.317310+0000", 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0065959859999999999 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.317522+0000", 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021203199999999999 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.317772+0000", 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000249638 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.320432+0000", 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0026597819999999999 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.320958+0000", 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00052596999999999995 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321047+0000", 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9191999999999996e-05 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321112+0000", 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5040000000000001e-05 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.310753+0000", 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 16.142943823, 2024-09-22T01:34:50.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011208645999999999, 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 88 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310753+0000", 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310753+0000", 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310754+0000", 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.443e-06 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310766+0000", 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.203e-05 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310818+0000", 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1502999999999998e-05 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310835+0000", 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.702e-05 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.319339+0000", 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0085041579999999995 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.319445+0000", 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000105766 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.319633+0000", 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018881400000000001 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.320882+0000", 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001249144 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321825+0000", 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00094259300000000003 2024-09-22T01:34:50.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321902+0000", 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6969000000000001e-05 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321961+0000", 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9206000000000002e-05 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.478 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.964191975, 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014449178, 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489506+0000", 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6700000000000001e-06 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489518+0000", 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2323e-05 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489537+0000", 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8960000000000001e-05 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489551+0000", 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3243e-05 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497558+0000", 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0080073049999999993 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497686+0000", 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012775899999999999 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497883+0000", 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000197622 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500679+0000", 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002795708 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503694+0000", 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030148739999999999 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503838+0000", 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014412499999999999 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503954+0000", 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011558899999999999 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.964083666000001, 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014775508999999999, 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.484 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489614+0000", 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6360000000000001e-06 2024-09-22T01:34:50.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489627+0000", 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2493999999999999e-05 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489656+0000", 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8770000000000001e-05 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489671+0000", 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4866e-05 2024-09-22T01:34:50.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499567+0000", 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0098963839999999994 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499697+0000", 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000130106 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499889+0000", 2024-09-22T01:34:50.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019192499999999999 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504109+0000", 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0042195770000000004 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504146+0000", 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7639999999999999e-05 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504270+0000", 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123409 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504388+0000", 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000118702 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.96399796, 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.019730597999999998, 2024-09-22T01:34:50.489 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 112 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489700+0000", 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.26e-06 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489899+0000", 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000199672 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489924+0000", 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4136000000000001e-05 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489939+0000", 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5457000000000001e-05 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500788+0000", 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010848806000000001 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500909+0000", 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000121322 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.501195+0000", 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028595500000000001 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504533+0000", 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0033380369999999999 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509171+0000", 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0046382649999999999 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509312+0000", 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014064200000000001 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509429+0000", 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117046 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.494 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.963727745, 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.021089374000000001, 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 113 2024-09-22T01:34:50.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489970+0000", 2024-09-22T01:34:50.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.426e-06 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489982+0000", 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1547e-05 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490011+0000", 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9119e-05 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490024+0000", 2024-09-22T01:34:50.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3667e-05 2024-09-22T01:34:50.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.498 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.498 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502168+0000", 2024-09-22T01:34:50.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012143693000000001 2024-09-22T01:34:50.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.498 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.498 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502411+0000", 2024-09-22T01:34:50.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024248499999999999 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502788+0000", 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00037754100000000001 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504678+0000", 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0018899450000000001 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510804+0000", 2024-09-22T01:34:50.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.006125836 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510947+0000", 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142712 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511058+0000", 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111403 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.963642556, 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.021258902999999999, 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 114 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490055+0000", 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490066+0000", 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.097e-05 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490097+0000", 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0470000000000001e-05 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490112+0000", 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5213e-05 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504774+0000", 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014662669999999999 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504905+0000", 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013048500000000001 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.505109+0000", 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000204539 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509133+0000", 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.004023403 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511078+0000", 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0019454749999999999 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511196+0000", 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011812200000000001 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511313+0000", 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000116286 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.963548947, 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.022115017000000001, 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 115 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:34:50.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490149+0000", 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3769999999999999e-06 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490346+0000", 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019744200000000001 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490363+0000", 2024-09-22T01:34:50.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6973000000000002e-05 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490374+0000", 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.06e-05 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.505802+0000", 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015427946999999999 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.506040+0000", 2024-09-22T01:34:50.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023778199999999999 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.506469+0000", 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042951300000000002 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509495+0000", 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030255199999999999 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512030+0000", 2024-09-22T01:34:50.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025350049999999999 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512162+0000", 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013271800000000001 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512262+0000", 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010014 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.963301182, 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.02212739, 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 116 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490396+0000", 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0160000000000001e-06 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490404+0000", 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7039999999999994e-06 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490417+0000", 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.341e-05 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490425+0000", 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0160000000000008e-06 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.507941+0000", 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.017515414999999999 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.508122+0000", 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000181452 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.508335+0000", 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021324199999999999 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511427+0000", 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030917090000000002 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512288+0000", 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00086098100000000003 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512420+0000", 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013192499999999999 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512523+0000", 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010252 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.963257631999999, 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.022626255000000001, 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.517 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 117 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490440+0000", 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.1600000000000001e-07 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490448+0000", 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0339999999999997e-06 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490486+0000", 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8065999999999998e-05 2024-09-22T01:34:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490500+0000", 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4583000000000001e-05 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509568+0000", 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.019067589999999999 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509809+0000", 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000240738 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510189+0000", 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000380281 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511540+0000", 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013514759999999999 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512847+0000", 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013063860000000001 2024-09-22T01:34:50.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512970+0000", 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123106 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.513065+0000", 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5278999999999994e-05 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.522 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005421+0000", 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.448275161, 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012578448000000001, 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 136 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005421+0000", 2024-09-22T01:34:50.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005421+0000", 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005422+0000", 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4099999999999999e-07 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005427+0000", 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8879999999999996e-06 2024-09-22T01:34:50.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005437+0000", 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0196e-05 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005442+0000", 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4260000000000002e-06 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.013089+0000", 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.007646506 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.013263+0000", 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174375 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.013516+0000", 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00025259099999999998 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016006+0000", 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024905510000000001 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017939+0000", 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0019327459999999999 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017973+0000", 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4337e-05 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018000+0000", 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6291e-05 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005489+0000", 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.448207093000001, 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012782085, 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 137 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005489+0000", 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005489+0000", 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005490+0000", 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.27e-07 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005552+0000", 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2180000000000004e-05 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005565+0000", 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2928999999999999e-05 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005572+0000", 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2019999999999998e-06 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.014223+0000", 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0086508520000000005 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.014332+0000", 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000108999 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.014530+0000", 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000198557 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017893+0000", 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00336266 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018098+0000", 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000204601 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018207+0000", 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109242 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018271+0000", 2024-09-22T01:34:50.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4436000000000004e-05 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.44809085, 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014112458, 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.533 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 138 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:50.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4099999999999998e-07 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005612+0000", 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4700000000000001e-06 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005622+0000", 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0593e-05 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005627+0000", 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2560000000000004e-06 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016043+0000", 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010416383 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016182+0000", 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013903200000000001 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016412+0000", 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023044499999999999 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019539+0000", 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031267230000000001 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019564+0000", 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5245999999999999e-05 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019651+0000", 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6782999999999999e-05 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019718+0000", 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6785999999999994e-05 2024-09-22T01:34:50.537 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.448058128, 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014654660999999999, 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.538 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 139 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005639+0000", 2024-09-22T01:34:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8200000000000001e-07 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005642+0000", 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3330000000000001e-06 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005649+0000", 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7279999999999998e-06 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005654+0000", 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5790000000000003e-06 2024-09-22T01:34:50.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017113+0000", 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011458822 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017220+0000", 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000107354 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017393+0000", 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017226700000000001 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019736+0000", 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0023427639999999998 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020234+0000", 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000498856 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020267+0000", 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2160999999999999e-05 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020293+0000", 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6415e-05 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.447946268999999, 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015246857000000001, 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.543 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 140 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005751+0000", 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.34e-07 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005811+0000", 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9935999999999997e-05 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005821+0000", 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0617e-05 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005825+0000", 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0090000000000001e-06 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018312+0000", 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012486919000000001 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018371+0000", 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8548000000000003e-05 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018462+0000", 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1254000000000004e-05 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019978+0000", 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0015163010000000001 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020947+0000", 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00096895599999999998 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020976+0000", 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8731999999999999e-05 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020997+0000", 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1151000000000001e-05 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.548 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 15.447849278, 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015779920999999999, 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 141 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005848+0000", 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1800000000000001e-07 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005851+0000", 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.878e-06 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005874+0000", 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3014e-05 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005882+0000", 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019064+0000", 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.013182268 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019124+0000", 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9358000000000003e-05 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019202+0000", 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7906999999999998e-05 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020379+0000", 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0011774940000000001 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021577+0000", 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0011975759999999999 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021605+0000", 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7968000000000001e-05 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021627+0000", 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2480000000000002e-05 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 14.712905713, 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010640472999999999, 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.554 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 158 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8000000000000005e-07 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740917+0000", 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012581499999999999 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740938+0000", 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0574e-05 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740950+0000", 2024-09-22T01:34:50.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1779e-05 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.747810+0000", 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0068605430000000002 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.748039+0000", 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022844200000000001 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.748307+0000", 2024-09-22T01:34:50.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000268375 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751089+0000", 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0027817749999999998 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751220+0000", 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013090899999999999 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751359+0000", 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013917199999999999 2024-09-22T01:34:50.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751431+0000", 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2309000000000002e-05 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.740966+0000", 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 14.712729935, 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012971455999999999, 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:50.559 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 159 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740966+0000", 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740966+0000", 2024-09-22T01:34:50.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740967+0000", 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7000000000000004e-07 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740974+0000", 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6969999999999996e-06 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740985+0000", 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0723000000000001e-05 2024-09-22T01:34:50.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740992+0000", 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4359999999999996e-06 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.749836+0000", 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0088437719999999997 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.749966+0000", 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013021899999999999 2024-09-22T01:34:50.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.750165+0000", 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019899800000000001 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751512+0000", 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013465969999999999 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.753769+0000", 2024-09-22T01:34:50.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0022572590000000002 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.753840+0000", 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0660000000000004e-05 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.753938+0000", 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8325000000000005e-05 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:50.564 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:50.566 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:34:50.566 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:50.563+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:50.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:34:50.667 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:50.667+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:50.736 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:50.736 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:50.737 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:34:50.737 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:50.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:34:50.795 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:50.795+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:50.868 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:50.867+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:50.927 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:34:50.928 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:34:50.928 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:50.942 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:34:50.983 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:50.983+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:51.069 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:51.067+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:51.110 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:20 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'10, mlcod=15'8)", 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.194181+0000", 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.916018445999999, 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0026287200000000002, 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.111 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.194181+0000", 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.194181+0000", 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.194183+0000", 2024-09-22T01:34:51.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9599999999999999e-06 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.194427+0000", 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000244088 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.194458+0000", 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999997e-05 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.194472+0000", 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4436999999999999e-05 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.194585+0000", 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112725 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.194620+0000", 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4916999999999998e-05 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.196646+0000", 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020264340000000001 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.196810+0000", 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016322900000000001 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:31 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'17, mlcod=15'14)", 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.212841+0000", 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.897358146999998, 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0036350459999999999, 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.212841+0000", 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.212841+0000", 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.212843+0000", 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.77e-06 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.212855+0000", 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1773999999999999e-05 2024-09-22T01:34:51.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.212885+0000", 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9793000000000001e-05 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.212903+0000", 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8845999999999999e-05 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.213068+0000", 2024-09-22T01:34:51.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164489 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.213127+0000", 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.923e-05 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.216391+0000", 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032636869999999999 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.216476+0000", 2024-09-22T01:34:51.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5457000000000005e-05 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:32 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'18, mlcod=15'14)", 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.213751+0000", 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.896448289999999, 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039557849999999999, 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.213751+0000", 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.213751+0000", 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.213753+0000", 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5999999999999999e-06 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.213833+0000", 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0399000000000001e-05 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.213866+0000", 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3130000000000003e-05 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.213882+0000", 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5936000000000001e-05 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.214231+0000", 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034877699999999998 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.214331+0000", 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9562999999999995e-05 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217610+0000", 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032797880000000001 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217707+0000", 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6591999999999999e-05 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:33 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'19, mlcod=15'14)", 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.215049+0000", 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.895150627, 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027517589999999999, 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.215049+0000", 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.215049+0000", 2024-09-22T01:34:51.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.215051+0000", 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.767e-06 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.215063+0000", 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2723e-05 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.215094+0000", 2024-09-22T01:34:51.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0283000000000001e-05 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.215108+0000", 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4303e-05 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.215489+0000", 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038080699999999999 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.215543+0000", 2024-09-22T01:34:51.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4783e-05 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217718+0000", 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002174746 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217801+0000", 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2347000000000003e-05 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:34 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'20, mlcod=15'14)", 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.216100+0000", 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.894099572000002, 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0026699459999999999, 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.216100+0000", 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.216100+0000", 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.216101+0000", 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.144e-06 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.216112+0000", 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0793e-05 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.216131+0000", 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.929e-05 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.216179+0000", 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8335999999999999e-05 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.216632+0000", 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00045220999999999998 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.216692+0000", 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0365999999999998e-05 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.218650+0000", 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019583550000000002 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.218770+0000", 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011945199999999999 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.132 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:35 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'21, mlcod=15'15)", 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.217274+0000", 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.892925158000001, 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027452650000000002, 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217274+0000", 2024-09-22T01:34:51.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217274+0000", 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217276+0000", 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.717e-06 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217355+0000", 2024-09-22T01:34:51.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8522999999999993e-05 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217387+0000", 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2805999999999997e-05 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217401+0000", 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3847e-05 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217862+0000", 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00046119599999999998 2024-09-22T01:34:51.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.217902+0000", 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9677e-05 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.219890+0000", 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019876500000000001 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.220020+0000", 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000129849 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:54 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'32, mlcod=15'29)", 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.250806+0000", 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.859393096000002, 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002677029, 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.250806+0000", 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.250806+0000", 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.250808+0000", 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7659999999999999e-06 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.250820+0000", 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1766999999999999e-05 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.250848+0000", 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8390000000000001e-05 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.250862+0000", 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.342e-05 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.251038+0000", 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017675500000000001 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.251096+0000", 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7593000000000002e-05 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.253398+0000", 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023022490000000001 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.253483+0000", 2024-09-22T01:34:51.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5088999999999998e-05 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:55 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'33, mlcod=15'29)", 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.251810+0000", 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.858389340999999, 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028206120000000001, 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.251810+0000", 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.251810+0000", 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.251812+0000", 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7099999999999999e-06 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.251882+0000", 2024-09-22T01:34:51.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9722999999999996e-05 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.251909+0000", 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7416999999999999e-05 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.251932+0000", 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3142999999999998e-05 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.252095+0000", 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162528 2024-09-22T01:34:51.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.252157+0000", 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2226999999999999e-05 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.254545+0000", 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023882909999999999 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.254631+0000", 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5573000000000002e-05 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:68 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'42, mlcod=15'39)", 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.277050+0000", 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.833149013, 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029456719999999999, 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.277050+0000", 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.277050+0000", 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.277052+0000", 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6670000000000001e-06 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.277065+0000", 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2713e-05 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.277094+0000", 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9454e-05 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.277112+0000", 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7343e-05 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.277250+0000", 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013833199999999999 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.277313+0000", 2024-09-22T01:34:51.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3232999999999996e-05 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.279875+0000", 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025615540000000002 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.279996+0000", 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121376 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:69 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'43, mlcod=15'39)", 2024-09-22T01:34:51.148 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.278206+0000", 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.831993190999999, 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028939840000000001, 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.278206+0000", 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.278206+0000", 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.278208+0000", 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.736e-06 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.278263+0000", 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5112999999999999e-05 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.278293+0000", 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9674000000000001e-05 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.278307+0000", 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.38e-05 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.278446+0000", 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013907899999999999 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.278499+0000", 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3551999999999998e-05 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.281007+0000", 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002507521 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.281100+0000", 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3509000000000002e-05 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.152 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:71 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'45, mlcod=15'43)", 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.285059+0000", 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.825140384000001, 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024321379999999999, 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.285059+0000", 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.285059+0000", 2024-09-22T01:34:51.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.285061+0000", 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6130000000000001e-06 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.285124+0000", 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3713000000000005e-05 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.285154+0000", 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9733000000000001e-05 2024-09-22T01:34:51.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.285168+0000", 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3657e-05 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.285312+0000", 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014424500000000001 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.285369+0000", 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6626000000000003e-05 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.287366+0000", 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019975349999999999 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.287491+0000", 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012501600000000001 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:72 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'46, mlcod=15'43)", 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.286226+0000", 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.823973339999998, 2024-09-22T01:34:51.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025892799999999998, 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.286226+0000", 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.286226+0000", 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.286228+0000", 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7829999999999999e-06 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.286294+0000", 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6307000000000001e-05 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.286328+0000", 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3476000000000003e-05 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.286345+0000", 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6869999999999999e-05 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.286491+0000", 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000146355 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.286551+0000", 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0197e-05 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.288685+0000", 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021340529999999999 2024-09-22T01:34:51.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.288815+0000", 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013023900000000001 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:83 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'50)", 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.311383+0000", 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.798816661, 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028657779999999998, 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.311383+0000", 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.311383+0000", 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.311385+0000", 2024-09-22T01:34:51.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.764e-06 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.311410+0000", 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5772999999999999e-05 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.311438+0000", 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7973000000000001e-05 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.311457+0000", 2024-09-22T01:34:51.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.84e-05 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.311613+0000", 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015646599999999999 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.311666+0000", 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2818999999999997e-05 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.314161+0000", 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024946170000000002 2024-09-22T01:34:51.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.314249+0000", 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7966000000000004e-05 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:87 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'57, mlcod=15'52)", 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:34.317402+0000", 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.792797227000001, 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002643767, 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.164 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.317402+0000", 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.317402+0000", 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.317404+0000", 2024-09-22T01:34:51.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7230000000000001e-06 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.317471+0000", 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.745e-05 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.317497+0000", 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6089e-05 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.317510+0000", 2024-09-22T01:34:51.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.222e-05 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.317625+0000", 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115349 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.317659+0000", 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4084000000000001e-05 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.319975+0000", 2024-09-22T01:34:51.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023158720000000001 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:34.320046+0000", 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0980000000000001e-05 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:134 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'88)", 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:35.010408+0000", 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.099791372999999, 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002518148, 2024-09-22T01:34:51.168 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.010408+0000", 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.010408+0000", 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.010410+0000", 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7439999999999999e-06 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.010466+0000", 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5899999999999997e-05 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.010496+0000", 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0273e-05 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.010513+0000", 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7266e-05 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.010624+0000", 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110993 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.010660+0000", 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5883000000000002e-05 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.012850+0000", 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021902559999999998 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.012926+0000", 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5833000000000004e-05 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:136 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'94, mlcod=16'90)", 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:35.013074+0000", 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.097125419000001, 2024-09-22T01:34:51.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025517629999999999, 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.013074+0000", 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.013074+0000", 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.013076+0000", 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9130000000000001e-06 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.013091+0000", 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5293000000000001e-05 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.013159+0000", 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7489000000000004e-05 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.013183+0000", 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4426999999999998e-05 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.013364+0000", 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018095900000000001 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.013403+0000", 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8862000000000002e-05 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.015528+0000", 2024-09-22T01:34:51.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021255139999999998 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.015626+0000", 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7306000000000007e-05 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:137 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'95, mlcod=16'90)", 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:35.014175+0000", 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.096023962, 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025771800000000001, 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.014175+0000", 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.014175+0000", 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.014178+0000", 2024-09-22T01:34:51.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.024e-06 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.014249+0000", 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1342999999999998e-05 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.014285+0000", 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5759000000000001e-05 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.014308+0000", 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2957000000000001e-05 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.014487+0000", 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000179505 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.014524+0000", 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6637000000000002e-05 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.016691+0000", 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021670930000000001 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.016753+0000", 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1861999999999998e-05 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:139 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'97, mlcod=16'92)", 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:35.016917+0000", 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.093282549000001, 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002497647, 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.180 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.016917+0000", 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.016917+0000", 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.016918+0000", 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.016929+0000", 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1153e-05 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.016969+0000", 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9669999999999998e-05 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.016983+0000", 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4256e-05 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.017101+0000", 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117806 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.017136+0000", 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4489000000000001e-05 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.019341+0000", 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022050500000000001 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.019415+0000", 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3953000000000002e-05 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4207.0:142 1.0 e16/14 1:30306672:devicehealth::main.db.0000000000000000:head v 16'100, mlcod=16'98)", 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:35.021951+0000", 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.088248021999998, 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0026812239999999998, 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.021951+0000", 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.021951+0000", 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.021953+0000", 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5370000000000001e-06 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.022046+0000", 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3403e-05 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.022076+0000", 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0122999999999999e-05 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.022090+0000", 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.383e-05 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.022266+0000", 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017529199999999999 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.022303+0000", 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7089999999999999e-05 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.024513+0000", 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022106830000000002 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:35.024633+0000", 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011926600000000001 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:50.542145+0000", 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.56805469799999997, 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047856670000000004, 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:51.188 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542145+0000", 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542145+0000", 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542147+0000", 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3970000000000001e-06 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542160+0000", 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2788e-05 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542184+0000", 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3672e-05 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542197+0000", 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3746e-05 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542292+0000", 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4823999999999999e-05 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542303+0000", 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0648e-05 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:51.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.544487+0000", 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021844970000000001 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.544585+0000", 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7621999999999995e-05 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5", 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.544740+0000", 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155076 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.545896+0000", 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011557780000000001 2024-09-22T01:34:51.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.546824+0000", 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092794800000000005 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.546887+0000", 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2921000000000003e-05 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.546930+0000", 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.375e-05 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:51.194 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:51.194 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:51.195 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:34:51.196 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:51.195+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:51.238 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:34:51.296 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:51.295+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:51.354 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:34:51.354 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:51.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:34:51.379 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:34:51.380 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:34:51.396 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:34:51.396 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:34:51.396 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:51.395+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:34:51.413 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:34:51.413 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:34:51.429 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:34:51.429 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:34:51.450 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:34:51.450 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:34:51.470 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:34:51.471 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:34:51.489 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:51.490 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:51.491 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:34:51.491 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:34:51.497 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:51.495+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:51.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:34:51.512 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:34:51.512 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:34:51.599 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:51.599+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:51.621 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:51.621 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:51.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:34:51.699 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:51.695+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:51.746 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:51.746 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:51.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:34:51.799 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:51.799+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:51.875 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:51.875 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:51.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:34:51.935 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:51.935+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:34:52.001 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:51.999+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:34:52.006 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:52.006 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:52.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:34:52.102 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:52.099+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:52.175 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:52.175 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:52.189 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:34:52.203 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:52.199+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:52.304 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:52.303+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:34:52.309 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:52.309 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:52.323 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:34:52.405 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:52.407+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:52.488 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:52.488 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:52.501 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:34:52.506 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:52.503+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:52.518 INFO:teuthology.orchestra.run.smithi018.stdout:skipping zero size read 2024-09-22T01:34:52.532 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:34:52.532 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:34:52.532 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-22T01:34:52.532 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-22T01:34:52.533 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-22T01:34:52.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-22T01:34:52.539 INFO:teuthology.orchestra.run.smithi018.stdout:2 write 0xa464803 thru 0xa46a745 (0x5f43 bytes) 2024-09-22T01:34:52.543 INFO:teuthology.orchestra.run.smithi018.stdout:3 write 0xa20a0d1 thru 0xa20e48b (0x43bb bytes) 2024-09-22T01:34:52.548 INFO:teuthology.orchestra.run.smithi018.stdout:truncating to largest ever: 0x8517c55 2024-09-22T01:34:52.551 INFO:teuthology.orchestra.run.smithi018.stdout:5 trunc from 0xa46a746 to 0x8517c55 2024-09-22T01:34:52.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:34:52.572 INFO:teuthology.orchestra.run.smithi018.stdout:6 read 0x3b90cac thru 0x3b9e2c0 (0xd615 bytes) 2024-09-22T01:34:52.572 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:52.572 INFO:teuthology.orchestra.run.smithi018.stdout:8 write 0x630801d thru 0x6308ce0 (0xcc4 bytes) 2024-09-22T01:34:52.576 INFO:teuthology.orchestra.run.smithi018.stdout:9 write 0x6d7af1b thru 0x6d7f71c (0x4802 bytes) 2024-09-22T01:34:52.606 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:52.602+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:52.637 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:52.637 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:52.651 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:34:52.674 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:52.674 INFO:teuthology.orchestra.run.smithi179.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-22T01:34:52.674 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:52.732 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:52.730+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:52.787 INFO:teuthology.orchestra.run.smithi018.stdout:10 read 0x17c9ce2 thru 0x17d542c (0xb74b bytes) 2024-09-22T01:34:52.787 INFO:teuthology.orchestra.run.smithi018.stdout:11 read 0x608eaa9 thru 0x609384b (0x4da3 bytes) 2024-09-22T01:34:52.795 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:52.795 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:52.804 INFO:teuthology.orchestra.run.smithi018.stdout:12 write 0x9e1802f thru 0x9e1ac4c (0x2c1e bytes) 2024-09-22T01:34:52.807 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:52.807+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:52.810 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:34:52.812 INFO:teuthology.orchestra.run.smithi018.stdout:13 writesame 0x779da13 thru 0x77a7d76 data_size 0x2(0xa364 bytes) 2024-09-22T01:34:52.848 INFO:teuthology.orchestra.run.smithi018.stdout:14 write 0xb9bbe6b thru 0xb9c8b96 (0xcd2c bytes) 2024-09-22T01:34:52.855 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:52.855 INFO:teuthology.orchestra.run.smithi018.stdout:16 punch from 0xbe5217 to 0xbee012, (0x8dfb bytes) 2024-09-22T01:34:52.855 INFO:teuthology.orchestra.run.smithi018.stdout:17 read 0x756940a thru 0x7574e4b (0xba42 bytes) 2024-09-22T01:34:52.855 INFO:teuthology.orchestra.run.smithi018.stdout:18 clone 1 order 23 su 131072 sc 9 2024-09-22T01:34:52.908 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:52.902+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:52.976 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:52.976 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:52.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:34:53.009 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:53.007+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:53.110 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:53.107+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:53.156 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:53.156 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:53.170 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:34:53.216 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:53.214+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:53.287 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:53.288 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:53.301 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:34:53.311 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:53.311+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:53.412 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:53.406+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:53.466 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:53.467 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:53.481 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:34:53.525 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:53.522+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:53.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:34:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:34:53.619 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:53.619+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:53.657 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:53.657 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:53.672 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:34:53.691 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:34:53.692 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:34:53.710 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:34:53.710 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:34:53.716 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:53.714+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:53.728 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:34:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:34:53.746 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:34:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:34:53.767 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:34:53.767 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:34:53.771 INFO:teuthology.orchestra.run.smithi018.stdout:19 writesame 0x12e4bed thru 0x12ea788 data_size 0x52(0x5b9c bytes) 2024-09-22T01:34:53.782 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:53.782 INFO:teuthology.orchestra.run.smithi018.stdout:21 read 0x559f5d1 thru 0x55ac311 (0xcd41 bytes) 2024-09-22T01:34:53.782 INFO:teuthology.orchestra.run.smithi018.stdout:22 punch from 0x4f81f4c to 0x4f84431, (0x24e5 bytes) 2024-09-22T01:34:53.782 INFO:teuthology.orchestra.run.smithi018.stdout:23 writesame 0x60e2f6 thru 0x612b6a data_size 0x51(0x4875 bytes) 2024-09-22T01:34:53.787 INFO:teuthology.orchestra.run.smithi018.stdout:24 write 0x2c9d5b thru 0x2d9184 (0xf42a bytes) 2024-09-22T01:34:53.789 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:34:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:34:53.792 INFO:teuthology.orchestra.run.smithi018.stdout:27 read 0x726d5bb thru 0x727c77c (0xf1c2 bytes) 2024-09-22T01:34:53.792 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:53.793 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:53.793 INFO:teuthology.orchestra.run.smithi018.stdout:32 read 0x294043a thru 0x29418f2 (0x14b9 bytes) 2024-09-22T01:34:53.793 INFO:teuthology.orchestra.run.smithi018.stdout:33 punch from 0x3681513 to 0x368f4ea, (0xdfd7 bytes) 2024-09-22T01:34:53.793 INFO:teuthology.orchestra.run.smithi018.stdout:34 write 0xb28b9bd thru 0xb29863f (0xcc83 bytes) 2024-09-22T01:34:53.797 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:53.797 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:53.798 INFO:teuthology.orchestra.run.smithi018.stdout:35 write 0xb0e8f95 thru 0xb0ed1f0 (0x425c bytes) 2024-09-22T01:34:53.803 INFO:teuthology.orchestra.run.smithi018.stdout:36 write 0x714a3fb thru 0x714a79b (0x3a1 bytes) 2024-09-22T01:34:53.810 INFO:teuthology.orchestra.run.smithi018.stdout:37 read 0x83b53dd thru 0x83baf04 (0x5b28 bytes) 2024-09-22T01:34:53.810 INFO:teuthology.orchestra.run.smithi018.stdout:38 write 0x39a9331 thru 0x39b6176 (0xce46 bytes) 2024-09-22T01:34:53.812 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:34:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:34:53.814 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:34:53.814 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:53.811+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:34:53.815 INFO:teuthology.orchestra.run.smithi018.stdout:39 punch from 0x95cc4ac to 0x95d6b9e, (0xa6f2 bytes) 2024-09-22T01:34:53.816 INFO:teuthology.orchestra.run.smithi018.stdout:40 read 0x452baf4 thru 0x4532f32 (0x743f bytes) 2024-09-22T01:34:53.816 INFO:teuthology.orchestra.run.smithi018.stdout:41 punch from 0x8d662d6 to 0x8d74b21, (0xe84b bytes) 2024-09-22T01:34:53.816 INFO:teuthology.orchestra.run.smithi018.stdout:42 write 0x134120c thru 0x1345338 (0x412d bytes) 2024-09-22T01:34:53.821 INFO:teuthology.orchestra.run.smithi018.stdout:43 read 0x1684217 thru 0x168eb78 (0xa962 bytes) 2024-09-22T01:34:53.832 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:34:53.832 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:34:53.836 INFO:teuthology.orchestra.run.smithi018.stdout:46 trunc from 0xb9c8b97 to 0xed1f5d 2024-09-22T01:34:53.875 INFO:teuthology.orchestra.run.smithi018.stdout:47 writesame 0x7f89f81 thru 0x7f8e2f2 data_size 0x2(0x4372 bytes) 2024-09-22T01:34:53.875 INFO:teuthology.orchestra.run.smithi018.stdout:49 read 0x1925a1b thru 0x1931394 (0xb97a bytes) 2024-09-22T01:34:53.875 INFO:teuthology.orchestra.run.smithi018.stdout:50 write 0x17ff15a thru 0x17ffe29 (0xcd0 bytes) 2024-09-22T01:34:53.887 INFO:teuthology.orchestra.run.smithi018.stdout:51 writesame 0xa0c7e5b thru 0xa0d44b4 data_size 0x7e(0xc65a bytes) 2024-09-22T01:34:53.888 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:53.888 INFO:teuthology.orchestra.run.smithi018.stdout:53 read 0x1135fe thru 0x118d6f (0x5772 bytes) 2024-09-22T01:34:53.901 INFO:teuthology.orchestra.run.smithi018.stdout:54 trunc from 0xa0d44b5 to 0x25169c5 2024-09-22T01:34:53.913 INFO:teuthology.orchestra.run.smithi018.stdout:55 read 0x204aafe thru 0x2057d2a (0xd22d bytes) 2024-09-22T01:34:53.914 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:53.910+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:56 write 0xe9865d1 thru 0xe9957fd (0xf22d bytes) 2024-09-22T01:34:53.952 INFO:teuthology.orchestra.run.smithi018.stdout:58 writesame 0xad2dd48 thru 0xad36821 data_size 0xe(0x8ada bytes) 2024-09-22T01:34:53.958 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:53.958 INFO:teuthology.orchestra.run.smithi018.stdout:60 read 0xce3f7b9 thru 0xce47a0f (0x8257 bytes) 2024-09-22T01:34:53.958 INFO:teuthology.orchestra.run.smithi018.stdout:61 write 0x7b00a6b thru 0x7b09b0b (0x90a1 bytes) 2024-09-22T01:34:53.965 INFO:teuthology.orchestra.run.smithi018.stdout:62 write 0x4201a0b thru 0x42023a3 (0x999 bytes) 2024-09-22T01:34:53.969 INFO:teuthology.orchestra.run.smithi018.stdout:64 writesame 0x6427299 thru 0x643270e data_size 0x1(0xb476 bytes) 2024-09-22T01:34:53.985 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:53.985 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:34:53.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:12 3.a 3:5158c39c:::rbd_header.110f1416e5fa:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.548950+0000", 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.4360646340000001, 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0053687539999999999, 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 12 2024-09-22T01:34:53.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.548950+0000", 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.548950+0000", 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.548951+0000", 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:34:53.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.548967+0000", 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6191000000000001e-05 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.548981+0000", 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3959e-05 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.548992+0000", 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0383e-05 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.549097+0000", 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010493300000000001 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.549107+0000", 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0876999999999999e-05 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.551944+0000", 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002836472 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.552101+0000", 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000157279 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.552335+0000", 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000234186 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554175+0000", 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001839788 2024-09-22T01:34:53.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554222+0000", 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6826999999999997e-05 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554278+0000", 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5952999999999998e-05 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554318+0000", 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0491999999999998e-05 2024-09-22T01:34:53.991 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop_reply(client.4367.0:12 3.a e25/22 ondisk, result = 0)", 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.554085+0000", 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.430929098, 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000240635, 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.992 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554085+0000", 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554085+0000", 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554087+0000", 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.576e-06 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:53.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554095+0000", 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554124+0000", 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9156999999999999e-05 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554153+0000", 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.879e-05 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:53.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554208+0000", 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5299e-05 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554216+0000", 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9419999999999995e-06 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.554326+0000", 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010983400000000001 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:16 3.a 3:5158c39c:::rbd_header.110f1416e5fa:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.560479+0000", 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.4245357639999998, 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000467467, 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 16 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.560479+0000", 2024-09-22T01:34:53.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.560479+0000", 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.560481+0000", 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9700000000000002e-06 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.560491+0000", 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9990000000000003e-06 2024-09-22T01:34:53.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.560519+0000", 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8350000000000001e-05 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.560534+0000", 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.560607+0000", 2024-09-22T01:34:53.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2925999999999999e-05 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.560696+0000", 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9845000000000005e-05 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.560946+0000", 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024958000000000001 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:53.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:17 3.a 3:5158c39c:::rbd_header.110f1416e5fa:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.561159+0000", 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.4238550870000002, 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00046857700000000002, 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 17 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561159+0000", 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561159+0000", 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561161+0000", 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3239999999999999e-06 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561168+0000", 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2400000000000001e-06 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561187+0000", 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9266000000000002e-05 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561200+0000", 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.243e-05 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561292+0000", 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2412999999999998e-05 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561424+0000", 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131965 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561628+0000", 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020393899999999999 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.003 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:18 3.a 3:5158c39c:::rbd_header.110f1416e5fa:head [call,call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.561910+0000", 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.4231044160000001, 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000345507, 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 18 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561910+0000", 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561910+0000", 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561911+0000", 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.114e-06 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561917+0000", 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0730000000000001e-06 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561934+0000", 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7085999999999999e-05 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.561949+0000", 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5099999999999999e-05 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562012+0000", 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2645999999999996e-05 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562094+0000", 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2120000000000007e-05 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562255+0000", 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000161368 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19 3.a 3:5158c39c:::rbd_header.110f1416e5fa:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:54.007 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.562627+0000", 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.422387654, 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00043381600000000001, 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562627+0000", 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562627+0000", 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562628+0000", 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.423e-06 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562636+0000", 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7200000000000006e-06 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.009 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562655+0000", 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8787000000000002e-05 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562664+0000", 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5429999999999999e-06 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562739+0000", 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5125999999999999e-05 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.562856+0000", 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000116319 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.563061+0000", 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020489799999999999 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:20 3.a 3:5158c39c:::rbd_header.110f1416e5fa:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.563912+0000", 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.4211026840000001, 2024-09-22T01:34:54.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00063351200000000003, 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 20 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.563912+0000", 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.563912+0000", 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.563914+0000", 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8500000000000001e-06 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.563923+0000", 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8859999999999999e-06 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.563952+0000", 2024-09-22T01:34:54.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8827e-05 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.563967+0000", 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4363e-05 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.564038+0000", 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.1810999999999994e-05 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.564124+0000", 2024-09-22T01:34:54.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5951000000000004e-05 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.564545+0000", 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042082399999999998 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:21 3.a 3:5158c39c:::rbd_header.110f1416e5fa:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.564906+0000", 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.4201084150000001, 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00052159400000000001, 2024-09-22T01:34:54.015 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 21 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.564906+0000", 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.564906+0000", 2024-09-22T01:34:54.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.564908+0000", 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6199999999999999e-06 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.564918+0000", 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0783e-05 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.564948+0000", 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9346e-05 2024-09-22T01:34:54.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.564972+0000", 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3824000000000001e-05 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.565043+0000", 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.1916999999999996e-05 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.565126+0000", 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2504999999999997e-05 2024-09-22T01:34:54.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.565428+0000", 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000301599 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:22 3.a 3:5158c39c:::rbd_header.110f1416e5fa:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.565906+0000", 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.4191079790000001, 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00052680900000000004, 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.019 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 22 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.565906+0000", 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.565906+0000", 2024-09-22T01:34:54.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.565908+0000", 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.863e-06 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.565918+0000", 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0057e-05 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.565947+0000", 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8586e-05 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.565961+0000", 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4127e-05 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.566058+0000", 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6998999999999997e-05 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.566195+0000", 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013744899999999999 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.566433+0000", 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023772800000000001 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:24 3.a 3:5158c39c:::rbd_header.110f1416e5fa:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.568069+0000", 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.416945106, 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00034515400000000002, 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 24 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568069+0000", 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568069+0000", 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568071+0000", 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9460000000000001e-06 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568083+0000", 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1389999999999999e-05 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568111+0000", 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8524e-05 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568126+0000", 2024-09-22T01:34:54.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4643e-05 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568201+0000", 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4807000000000004e-05 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568275+0000", 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4828999999999998e-05 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568414+0000", 2024-09-22T01:34:54.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013901500000000001 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:25 3.a 3:5158c39c:::rbd_header.110f1416e5fa:head [watch watch cookie 140215381417984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.568778+0000", 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.4162366450000001, 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002238823, 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:54.027 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 25 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568778+0000", 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568778+0000", 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568779+0000", 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.31e-06 2024-09-22T01:34:54.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568786+0000", 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6800000000000004e-06 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568807+0000", 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0893000000000001e-05 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568817+0000", 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0847e-05 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.568909+0000", 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1149000000000004e-05 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.569036+0000", 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012695299999999999 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.569250+0000", 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021431400000000001 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570327+0000", 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001077459 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570892+0000", 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00056503 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570946+0000", 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3494e-05 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.571017+0000", 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0693999999999998e-05 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop_reply(client.4367.0:25 3.a e25/22 ondisk, result = 0)", 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:50.570769+0000", 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.4142450339999999, 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00025351699999999998, 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570769+0000", 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570769+0000", 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570771+0000", 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570778+0000", 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7659999999999998e-06 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570800+0000", 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2019999999999999e-05 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570812+0000", 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1929999999999999e-05 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570879+0000", 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6519999999999993e-05 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.570887+0000", 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7959999999999996e-06 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:50.571023+0000", 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000136188 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.036 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.036 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.036 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.036 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:54.037 INFO:teuthology.orchestra.run.smithi018.stdout:65 write 0x4948adb thru 0x4955b94 (0xd0ba bytes) 2024-09-22T01:34:54.037 INFO:teuthology.orchestra.run.smithi018.stdout:66 write 0xaaa2922 thru 0xaab0011 (0xd6f0 bytes) 2024-09-22T01:34:54.037 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:34:54.038 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:54.035+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:54.041 INFO:teuthology.orchestra.run.smithi018.stdout:truncating to largest ever: 0xb11ba59 2024-09-22T01:34:54.051 INFO:teuthology.orchestra.run.smithi018.stdout:68 trunc from 0xe9957fe to 0xb11ba59 2024-09-22T01:34:54.076 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.076 INFO:teuthology.orchestra.run.smithi018.stdout:70 read 0xaf19622 thru 0xaf23408 (0x9de7 bytes) 2024-09-22T01:34:54.076 INFO:teuthology.orchestra.run.smithi018.stdout:71 punch from 0x5c1a778 to 0x5c1c6e8, (0x1f70 bytes) 2024-09-22T01:34:54.077 INFO:teuthology.orchestra.run.smithi018.stdout:72 writesame 0x84bc96 thru 0x859480 data_size 0x4b(0xd7eb bytes) 2024-09-22T01:34:54.080 INFO:teuthology.orchestra.run.smithi018.stdout:73 writesame 0x6fd8044 thru 0x6fdc8ab data_size 0x1c(0x4868 bytes) 2024-09-22T01:34:54.084 INFO:teuthology.orchestra.run.smithi018.stdout:74 write 0x7983aa1 thru 0x7991940 (0xdea0 bytes) 2024-09-22T01:34:54.118 INFO:teuthology.orchestra.run.smithi018.stdout:75 trunc from 0xb11ba59 to 0x429c78 2024-09-22T01:34:54.138 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:54.134+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:54.148 INFO:teuthology.orchestra.run.smithi018.stdout:77 punch from 0x164937 to 0x170f42, (0xc60b bytes) 2024-09-22T01:34:54.148 INFO:teuthology.orchestra.run.smithi018.stdout:78 read 0x2c85c8 thru 0x2ce110 (0x5b49 bytes) 2024-09-22T01:34:54.179 INFO:teuthology.orchestra.run.smithi018.stdout:79 write 0x5ed8c36 thru 0x5edf3eb (0x67b6 bytes) 2024-09-22T01:34:54.185 INFO:teuthology.orchestra.run.smithi018.stdout:80 read 0x3569f4e thru 0x356c000 (0x20b3 bytes) 2024-09-22T01:34:54.186 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.186 INFO:teuthology.orchestra.run.smithi018.stdout:83 read 0x894e50 thru 0x89862d (0x37de bytes) 2024-09-22T01:34:54.187 INFO:teuthology.orchestra.run.smithi018.stdout:85 punch from 0x49b7d0b to 0x49ba093, (0x2388 bytes) 2024-09-22T01:34:54.187 INFO:teuthology.orchestra.run.smithi018.stdout:86 read 0x12041b9 thru 0x1209f64 (0x5dac bytes) 2024-09-22T01:34:54.188 INFO:teuthology.orchestra.run.smithi018.stdout:87 write 0x37eb6c9 thru 0x37fb197 (0xfacf bytes) 2024-09-22T01:34:54.209 INFO:teuthology.orchestra.run.smithi018.stdout:88 writesame 0x74dfe83 thru 0x74ec8eb data_size 0x1(0xca69 bytes) 2024-09-22T01:34:54.209 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.209 INFO:teuthology.orchestra.run.smithi018.stdout:91 read 0x159966f thru 0x159a60b (0xf9d bytes) 2024-09-22T01:34:54.210 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.217 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:54.217 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:34:54.217 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:34:54.217 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:54.229 INFO:teuthology.orchestra.run.smithi018.stdout:98 write 0x98f830f thru 0x9904bb5 (0xc8a7 bytes) 2024-09-22T01:34:54.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:34:54.238 INFO:teuthology.orchestra.run.smithi018.stdout:100 read 0x332fc44 thru 0x3339d76 (0xa133 bytes) 2024-09-22T01:34:54.239 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.239 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.241 INFO:teuthology.orchestra.run.smithi018.stdout:104 trunc from 0x9904bb6 to 0xa3154f5 2024-09-22T01:34:54.253 INFO:teuthology.orchestra.run.smithi018.stdout:105 write 0x9ddead2 thru 0x9de67eb (0x7d1a bytes) 2024-09-22T01:34:54.263 INFO:teuthology.orchestra.run.smithi018.stdout:106 read 0x7d00ebd thru 0x7d042b5 (0x33f9 bytes) 2024-09-22T01:34:54.280 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:54.278+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:54.283 INFO:teuthology.orchestra.run.smithi018.stdout:107 write 0xcd7e704 thru 0xcd7fb4e (0x144b bytes) 2024-09-22T01:34:54.289 INFO:teuthology.orchestra.run.smithi018.stdout:108 punch from 0x341c053 to 0x3423f37, (0x7ee4 bytes) 2024-09-22T01:34:54.289 INFO:teuthology.orchestra.run.smithi018.stdout:109 writesame 0x6ff0321 thru 0x6ff4c8e data_size 0x27(0x496e bytes) 2024-09-22T01:34:54.322 INFO:teuthology.orchestra.run.smithi018.stdout:110 trunc from 0xcd7fb4f to 0x386a0cf 2024-09-22T01:34:54.339 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:54.334+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:54.351 INFO:teuthology.orchestra.run.smithi018.stdout:111 writesame 0x111e989 thru 0x1123b87 data_size 0x1(0x51ff bytes) 2024-09-22T01:34:54.373 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.373 INFO:teuthology.orchestra.run.smithi018.stdout:113 read 0x137f79f thru 0x138d369 (0xdbcb bytes) 2024-09-22T01:34:54.402 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:54.402 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:34:54.403 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:34:54.403 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:34:54.403 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:54.405 INFO:teuthology.orchestra.run.smithi018.stdout:114 write 0xa21f74b thru 0xa225716 (0x5fcc bytes) 2024-09-22T01:34:54.414 INFO:teuthology.orchestra.run.smithi018.stdout:115 write 0x95f693b thru 0x95fb40e (0x4ad4 bytes) 2024-09-22T01:34:54.417 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:34:54.422 INFO:teuthology.orchestra.run.smithi018.stdout:truncating to largest ever: 0xed8bf6f 2024-09-22T01:34:54.433 INFO:teuthology.orchestra.run.smithi018.stdout:116 trunc from 0xa225717 to 0xed8bf6f 2024-09-22T01:34:54.447 INFO:teuthology.orchestra.run.smithi018.stdout:118 write 0x4d7edc7 thru 0x4d8b91a (0xcb54 bytes) 2024-09-22T01:34:54.456 INFO:teuthology.orchestra.run.smithi018.stdout:119 write 0x1d4ce0b thru 0x1d509b6 (0x3bac bytes) 2024-09-22T01:34:54.460 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:54.458+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:54.482 INFO:teuthology.orchestra.run.smithi018.stdout:120 trunc from 0xed8bf6f to 0x614cecf 2024-09-22T01:34:54.510 INFO:teuthology.orchestra.run.smithi018.stdout:123 read 0x2be52ba thru 0x2bf41ce (0xef15 bytes) 2024-09-22T01:34:54.512 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.528 INFO:teuthology.orchestra.run.smithi018.stdout:126 write 0x7d9067c thru 0x7d9d476 (0xcdfb bytes) 2024-09-22T01:34:54.541 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:54.539+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:54.555 INFO:teuthology.orchestra.run.smithi018.stdout:128 trunc from 0x7d9d477 to 0xc041e 2024-09-22T01:34:54.593 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:54.593 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 21.282102730999998, 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.594 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:34:54.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.212510+0000", 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.378631589000001, 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011227233, 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 37 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212510+0000", 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212510+0000", 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212511+0000", 2024-09-22T01:34:54.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3799999999999997e-07 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212517+0000", 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.934e-06 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212536+0000", 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8563000000000002e-05 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212548+0000", 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1471000000000001e-05 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.221623+0000", 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0090758760000000001 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.221758+0000", 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013510900000000001 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.221953+0000", 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019497199999999999 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.222951+0000", 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00099787899999999991 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.223595+0000", 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00064393499999999999 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.223678+0000", 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3053000000000006e-05 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.223737+0000", 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8903000000000002e-05 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:54.605 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.310510+0000", 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.28063139, 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010601688999999999, 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 87 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310510+0000", 2024-09-22T01:34:54.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310510+0000", 2024-09-22T01:34:54.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310512+0000", 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.347e-06 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310672+0000", 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016020499999999999 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310696+0000", 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4669999999999999e-05 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310714+0000", 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7827000000000001e-05 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.317310+0000", 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0065959859999999999 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.317522+0000", 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021203199999999999 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.317772+0000", 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000249638 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.320432+0000", 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0026597819999999999 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.320958+0000", 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00052596999999999995 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321047+0000", 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9191999999999996e-05 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321112+0000", 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5040000000000001e-05 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.310753+0000", 2024-09-22T01:34:54.611 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.280388990999999, 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011208645999999999, 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 88 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310753+0000", 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310753+0000", 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310754+0000", 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.443e-06 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310766+0000", 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.203e-05 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310818+0000", 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1502999999999998e-05 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310835+0000", 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.702e-05 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.319339+0000", 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0085041579999999995 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.319445+0000", 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000105766 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.319633+0000", 2024-09-22T01:34:54.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018881400000000001 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.320882+0000", 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001249144 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321825+0000", 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00094259300000000003 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321902+0000", 2024-09-22T01:34:54.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6969000000000001e-05 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321961+0000", 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9206000000000002e-05 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.101637143000001, 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014449178, 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.617 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489506+0000", 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6700000000000001e-06 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489518+0000", 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2323e-05 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489537+0000", 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8960000000000001e-05 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489551+0000", 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3243e-05 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497558+0000", 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0080073049999999993 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497686+0000", 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012775899999999999 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497883+0000", 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000197622 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500679+0000", 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002795708 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503694+0000", 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030148739999999999 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503838+0000", 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014412499999999999 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503954+0000", 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011558899999999999 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.101528834, 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014775508999999999, 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111 2024-09-22T01:34:54.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489614+0000", 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6360000000000001e-06 2024-09-22T01:34:54.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489627+0000", 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2493999999999999e-05 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489656+0000", 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8770000000000001e-05 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489671+0000", 2024-09-22T01:34:54.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4866e-05 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499567+0000", 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0098963839999999994 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499697+0000", 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000130106 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499889+0000", 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019192499999999999 2024-09-22T01:34:54.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504109+0000", 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0042195770000000004 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504146+0000", 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7639999999999999e-05 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504270+0000", 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123409 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504388+0000", 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000118702 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.101443128, 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.019730597999999998, 2024-09-22T01:34:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 112 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489700+0000", 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.26e-06 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489899+0000", 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000199672 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489924+0000", 2024-09-22T01:34:54.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4136000000000001e-05 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489939+0000", 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5457000000000001e-05 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500788+0000", 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010848806000000001 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500909+0000", 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000121322 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.501195+0000", 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028595500000000001 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504533+0000", 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0033380369999999999 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509171+0000", 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0046382649999999999 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509312+0000", 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014064200000000001 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509429+0000", 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117046 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.633 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.101172912999999, 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.021089374000000001, 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 113 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.634 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489970+0000", 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.426e-06 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489982+0000", 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1547e-05 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490011+0000", 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9119e-05 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490024+0000", 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3667e-05 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.636 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502168+0000", 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012143693000000001 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502411+0000", 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024248499999999999 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502788+0000", 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00037754100000000001 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504678+0000", 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0018899450000000001 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510804+0000", 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.006125836 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510947+0000", 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142712 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.638 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511058+0000", 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111403 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.101087723999999, 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.021258902999999999, 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.639 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 114 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490055+0000", 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:34:54.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490066+0000", 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.097e-05 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490097+0000", 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0470000000000001e-05 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490112+0000", 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5213e-05 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504774+0000", 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014662669999999999 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504905+0000", 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013048500000000001 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.505109+0000", 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000204539 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.642 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509133+0000", 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.004023403 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511078+0000", 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0019454749999999999 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511196+0000", 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011812200000000001 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511313+0000", 2024-09-22T01:34:54.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000116286 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.100994114999999, 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.022115017000000001, 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 115 2024-09-22T01:34:54.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490149+0000", 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3769999999999999e-06 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490346+0000", 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019744200000000001 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490363+0000", 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6973000000000002e-05 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490374+0000", 2024-09-22T01:34:54.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.06e-05 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.505802+0000", 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015427946999999999 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.506040+0000", 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023778199999999999 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.506469+0000", 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042951300000000002 2024-09-22T01:34:54.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509495+0000", 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030255199999999999 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512030+0000", 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025350049999999999 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512162+0000", 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013271800000000001 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512262+0000", 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010014 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.100746350000001, 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.02212739, 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.649 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 116 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490396+0000", 2024-09-22T01:34:54.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0160000000000001e-06 2024-09-22T01:34:54.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490404+0000", 2024-09-22T01:34:54.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7039999999999994e-06 2024-09-22T01:34:54.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490417+0000", 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.341e-05 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490425+0000", 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0160000000000008e-06 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.507941+0000", 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.017515414999999999 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.508122+0000", 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000181452 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.508335+0000", 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021324199999999999 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511427+0000", 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030917090000000002 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512288+0000", 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00086098100000000003 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512420+0000", 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013192499999999999 2024-09-22T01:34:54.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512523+0000", 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010252 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 20.100702800000001, 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.022626255000000001, 2024-09-22T01:34:54.655 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 117 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490440+0000", 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.1600000000000001e-07 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490448+0000", 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0339999999999997e-06 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490486+0000", 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8065999999999998e-05 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490500+0000", 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4583000000000001e-05 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509568+0000", 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.019067589999999999 2024-09-22T01:34:54.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509809+0000", 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000240738 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510189+0000", 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000380281 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511540+0000", 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013514759999999999 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512847+0000", 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013063860000000001 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512970+0000", 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123106 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.513065+0000", 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5278999999999994e-05 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005421+0000", 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 19.585720329000001, 2024-09-22T01:34:54.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012578448000000001, 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 136 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005421+0000", 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005421+0000", 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005422+0000", 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4099999999999999e-07 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005427+0000", 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8879999999999996e-06 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005437+0000", 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0196e-05 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005442+0000", 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4260000000000002e-06 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.013089+0000", 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.007646506 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.013263+0000", 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174375 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.013516+0000", 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00025259099999999998 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016006+0000", 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024905510000000001 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017939+0000", 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0019327459999999999 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017973+0000", 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4337e-05 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018000+0000", 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6291e-05 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.666 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005489+0000", 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 19.585652261, 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012782085, 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 137 2024-09-22T01:34:54.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005489+0000", 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005489+0000", 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005490+0000", 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.27e-07 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005552+0000", 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2180000000000004e-05 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005565+0000", 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2928999999999999e-05 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005572+0000", 2024-09-22T01:34:54.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2019999999999998e-06 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.014223+0000", 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0086508520000000005 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.014332+0000", 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000108999 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.014530+0000", 2024-09-22T01:34:54.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000198557 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017893+0000", 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00336266 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018098+0000", 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000204601 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018207+0000", 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109242 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018271+0000", 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4436000000000004e-05 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 19.585536017999999, 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014112458, 2024-09-22T01:34:54.672 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 138 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4099999999999998e-07 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005612+0000", 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4700000000000001e-06 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005622+0000", 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0593e-05 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005627+0000", 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2560000000000004e-06 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016043+0000", 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010416383 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016182+0000", 2024-09-22T01:34:54.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013903200000000001 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016412+0000", 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023044499999999999 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019539+0000", 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031267230000000001 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019564+0000", 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5245999999999999e-05 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019651+0000", 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6782999999999999e-05 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019718+0000", 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6785999999999994e-05 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.677 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 19.585503295999999, 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014654660999999999, 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 139 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.678 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005639+0000", 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8200000000000001e-07 2024-09-22T01:34:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005642+0000", 2024-09-22T01:34:54.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3330000000000001e-06 2024-09-22T01:34:54.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005649+0000", 2024-09-22T01:34:54.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7279999999999998e-06 2024-09-22T01:34:54.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005654+0000", 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5790000000000003e-06 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017113+0000", 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011458822 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017220+0000", 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000107354 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017393+0000", 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017226700000000001 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019736+0000", 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0023427639999999998 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020234+0000", 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000498856 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020267+0000", 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2160999999999999e-05 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020293+0000", 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6415e-05 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 19.585391436999998, 2024-09-22T01:34:54.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015246857000000001, 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 140 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005751+0000", 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.34e-07 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005811+0000", 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9935999999999997e-05 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005821+0000", 2024-09-22T01:34:54.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0617e-05 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005825+0000", 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0090000000000001e-06 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018312+0000", 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012486919000000001 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018371+0000", 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8548000000000003e-05 2024-09-22T01:34:54.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018462+0000", 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1254000000000004e-05 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019978+0000", 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0015163010000000001 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020947+0000", 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00096895599999999998 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020976+0000", 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8731999999999999e-05 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020997+0000", 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1151000000000001e-05 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 19.585294445999999, 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015779920999999999, 2024-09-22T01:34:54.688 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 141 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005848+0000", 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1800000000000001e-07 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005851+0000", 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.878e-06 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005874+0000", 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3014e-05 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005882+0000", 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019064+0000", 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.013182268 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019124+0000", 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9358000000000003e-05 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019202+0000", 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7906999999999998e-05 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020379+0000", 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0011774940000000001 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021577+0000", 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0011975759999999999 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021605+0000", 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7968000000000001e-05 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021627+0000", 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2480000000000002e-05 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.693 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.850350881000001, 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010640472999999999, 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 158 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8000000000000005e-07 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740917+0000", 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012581499999999999 2024-09-22T01:34:54.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740938+0000", 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0574e-05 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740950+0000", 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1779e-05 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.747810+0000", 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0068605430000000002 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.748039+0000", 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022844200000000001 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.748307+0000", 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000268375 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751089+0000", 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0027817749999999998 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751220+0000", 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013090899999999999 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751359+0000", 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013917199999999999 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751431+0000", 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2309000000000002e-05 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.740966+0000", 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.850175103000002, 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012971455999999999, 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 159 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740966+0000", 2024-09-22T01:34:54.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740966+0000", 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740967+0000", 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7000000000000004e-07 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740974+0000", 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6969999999999996e-06 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740985+0000", 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0723000000000001e-05 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740992+0000", 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4359999999999996e-06 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.749836+0000", 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0088437719999999997 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.749966+0000", 2024-09-22T01:34:54.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013021899999999999 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.750165+0000", 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019899800000000001 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751512+0000", 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013465969999999999 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.753769+0000", 2024-09-22T01:34:54.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0022572590000000002 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.753840+0000", 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0660000000000004e-05 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.753938+0000", 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8325000000000005e-05 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:54.703 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:54.705 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:54.702+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:54.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:34:54.706 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.706 INFO:teuthology.orchestra.run.smithi018.stdout:131 write 0x6831bb4 thru 0x683c73f (0xab8c bytes) 2024-09-22T01:34:54.706 INFO:teuthology.orchestra.run.smithi018.stdout:132 punch from 0x5ad28a1 to 0x5ad5c23, (0x3382 bytes) 2024-09-22T01:34:54.706 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.706 INFO:teuthology.orchestra.run.smithi018.stdout:135 writesame 0xc00bb73 thru 0xc01a73a data_size 0x14(0xebc8 bytes) 2024-09-22T01:34:54.706 INFO:teuthology.orchestra.run.smithi018.stdout:136 read 0x1d0590f thru 0x1d111ba (0xb8ac bytes) 2024-09-22T01:34:54.706 INFO:teuthology.orchestra.run.smithi018.stdout:137 write 0xe536d92 thru 0xe53ade8 (0x4057 bytes) 2024-09-22T01:34:54.706 INFO:teuthology.orchestra.run.smithi018.stdout:139 writesame 0x364daf6 thru 0x3658233 data_size 0x1(0xa73e bytes) 2024-09-22T01:34:54.754 INFO:teuthology.orchestra.run.smithi018.stdout:140 writesame 0xb6fc73 thru 0xb72400 data_size 0x3d(0x278e bytes) 2024-09-22T01:34:54.757 INFO:teuthology.orchestra.run.smithi018.stdout:141 write 0x28d6d5d thru 0x28dd09d (0x6341 bytes) 2024-09-22T01:34:54.760 INFO:teuthology.orchestra.run.smithi018.stdout:142 punch from 0x42facec to 0x4302480, (0x7794 bytes) 2024-09-22T01:34:54.760 INFO:teuthology.orchestra.run.smithi018.stdout:145 read 0x5ad1c06 thru 0x5adb763 (0x9b5e bytes) 2024-09-22T01:34:54.782 INFO:teuthology.orchestra.run.smithi018.stdout:146 trunc from 0xe53ade9 to 0x3c07618 2024-09-22T01:34:54.806 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:54.803+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:54.810 INFO:teuthology.orchestra.run.smithi018.stdout:147 write 0x5f6c30 thru 0x6052b3 (0xe684 bytes) 2024-09-22T01:34:54.814 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.814 INFO:teuthology.orchestra.run.smithi018.stdout:150 write 0x36d6aba thru 0x36d9312 (0x2859 bytes) 2024-09-22T01:34:54.818 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.818 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.832 INFO:teuthology.orchestra.run.smithi018.stdout:153 trunc from 0x3c07618 to 0xc31be39 2024-09-22T01:34:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:154 punch from 0x35e46b9 to 0x35f2dd5, (0xe71c bytes) 2024-09-22T01:34:54.846 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:54.862 INFO:teuthology.orchestra.run.smithi018.stdout:157 trunc from 0xc31be39 to 0x1fdf6a1 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:646 3.1b 3.7dd2b3db (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.879877+0000", 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.4147000000000003e-05, 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105689, 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "queued for pg", 2024-09-22T01:34:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 646 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.879877+0000", 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.879877+0000", 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.879879+0000", 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9970000000000001e-06 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.879889+0000", 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8369999999999992e-06 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.879917+0000", 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8116e-05 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.879932+0000", 2024-09-22T01:34:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5e-05 2024-09-22T01:34:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:34:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 1 2024-09-22T01:34:54.882 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:54.906 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:54.907+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:54.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:34:54.911 INFO:teuthology.orchestra.run.smithi018.stdout:158 writesame 0xb324285 thru 0xb333a1f data_size 0x3(0xf79b bytes) 2024-09-22T01:34:54.927 INFO:teuthology.orchestra.run.smithi018.stdout:160 trunc from 0xb333a20 to 0xe1860 2024-09-22T01:34:54.965 INFO:teuthology.orchestra.run.smithi018.stdout:161 write 0x4bbb66f thru 0x4bca8da (0xf26c bytes) 2024-09-22T01:34:54.979 INFO:teuthology.orchestra.run.smithi018.stdout:163 trunc from 0x4bca8db to 0xaab278 2024-09-22T01:34:55.001 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:55.008 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:55.002+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:55.031 INFO:teuthology.orchestra.run.smithi018.stdout:165 write 0xcaa178b thru 0xcaaefcb (0xd841 bytes) 2024-09-22T01:34:55.038 INFO:teuthology.orchestra.run.smithi018.stdout:166 read 0x5e65308 thru 0x5e69fc4 (0x4cbd bytes) 2024-09-22T01:34:55.038 INFO:teuthology.orchestra.run.smithi018.stdout:168 punch from 0x4dae200 to 0x4dae6c2, (0x4c2 bytes) 2024-09-22T01:34:55.038 INFO:teuthology.orchestra.run.smithi018.stdout:169 writesame 0x2427ee8 thru 0x2432df3 data_size 0x4(0xaf0c bytes) 2024-09-22T01:34:55.042 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:55.042 INFO:teuthology.orchestra.run.smithi018.stdout:172 read 0x135c420 thru 0x13614be (0x509f bytes) 2024-09-22T01:34:55.043 INFO:teuthology.orchestra.run.smithi018.stdout:173 read 0xada13de thru 0xadaadf7 (0x9a1a bytes) 2024-09-22T01:34:55.043 INFO:teuthology.orchestra.run.smithi018.stdout:174 read 0x9cf1827 thru 0x9cfd4f3 (0xbccd bytes) 2024-09-22T01:34:55.043 INFO:teuthology.orchestra.run.smithi018.stdout:175 punch from 0xc78b0f4 to 0xc79117b, (0x6087 bytes) 2024-09-22T01:34:55.043 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:55.054 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:55.054 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:55.055 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:34:55.055 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:34:55.055 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:55.055 INFO:teuthology.orchestra.run.smithi018.stdout:177 trunc from 0xcaaefcc to 0x5b1c3ad 2024-09-22T01:34:55.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:34:55.079 INFO:teuthology.orchestra.run.smithi018.stdout:178 trunc from 0x5b1c3ad to 0x6613370 2024-09-22T01:34:55.090 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:55.090 INFO:teuthology.orchestra.run.smithi018.stdout:181 read 0x4240581 thru 0x4242e86 (0x2906 bytes) 2024-09-22T01:34:55.090 INFO:teuthology.orchestra.run.smithi018.stdout:184 read 0x5d76f78 thru 0x5d7dcde (0x6d67 bytes) 2024-09-22T01:34:55.090 INFO:teuthology.orchestra.run.smithi018.stdout:185 read 0x5dce20 thru 0x5ea16e (0xd34f bytes) 2024-09-22T01:34:55.091 INFO:teuthology.orchestra.run.smithi018.stdout:188 punch from 0x3178cc5 to 0x317d191, (0x44cc bytes) 2024-09-22T01:34:55.091 INFO:teuthology.orchestra.run.smithi018.stdout:189 read 0x4373966 thru 0x43770ec (0x3787 bytes) 2024-09-22T01:34:55.108 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:55.106+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:55.111 INFO:teuthology.orchestra.run.smithi018.stdout:192 write 0xc1ff3ad thru 0xc2096ec (0xa340 bytes) 2024-09-22T01:34:55.118 INFO:teuthology.orchestra.run.smithi018.stdout:195 writesame 0xbd1c79f thru 0xbd21b79 data_size 0x1(0x53db bytes) 2024-09-22T01:34:55.133 INFO:teuthology.orchestra.run.smithi018.stdout:196 writesame 0x227d3ee thru 0x228c3ec data_size 0x43(0xefff bytes) 2024-09-22T01:34:55.136 INFO:teuthology.orchestra.run.smithi018.stdout:197 punch from 0xab47361 to 0xab522cc, (0xaf6b bytes) 2024-09-22T01:34:55.136 INFO:teuthology.orchestra.run.smithi018.stdout:199 write 0x1a2f46c thru 0x1a3a67e (0xb213 bytes) 2024-09-22T01:34:55.139 INFO:teuthology.orchestra.run.smithi018.stdout:203 read 0x1ed8c15 thru 0x1edca3b (0x3e27 bytes) 2024-09-22T01:34:55.139 INFO:teuthology.orchestra.run.smithi018.stdout:204 read 0x67fc0d6 thru 0x6801200 (0x512b bytes) 2024-09-22T01:34:55.139 INFO:teuthology.orchestra.run.smithi018.stdout:205 write 0x608fe5 thru 0x610d6d (0x7d89 bytes) 2024-09-22T01:34:55.142 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:55.142 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:55.155 INFO:teuthology.orchestra.run.smithi018.stdout:209 trunc from 0xc2096ed to 0x6a4437f 2024-09-22T01:34:55.188 INFO:teuthology.orchestra.run.smithi018.stdout:213 write 0xa449edc thru 0xa44acc8 (0xded bytes) 2024-09-22T01:34:55.193 INFO:teuthology.orchestra.run.smithi018.stdout:214 punch from 0x472dfbc to 0x473223e, (0x4282 bytes) 2024-09-22T01:34:55.193 INFO:teuthology.orchestra.run.smithi018.stdout:215 write 0x6dd8e03 thru 0x6de898f (0xfb8d bytes) 2024-09-22T01:34:55.200 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:55.209 INFO:teuthology.orchestra.run.smithi018.stdout:219 trunc from 0xa44acc9 to 0xe94a8cc 2024-09-22T01:34:55.209 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:55.207+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:55.219 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:55.223 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:34:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:34:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:34:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:50.542145+0000", 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.6787411759999999, 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047856670000000004, 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542145+0000", 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542145+0000", 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542147+0000", 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3970000000000001e-06 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542160+0000", 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2788e-05 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542184+0000", 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3672e-05 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542197+0000", 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3746e-05 2024-09-22T01:34:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542292+0000", 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4823999999999999e-05 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542303+0000", 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0648e-05 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.544487+0000", 2024-09-22T01:34:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021844970000000001 2024-09-22T01:34:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.544585+0000", 2024-09-22T01:34:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7621999999999995e-05 2024-09-22T01:34:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5", 2024-09-22T01:34:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.544740+0000", 2024-09-22T01:34:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155076 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.545896+0000", 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011557780000000001 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.546824+0000", 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092794800000000005 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.546887+0000", 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2921000000000003e-05 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.546930+0000", 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.375e-05 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:425 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.230653+0000", 2024-09-22T01:34:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.99023262999999995, 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045298389999999999, 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 425 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230653+0000", 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230653+0000", 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230655+0000", 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.657e-06 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230664+0000", 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3530000000000001e-06 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230690+0000", 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5380000000000001e-05 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230709+0000", 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9415999999999998e-05 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230808+0000", 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9146000000000002e-05 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230950+0000", 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000141402 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.231559+0000", 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060917899999999995 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.234911+0000", 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033518480000000002 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.235013+0000", 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000102019 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.235110+0000", 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6966000000000006e-05 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.235183+0000", 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3473000000000006e-05 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:426 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.230764+0000", 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.99012233999999999, 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056485270000000004, 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 426 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230764+0000", 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230764+0000", 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230765+0000", 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0160000000000001e-06 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230771+0000", 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2999999999999998e-06 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230785+0000", 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4430000000000001e-05 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230795+0000", 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2529999999999993e-06 2024-09-22T01:34:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.232388+0000", 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015937779999999999 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.232686+0000", 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029723100000000001 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.233838+0000", 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001152754 2024-09-22T01:34:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.235585+0000", 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017462840000000001 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.236106+0000", 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00052182900000000002 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.236270+0000", 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016395599999999999 2024-09-22T01:34:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.236412+0000", 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014169599999999999 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:440 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.255362+0000", 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.96552417700000004, 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060629999999999998, 2024-09-22T01:34:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 440 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255362+0000", 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255362+0000", 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255364+0000", 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.843e-06 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255374+0000", 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0814e-05 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255399+0000", 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4306000000000001e-05 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255415+0000", 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6137000000000002e-05 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.256998+0000", 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015827009999999999 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.257149+0000", 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151695 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.257699+0000", 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00055019300000000004 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259385+0000", 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001685897 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.261136+0000", 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001750653 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.261303+0000", 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016701800000000001 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.261425+0000", 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121743 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:463 3.1 3:8736d36c:::rbd_data.110fc6985e86.000000000000001a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328292+0000", 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.89259370299999996, 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048201930000000004, 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 463 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328292+0000", 2024-09-22T01:34:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328292+0000", 2024-09-22T01:34:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328303+0000", 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0672999999999999e-05 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328315+0000", 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1703e-05 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328348+0000", 2024-09-22T01:34:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3303000000000003e-05 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328367+0000", 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8862999999999999e-05 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328554+0000", 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018755900000000001 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328780+0000", 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000225975 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329110+0000", 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032994399999999998 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330916+0000", 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001805706 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332952+0000", 2024-09-22T01:34:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020358379999999999 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333042+0000", 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0202000000000001e-05 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333112+0000", 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0426999999999995e-05 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:483 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.352981+0000", 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.86790536399999996, 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007806431, 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 483 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352981+0000", 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352981+0000", 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352983+0000", 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.497e-06 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352997+0000", 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3566e-05 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353034+0000", 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7799999999999997e-05 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353056+0000", 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1399999999999998e-05 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353192+0000", 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013588900000000001 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353336+0000", 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144196 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.354694+0000", 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013579690000000001 2024-09-22T01:34:55.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360544+0000", 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058505720000000001 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360586+0000", 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1465999999999999e-05 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360706+0000", 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119943 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360787+0000", 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1132999999999997e-05 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:496 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.406637+0000", 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.81424917100000005, 2024-09-22T01:34:55.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046489770000000003, 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 496 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406637+0000", 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406637+0000", 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406638+0000", 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.623e-06 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406648+0000", 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4669999999999993e-06 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406673+0000", 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5289000000000001e-05 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406686+0000", 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2524000000000001e-05 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406788+0000", 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000102569 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406921+0000", 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133122 2024-09-22T01:34:55.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.407500+0000", 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057851599999999995 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.410876+0000", 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033764469999999999 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.410993+0000", 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116939 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411159+0000", 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016544500000000001 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411286+0000", 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012703599999999999 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:497 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.406742+0000", 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.81414402500000005, 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049671139999999999, 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 497 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406742+0000", 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406742+0000", 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406743+0000", 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5000000000000001e-07 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406751+0000", 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7499999999999992e-06 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406766+0000", 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4873e-05 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406775+0000", 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.67e-06 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.408238+0000", 2024-09-22T01:34:55.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001462655 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.408499+0000", 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026130800000000003 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.409766+0000", 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001267333 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411544+0000", 2024-09-22T01:34:55.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017775829999999999 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411562+0000", 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8513e-05 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411643+0000", 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.072e-05 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411709+0000", 2024-09-22T01:34:55.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5858999999999994e-05 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:511 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.449203+0000", 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.77168324300000002, 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048177960000000001, 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 511 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449203+0000", 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449203+0000", 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449205+0000", 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449215+0000", 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0699999999999999e-05 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449249+0000", 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3283e-05 2024-09-22T01:34:55.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449264+0000", 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5387e-05 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449398+0000", 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000134375 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449652+0000", 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025375099999999998 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.450787+0000", 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011352389999999999 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.453594+0000", 2024-09-22T01:34:55.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002806364 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.453720+0000", 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012596600000000001 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.453896+0000", 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017638500000000001 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454020+0000", 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012431599999999999 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:512 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.449299+0000", 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.77158658099999999, 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0053673690000000003, 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 512 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449299+0000", 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449299+0000", 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449300+0000", 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4399999999999999e-07 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449306+0000", 2024-09-22T01:34:55.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9200000000000001e-06 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449321+0000", 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4705999999999999e-05 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449329+0000", 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5040000000000002e-06 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.451885+0000", 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025560230000000001 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.452073+0000", 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000187419 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.452778+0000", 2024-09-22T01:34:55.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00070554400000000001 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454298+0000", 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001519255 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454404+0000", 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106473 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454547+0000", 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000143215 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454667+0000", 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119466 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.281 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:550 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,truncate 131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.568697+0000", 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.65218898800000003, 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052286390000000002, 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 550 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568697+0000", 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568697+0000", 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568699+0000", 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.626e-06 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568723+0000", 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4054e-05 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568748+0000", 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5299e-05 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568768+0000", 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9936999999999999e-05 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568929+0000", 2024-09-22T01:34:55.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000161008 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569147+0000", 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021770599999999999 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569504+0000", 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035783700000000001 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.571201+0000", 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001696393 2024-09-22T01:34:55.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573658+0000", 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024571039999999999 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573797+0000", 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872600000000001 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573926+0000", 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128949 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.286 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:556 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.569109+0000", 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.651776735, 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072176740000000003, 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 556 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569109+0000", 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569109+0000", 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569112+0000", 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0170000000000001e-06 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569128+0000", 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6047000000000001e-05 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569162+0000", 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4199000000000002e-05 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569184+0000", 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1206e-05 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569367+0000", 2024-09-22T01:34:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182969 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569967+0000", 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060015899999999996 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.571991+0000", 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020240810000000001 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573950+0000", 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019593240000000001 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.576117+0000", 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021672200000000001 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.576256+0000", 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000138269 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.576327+0000", 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1182999999999999e-05 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:557 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.569250+0000", 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.65163640599999995, 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096288420000000003, 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 557 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569250+0000", 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569250+0000", 2024-09-22T01:34:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569251+0000", 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5e-06 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569261+0000", 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7929999999999992e-06 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569290+0000", 2024-09-22T01:34:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8912999999999999e-05 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569310+0000", 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0403000000000001e-05 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.572853+0000", 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035429369999999999 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.572942+0000", 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8760999999999999e-05 2024-09-22T01:34:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573389+0000", 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044766100000000002 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.574748+0000", 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013586760000000001 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.578712+0000", 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039640889999999996 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.578810+0000", 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8208999999999994e-05 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.578878+0000", 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7899999999999997e-05 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:561 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.582156+0000", 2024-09-22T01:34:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.638730146, 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054648179999999998, 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 561 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582156+0000", 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582156+0000", 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582158+0000", 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3070000000000001e-06 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582172+0000", 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3876999999999999e-05 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582203+0000", 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1306000000000001e-05 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582229+0000", 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5908999999999999e-05 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.583548+0000", 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013188640000000001 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.583719+0000", 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171199 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.584398+0000", 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000679081 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.586079+0000", 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001680604 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.587393+0000", 2024-09-22T01:34:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013142589999999999 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.587494+0000", 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010071 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.587621+0000", 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012670199999999999 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:572 3.1b 3:dbcd4bbe:::rbd_header.110fc6985e86:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.622101+0000", 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.59878494699999996, 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00475874, 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 572 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622101+0000", 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622101+0000", 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622103+0000", 2024-09-22T01:34:55.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.77e-06 2024-09-22T01:34:55.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622113+0000", 2024-09-22T01:34:55.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0105999999999999e-05 2024-09-22T01:34:55.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622139+0000", 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6383000000000001e-05 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622153+0000", 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4123e-05 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622336+0000", 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018248599999999999 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622490+0000", 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015436200000000001 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622802+0000", 2024-09-22T01:34:55.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00031133099999999998 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.623912+0000", 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001110818 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.626698+0000", 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027852179999999999 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.626790+0000", 2024-09-22T01:34:55.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2916000000000003e-05 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.626860+0000", 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9227000000000007e-05 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:610 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,truncate 7077888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.795782+0000", 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.42510357100000001, 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0043867159999999997, 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 610 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795782+0000", 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795782+0000", 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795784+0000", 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0700000000000001e-06 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795795+0000", 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0806e-05 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795836+0000", 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0383000000000003e-05 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795858+0000", 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2039999999999999e-05 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.796044+0000", 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000186295 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.796272+0000", 2024-09-22T01:34:55.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022839 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.796638+0000", 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036562500000000001 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.797996+0000", 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013584669999999999 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.799866+0000", 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018693480000000001 2024-09-22T01:34:55.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.800046+0000", 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000179765 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.800169+0000", 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012352700000000001 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:638 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,truncate 3801088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.864722+0000", 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.35616378799999998, 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085411020000000001, 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 638 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864722+0000", 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864722+0000", 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864725+0000", 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0309999999999999e-06 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864740+0000", 2024-09-22T01:34:55.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.47e-05 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864788+0000", 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8457e-05 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864913+0000", 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012486999999999999 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865070+0000", 2024-09-22T01:34:55.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015637600000000001 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865284+0000", 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021468400000000001 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865628+0000", 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034399700000000002 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.867307+0000", 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016784059999999999 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.873152+0000", 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058457200000000004 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.873212+0000", 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9775999999999998e-05 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.873263+0000", 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1085000000000003e-05 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:670 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.937639+0000", 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.28324706799999999, 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051990609999999996, 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 670 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937639+0000", 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937639+0000", 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937640+0000", 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7199999999999997e-07 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937644+0000", 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.25e-06 2024-09-22T01:34:55.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937655+0000", 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1027e-05 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937660+0000", 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4450000000000004e-06 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937724+0000", 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3917999999999993e-05 2024-09-22T01:34:55.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937807+0000", 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2774000000000004e-05 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.938028+0000", 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000220404 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.938776+0000", 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00074844099999999997 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.942777+0000", 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040009909999999997 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.942810+0000", 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2880999999999999e-05 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.942838+0000", 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8058000000000001e-05 2024-09-22T01:34:55.325 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:722 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.038147+0000", 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.182739072, 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058652280000000001, 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.326 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 722 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038147+0000", 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038147+0000", 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038148+0000", 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0219999999999999e-06 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038153+0000", 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2109999999999997e-06 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038167+0000", 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.376e-05 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038174+0000", 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8170000000000001e-06 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038236+0000", 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1895000000000003e-05 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038298+0000", 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2860000000000005e-05 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.039389+0000", 2024-09-22T01:34:55.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010905629999999999 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.043894+0000", 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045046210000000003 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.043912+0000", 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8762000000000001e-05 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.043950+0000", 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7490000000000002e-05 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.044012+0000", 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2226999999999999e-05 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:764 3.6 3:6277f7f1:::rbd_data.110fc6985e86.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.124104+0000", 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.096782261999999994, 2024-09-22T01:34:55.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086580210000000001, 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 764 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124104+0000", 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124104+0000", 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124105+0000", 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.528e-06 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124113+0000", 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8050000000000007e-06 2024-09-22T01:34:55.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124129+0000", 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6364000000000001e-05 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124142+0000", 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2281e-05 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124227+0000", 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5395999999999994e-05 2024-09-22T01:34:55.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124339+0000", 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011228199999999999 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.125728+0000", 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013882810000000001 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132635+0000", 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006907219 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132654+0000", 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9347999999999998e-05 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132710+0000", 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5649000000000002e-05 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132762+0000", 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1867999999999999e-05 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.337 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.337 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:55.337 INFO:teuthology.orchestra.run.smithi018.stdout:221 trunc from 0xe94a8cc to 0x6eb65e9 2024-09-22T01:34:55.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:34:55.339 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:55.339 INFO:teuthology.orchestra.run.smithi018.stdout:224 trunc from 0x6eb65e9 to 0x2e22308 2024-09-22T01:34:55.339 INFO:teuthology.orchestra.run.smithi018.stdout:225 write 0x33de326 thru 0x33e7256 (0x8f31 bytes) 2024-09-22T01:34:55.340 INFO:teuthology.orchestra.run.smithi018.stdout:226 write 0x912ef3c thru 0x9132e99 (0x3f5e bytes) 2024-09-22T01:34:55.340 INFO:teuthology.orchestra.run.smithi018.stdout:227 punch from 0x7977b1b to 0x797b09e, (0x3583 bytes) 2024-09-22T01:34:55.340 INFO:teuthology.orchestra.run.smithi018.stdout:228 writesame 0xe5b603b thru 0xe5bd913 data_size 0x1(0x78d9 bytes) 2024-09-22T01:34:55.340 INFO:teuthology.orchestra.run.smithi018.stdout:229 write 0x128d525 thru 0x1296d13 (0x97ef bytes) 2024-09-22T01:34:55.340 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:55.334+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:55.342 INFO:teuthology.orchestra.run.smithi018.stdout:232 clone 2 order 25 su 16777216 sc 5 2024-09-22T01:34:55.439 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:55.434+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:55.462 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:55.463 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:55.463 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:34:55.463 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:55.477 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:34:55.539 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:55.534+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:55.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:34:55.641 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:55.638+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:55.655 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:55.655 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:55.655 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:34:55.655 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:34:55.655 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:55.672 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:34:55.679 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone1 from 0xe5bd914 (overlap 0xc041e) to 0x0 2024-09-22T01:34:55.741 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:55.739+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:34:55.760 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-22T01:34:55.825 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:34:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:34:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:34:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:265 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,truncate 1703936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.845035+0000", 2024-09-22T01:34:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.9775970549999999, 2024-09-22T01:34:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0026681529999999999, 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 265 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.845035+0000", 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.845035+0000", 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.845037+0000", 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6169999999999999e-06 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.845042+0000", 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4e-06 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.845057+0000", 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5141e-05 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.845066+0000", 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7569999999999993e-06 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.845140+0000", 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3714000000000006e-05 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.845229+0000", 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8716999999999998e-05 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.845365+0000", 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136811 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.846189+0000", 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00082346700000000004 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.847608+0000", 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014187679999999999 2024-09-22T01:34:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.847653+0000", 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5643000000000003e-05 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.847703+0000", 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0117999999999997e-05 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:314 3.19 3:9b96d891:::rbd_data.110fc6985e86.0000000000000008:head [stat,truncate 4286917] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.903722+0000", 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.9189104289999999, 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023202499999999998, 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 314 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.903722+0000", 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.903722+0000", 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.903723+0000", 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.903727+0000", 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.668e-06 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.903738+0000", 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1151999999999999e-05 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.903745+0000", 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0040000000000002e-06 2024-09-22T01:34:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.904417+0000", 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00067166999999999997 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.904541+0000", 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012400599999999999 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.904770+0000", 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000228528 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.905432+0000", 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00066212400000000005 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.905965+0000", 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00053366299999999998 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.906016+0000", 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0445999999999998e-05 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.906042+0000", 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6308999999999998e-05 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:374 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,truncate 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.130981+0000", 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.6916512080000001, 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054922399999999998, 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 374 2024-09-22T01:34:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.130981+0000", 2024-09-22T01:34:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.130981+0000", 2024-09-22T01:34:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.130985+0000", 2024-09-22T01:34:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6899999999999998e-06 2024-09-22T01:34:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131000+0000", 2024-09-22T01:34:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5435999999999999e-05 2024-09-22T01:34:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131053+0000", 2024-09-22T01:34:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2936999999999998e-05 2024-09-22T01:34:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131078+0000", 2024-09-22T01:34:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4358999999999998e-05 2024-09-22T01:34:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131296+0000", 2024-09-22T01:34:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021884199999999999 2024-09-22T01:34:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131532+0000", 2024-09-22T01:34:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023589499999999999 2024-09-22T01:34:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131933+0000", 2024-09-22T01:34:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040025 2024-09-22T01:34:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.134036+0000", 2024-09-22T01:34:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021036100000000001 2024-09-22T01:34:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.136260+0000", 2024-09-22T01:34:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022233359999999998 2024-09-22T01:34:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.136397+0000", 2024-09-22T01:34:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013761599999999999 2024-09-22T01:34:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.136473+0000", 2024-09-22T01:34:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6268999999999998e-05 2024-09-22T01:34:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:380 3.19 3:9b96d891:::rbd_data.110fc6985e86.0000000000000008:head [stat,truncate 393216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.131247+0000", 2024-09-22T01:34:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.6913855039999999, 2024-09-22T01:34:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055105010000000001, 2024-09-22T01:34:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 380 2024-09-22T01:34:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131247+0000", 2024-09-22T01:34:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131247+0000", 2024-09-22T01:34:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131249+0000", 2024-09-22T01:34:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.424e-06 2024-09-22T01:34:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131260+0000", 2024-09-22T01:34:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0573e-05 2024-09-22T01:34:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131290+0000", 2024-09-22T01:34:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0083e-05 2024-09-22T01:34:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.131309+0000", 2024-09-22T01:34:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9527000000000001e-05 2024-09-22T01:34:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.132748+0000", 2024-09-22T01:34:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001438988 2024-09-22T01:34:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.133028+0000", 2024-09-22T01:34:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027944500000000002 2024-09-22T01:34:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.133418+0000", 2024-09-22T01:34:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00038960699999999999 2024-09-22T01:34:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.134880+0000", 2024-09-22T01:34:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014624589999999999 2024-09-22T01:34:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.136574+0000", 2024-09-22T01:34:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001693897 2024-09-22T01:34:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.136654+0000", 2024-09-22T01:34:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0001999999999997e-05 2024-09-22T01:34:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.136757+0000", 2024-09-22T01:34:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103496 2024-09-22T01:34:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:457 3.0 e26/22 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head v 26'3, mlcod=26'1)", 2024-09-22T01:34:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.329472+0000", 2024-09-22T01:34:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.4931603039999999, 2024-09-22T01:34:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0026248959999999998, 2024-09-22T01:34:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329472+0000", 2024-09-22T01:34:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329472+0000", 2024-09-22T01:34:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329475+0000", 2024-09-22T01:34:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.847e-06 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329494+0000", 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9225999999999999e-05 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329543+0000", 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9016e-05 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329566+0000", 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2577000000000001e-05 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329737+0000", 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017158200000000001 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329795+0000", 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8023000000000003e-05 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331998+0000", 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022026530000000002 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332097+0000", 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8972e-05 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:467 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,truncate 6553600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.336517+0000", 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.4861152980000001, 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046844199999999999, 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 467 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336517+0000", 2024-09-22T01:34:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336517+0000", 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336521+0000", 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.574e-06 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336538+0000", 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7606000000000001e-05 2024-09-22T01:34:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336581+0000", 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2806000000000003e-05 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336605+0000", 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4323000000000001e-05 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336780+0000", 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017498599999999999 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.337020+0000", 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000239848 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.337316+0000", 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000295994 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.340456+0000", 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0031394489999999999 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.340893+0000", 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043757699999999997 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.341078+0000", 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000185155 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.341202+0000", 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012310199999999999 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:473 3.19 3:9b96d891:::rbd_data.110fc6985e86.0000000000000008:head [stat,truncate 6553600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.336693+0000", 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.4859394560000001, 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004919395, 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 473 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336693+0000", 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336693+0000", 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336695+0000", 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.26e-06 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336707+0000", 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1633e-05 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336731+0000", 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4680000000000001e-05 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.336750+0000", 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.897e-05 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.338018+0000", 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001267083 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.338225+0000", 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020750200000000001 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.338599+0000", 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037421399999999999 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.340474+0000", 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018745319999999999 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.341375+0000", 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000901 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.341525+0000", 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000150345 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.341612+0000", 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7175999999999993e-05 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:484 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.353045+0000", 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.469587049, 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021734202000000001, 2024-09-22T01:34:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 484 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353045+0000", 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353045+0000", 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353048+0000", 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2069999999999998e-06 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353059+0000", 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1336e-05 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353088+0000", 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9507000000000001e-05 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353103+0000", 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5063e-05 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353228+0000", 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012486299999999999 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353367+0000", 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000138565 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.357229+0000", 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00386258 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374592+0000", 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017362826000000001 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374621+0000", 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.887e-05 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374705+0000", 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3799000000000002e-05 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374780+0000", 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4585999999999994e-05 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.4367.0:484 3.19 e26/22 ondisk, result = 0)", 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.367841+0000", 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.454791873, 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0067650180000000002, 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.367841+0000", 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.367841+0000", 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.367842+0000", 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3069999999999999e-06 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.367848+0000", 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4400000000000002e-06 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.367873+0000", 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4542999999999999e-05 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.367893+0000", 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9843e-05 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374571+0000", 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066778879999999999 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374583+0000", 2024-09-22T01:34:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2717e-05 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374606+0000", 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.228e-05 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:499 3.6 e26/22 3:6277f7f1:::rbd_data.110fc6985e86.0000000000000013:head v 26'1, mlcod=0'0)", 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.412792+0000", 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.409840413, 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002166046, 2024-09-22T01:34:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.412792+0000", 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.412792+0000", 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.412795+0000", 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8760000000000001e-06 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.412837+0000", 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2277000000000002e-05 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.412882+0000", 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5076e-05 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.412908+0000", 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6026000000000001e-05 2024-09-22T01:34:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.413057+0000", 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014830299999999999 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.413089+0000", 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2736e-05 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.414872+0000", 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017832200000000001 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.414958+0000", 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5531999999999994e-05 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:518 3.6 e26/22 3:6277f7f1:::rbd_data.110fc6985e86.0000000000000013:head v 26'2, mlcod=0'0)", 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.490639+0000", 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.331992888, 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023267219999999998, 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.490639+0000", 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.490639+0000", 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.490642+0000", 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2869999999999999e-06 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.490659+0000", 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7402999999999999e-05 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.490732+0000", 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2385999999999994e-05 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.490755+0000", 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.389e-05 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.490927+0000", 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017133200000000001 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.490986+0000", 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9379999999999997e-05 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492853+0000", 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001867182 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492966+0000", 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112862 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:551 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,truncate 131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.568754+0000", 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.2538787760000001, 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035154180000000002, 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 551 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568754+0000", 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568754+0000", 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568756+0000", 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6879999999999999e-06 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568766+0000", 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4639999999999995e-06 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568788+0000", 2024-09-22T01:34:55.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2133e-05 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568801+0000", 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3563999999999999e-05 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568962+0000", 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016016199999999999 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569190+0000", 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000228168 2024-09-22T01:34:55.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569547+0000", 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035683699999999999 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.571338+0000", 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017917600000000001 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.571944+0000", 2024-09-22T01:34:55.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000605519 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.572116+0000", 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017255100000000001 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.572269+0000", 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015257199999999999 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:559 3.19 3:9b96d891:::rbd_data.110fc6985e86.0000000000000008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.579063+0000", 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.2435698399999999, 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002782512, 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 559 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.579063+0000", 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.579063+0000", 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.579065+0000", 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2029999999999999e-06 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.579077+0000", 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2576e-05 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.579107+0000", 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9964e-05 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.579122+0000", 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4960000000000001e-05 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.579279+0000", 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015676500000000001 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.579553+0000", 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027440500000000003 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.579904+0000", 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035023699999999999 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.581356+0000", 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014519120000000001 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.581684+0000", 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032862700000000001 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.581773+0000", 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8497000000000003e-05 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.581845+0000", 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2366000000000005e-05 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:602 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.1230077970000001, 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055897943999999998, 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 602 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699628+0000", 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6330000000000002e-06 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699650+0000", 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2056999999999999e-05 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699689+0000", 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9109000000000001e-05 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699707+0000", 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7207e-05 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699868+0000", 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016106200000000001 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.700040+0000", 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171865 2024-09-22T01:34:55.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.707678+0000", 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076380479999999997 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755348+0000", 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.047670037999999998 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755387+0000", 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9662000000000001e-05 2024-09-22T01:34:55.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755455+0000", 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7995000000000002e-05 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755523+0000", 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7267999999999994e-05 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.910 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.4367.0:602 3.19 e26/22 ondisk, result = 0)", 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.736255+0000", 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.0863773290000001, 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019105332999999999, 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736255+0000", 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736255+0000", 2024-09-22T01:34:55.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736257+0000", 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2730000000000001e-06 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736267+0000", 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4930000000000004e-06 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736301+0000", 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4252999999999999e-05 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736319+0000", 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7779999999999999e-05 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755323+0000", 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019004271999999999 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755337+0000", 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4295e-05 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755360+0000", 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2966999999999999e-05 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:604 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write 4812125~25409] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.759453+0000", 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.063178945, 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025714760000000001, 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.914 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 604 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.759453+0000", 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.759453+0000", 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.759456+0000", 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5170000000000002e-06 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.759510+0000", 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4061999999999998e-05 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.759541+0000", 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1483000000000003e-05 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.759558+0000", 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6217000000000001e-05 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.759680+0000", 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012233900000000001 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.759798+0000", 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011770200000000001 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.760005+0000", 2024-09-22T01:34:55.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020712199999999999 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.761225+0000", 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001220119 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.761958+0000", 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00073300500000000001 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.761994+0000", 2024-09-22T01:34:55.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6018e-05 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.762025+0000", 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0892000000000002e-05 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:611 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,truncate 7077888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.795828+0000", 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.0268046829999999, 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003082886, 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 611 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795828+0000", 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795828+0000", 2024-09-22T01:34:55.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795832+0000", 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2629999999999997e-06 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795848+0000", 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.626e-05 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795899+0000", 2024-09-22T01:34:55.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0333000000000001e-05 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.795923+0000", 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4196999999999999e-05 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.796057+0000", 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013472199999999999 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.796168+0000", 2024-09-22T01:34:55.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011076799999999999 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.796335+0000", 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016641299999999999 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.797792+0000", 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001457222 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.798659+0000", 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00086685699999999996 2024-09-22T01:34:55.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.798786+0000", 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000127329 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.798911+0000", 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012452200000000001 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.924 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:625 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write 748592~37840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.812397+0000", 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 1.010235421, 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034866929999999999, 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 625 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.812397+0000", 2024-09-22T01:34:55.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.812397+0000", 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.812400+0000", 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4300000000000002e-06 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.812450+0000", 2024-09-22T01:34:55.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9632999999999997e-05 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.812494+0000", 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4270000000000001e-05 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.812519+0000", 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4355999999999999e-05 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.812641+0000", 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012271499999999999 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.812739+0000", 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7849000000000005e-05 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.812904+0000", 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164637 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.814440+0000", 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001536379 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.815710+0000", 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001269549 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.815810+0000", 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9976000000000006e-05 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.815884+0000", 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3899000000000005e-05 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:639 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,truncate 3798689] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.864807+0000", 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.95782566099999999, 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044320380000000001, 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:55.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 639 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864807+0000", 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864807+0000", 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864811+0000", 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1110000000000001e-06 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864826+0000", 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4829e-05 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864870+0000", 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4311000000000003e-05 2024-09-22T01:34:55.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864894+0000", 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3702000000000001e-05 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865064+0000", 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017019 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865287+0000", 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022357900000000001 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865635+0000", 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034731399999999999 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.867189+0000", 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015547060000000001 2024-09-22T01:34:55.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.868963+0000", 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001773791 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.869131+0000", 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016777900000000001 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.869239+0000", 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010772600000000001 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.935 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:764 3.6 e26/22 3:6277f7f1:::rbd_data.110fc6985e86.0000000000000013:head v 26'6, mlcod=26'4)", 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.126994+0000", 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.69563799800000004, 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035061089999999999, 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.126994+0000", 2024-09-22T01:34:55.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.126994+0000", 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.126996+0000", 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.671e-06 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.127015+0000", 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9015999999999999e-05 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.127039+0000", 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3728000000000001e-05 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.127053+0000", 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4021e-05 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.127139+0000", 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6606000000000004e-05 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.127174+0000", 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4329000000000003e-05 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.130437+0000", 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032634090000000001 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.130500+0000", 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3329000000000003e-05 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:55.940 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:55.940 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:55.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:34:55.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:34:55.942 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:55.938+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:56.041 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:56.039+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:56.077 INFO:teuthology.orchestra.run.smithi018.stdout:233 read 0xad60ec0 thru 0xad70842 (0xf983 bytes) 2024-09-22T01:34:56.078 INFO:teuthology.orchestra.run.smithi018.stdout:234 read 0x6f6e2d7 thru 0x6f77965 (0x968f bytes) 2024-09-22T01:34:56.085 INFO:teuthology.orchestra.run.smithi018.stdout:235 trunc from 0xe5bd914 to 0x9e503ed 2024-09-22T01:34:56.109 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:56.110 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:56.110 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:34:56.110 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:56.125 INFO:teuthology.orchestra.run.smithi018.stdout:236 write 0xbd7241f thru 0xbd726a6 (0x288 bytes) 2024-09-22T01:34:56.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:34:56.131 INFO:teuthology.orchestra.run.smithi018.stdout:237 punch from 0x8624eee to 0x863102d, (0xc13f bytes) 2024-09-22T01:34:56.137 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:34:56.137 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:34:56.142 INFO:teuthology.orchestra.run.smithi018.stdout:239 trunc from 0xbd726a7 to 0x5010783 2024-09-22T01:34:56.142 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:56.139+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:34:56.159 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:34:56.160 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:34:56.177 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:34:56.177 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:34:56.179 INFO:teuthology.orchestra.run.smithi018.stdout:240 read 0x3edbf86 thru 0x3ee7fd8 (0xc053 bytes) 2024-09-22T01:34:56.196 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:34:56.196 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:34:56.205 INFO:teuthology.orchestra.run.smithi018.stdout:241 write 0xe051b2a thru 0xe05dbf4 (0xc0cb bytes) 2024-09-22T01:34:56.210 INFO:teuthology.orchestra.run.smithi018.stdout:243 writesame 0x9ad6ec9 thru 0x9ae1ef8 data_size 0x8(0xb030 bytes) 2024-09-22T01:34:56.214 INFO:teuthology.orchestra.run.smithi018.stdout:244 writesame 0x5c74565 thru 0x5c812c7 data_size 0x1(0xcd63 bytes) 2024-09-22T01:34:56.219 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:34:56.219 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:34:56.240 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:34:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:34:56.242 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:56.238+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:56.257 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:56.257 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:56.262 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:34:56.262 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:34:56.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:34:56.276 INFO:teuthology.orchestra.run.smithi018.stdout:245 write 0x4f2fc5c thru 0x4f31b33 (0x1ed8 bytes) 2024-09-22T01:34:56.278 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:56.278 INFO:teuthology.orchestra.run.smithi018.stdout:247 read 0xd4e9f9d thru 0xd4f4a35 (0xaa99 bytes) 2024-09-22T01:34:56.278 INFO:teuthology.orchestra.run.smithi018.stdout:248 punch from 0xb5018eb to 0xb502968, (0x107d bytes) 2024-09-22T01:34:56.278 INFO:teuthology.orchestra.run.smithi018.stdout:250 punch from 0xb60dbdf to 0xb61a06b, (0xc48c bytes) 2024-09-22T01:34:56.278 INFO:teuthology.orchestra.run.smithi018.stdout:251 read 0xbb0b4c6 thru 0xbb0c9b1 (0x14ec bytes) 2024-09-22T01:34:56.278 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:56.278 INFO:teuthology.orchestra.run.smithi018.stdout:255 read 0x5f1feb8 thru 0x5f23718 (0x3861 bytes) 2024-09-22T01:34:56.284 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:34:56.284 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:34:56.292 INFO:teuthology.orchestra.run.smithi018.stdout:257 trunc from 0xe05dbf5 to 0x50ef136 2024-09-22T01:34:56.324 INFO:teuthology.orchestra.run.smithi018.stdout:258 trunc from 0x50ef136 to 0x2b5ee49 2024-09-22T01:34:56.344 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:56.338+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:56.351 INFO:teuthology.orchestra.run.smithi018.stdout:259 read 0x272113e thru 0x2722c61 (0x1b24 bytes) 2024-09-22T01:34:56.376 INFO:teuthology.orchestra.run.smithi018.stdout:263 write 0x6edb506 thru 0x6edf37d (0x3e78 bytes) 2024-09-22T01:34:56.379 INFO:teuthology.orchestra.run.smithi018.stdout:264 writesame 0x394eb34 thru 0x39580f7 data_size 0x6c(0x95c4 bytes) 2024-09-22T01:34:56.386 INFO:teuthology.orchestra.run.smithi018.stdout:265 write 0x4c983f2 thru 0x4c9c418 (0x4027 bytes) 2024-09-22T01:34:56.403 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:56.403 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:56.417 INFO:teuthology.orchestra.run.smithi018.stdout:266 writesame 0xb1e8f6e thru 0xb1f2ae3 data_size 0x43(0x9b76 bytes) 2024-09-22T01:34:56.418 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:34:56.433 INFO:teuthology.orchestra.run.smithi018.stdout:267 writesame 0xca264db thru 0xca26911 data_size 0x1(0x437 bytes) 2024-09-22T01:34:56.449 INFO:teuthology.orchestra.run.smithi018.stdout:269 write 0xdfb7932 thru 0xdfc36da (0xbda9 bytes) 2024-09-22T01:34:56.449 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:56.447+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:56.454 INFO:teuthology.orchestra.run.smithi018.stdout:270 read 0xd01022c thru 0xd014052 (0x3e27 bytes) 2024-09-22T01:34:56.454 INFO:teuthology.orchestra.run.smithi018.stdout:271 read 0x66b0e67 thru 0x66be753 (0xd8ed bytes) 2024-09-22T01:34:56.455 INFO:teuthology.orchestra.run.smithi018.stdout:272 writesame 0x5f9da5 thru 0x5fbd9b data_size 0x7(0x1ff7 bytes) 2024-09-22T01:34:56.459 INFO:teuthology.orchestra.run.smithi018.stdout:274 punch from 0x3d2c6b7 to 0x3d321ae, (0x5af7 bytes) 2024-09-22T01:34:56.459 INFO:teuthology.orchestra.run.smithi018.stdout:276 punch from 0x93db929 to 0x93eac3f, (0xf316 bytes) 2024-09-22T01:34:56.459 INFO:teuthology.orchestra.run.smithi018.stdout:277 read 0x9689a15 thru 0x968c0b4 (0x26a0 bytes) 2024-09-22T01:34:56.459 INFO:teuthology.orchestra.run.smithi018.stdout:278 read 0x627c610 thru 0x627f5e9 (0x2fda bytes) 2024-09-22T01:34:56.460 INFO:teuthology.orchestra.run.smithi018.stdout:279 write 0xd0ba594 thru 0xd0c891d (0xe38a bytes) 2024-09-22T01:34:56.472 INFO:teuthology.orchestra.run.smithi018.stdout:280 trunc from 0xdfc36db to 0x8998f93 2024-09-22T01:34:56.494 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:56.512 INFO:teuthology.orchestra.run.smithi018.stdout:283 write 0xabc1232 thru 0xabcb327 (0xa0f6 bytes) 2024-09-22T01:34:56.519 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:56.519 INFO:teuthology.orchestra.run.smithi018.stdout:286 read 0x485f1e9 thru 0x4867540 (0x8358 bytes) 2024-09-22T01:34:56.520 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:56.520 INFO:teuthology.orchestra.run.smithi018.stdout:288 read 0x679936c thru 0x679c3f1 (0x3086 bytes) 2024-09-22T01:34:56.521 INFO:teuthology.orchestra.run.smithi018.stdout:290 read 0x33379fc thru 0x333ca43 (0x5048 bytes) 2024-09-22T01:34:56.521 INFO:teuthology.orchestra.run.smithi018.stdout:291 read 0x8eccb9c thru 0x8eccdf4 (0x259 bytes) 2024-09-22T01:34:56.522 INFO:teuthology.orchestra.run.smithi018.stdout:293 writesame 0x7209dc1 thru 0x7216ff9 data_size 0x1(0xd239 bytes) 2024-09-22T01:34:56.545 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:56.543+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:56.563 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:34:56.570 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:56.570 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:56.587 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:34:56.601 INFO:teuthology.orchestra.run.smithi018.stdout:294 trunc from 0xabcb328 to 0x6c4d6ab 2024-09-22T01:34:56.647 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:56.642+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:56.652 INFO:teuthology.orchestra.run.smithi018.stdout:297 write 0xcccd571 thru 0xccd3f1b (0x69ab bytes) 2024-09-22T01:34:56.659 INFO:teuthology.orchestra.run.smithi018.stdout:298 writesame 0x359c850 thru 0x35a3bdd data_size 0x7(0x738e bytes) 2024-09-22T01:34:56.665 INFO:teuthology.orchestra.run.smithi018.stdout:299 read 0x678a7e2 thru 0x6795203 (0xaa22 bytes) 2024-09-22T01:34:56.666 INFO:teuthology.orchestra.run.smithi018.stdout:300 punch from 0x79c8631 to 0x79d48f6, (0xc2c5 bytes) 2024-09-22T01:34:56.672 INFO:teuthology.orchestra.run.smithi018.stdout:301 trunc from 0xccd3f1c to 0x91efd3d 2024-09-22T01:34:56.696 INFO:teuthology.orchestra.run.smithi018.stdout:302 punch from 0x90bc869 to 0x90bcda3, (0x53a bytes) 2024-09-22T01:34:56.696 INFO:teuthology.orchestra.run.smithi018.stdout:303 punch from 0x8fd68b to 0x8fe278, (0xbed bytes) 2024-09-22T01:34:56.696 INFO:teuthology.orchestra.run.smithi018.stdout:304 read 0x8c36807 thru 0x8c3bfc3 (0x57bd bytes) 2024-09-22T01:34:56.696 INFO:teuthology.orchestra.run.smithi018.stdout:305 punch from 0x32b087d to 0x32b9d91, (0x9514 bytes) 2024-09-22T01:34:56.697 INFO:teuthology.orchestra.run.smithi018.stdout:306 punch from 0x2a22ae to 0x2b03f0, (0xe142 bytes) 2024-09-22T01:34:56.697 INFO:teuthology.orchestra.run.smithi018.stdout:307 read 0x8c7770d thru 0x8c828d4 (0xb1c8 bytes) 2024-09-22T01:34:56.697 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:56.697 INFO:teuthology.orchestra.run.smithi018.stdout:310 write 0x7f779b2 thru 0x7f7a621 (0x2c70 bytes) 2024-09-22T01:34:56.723 INFO:teuthology.orchestra.run.smithi018.stdout:311 write 0xe5f36a2 thru 0xe5fe43b (0xad9a bytes) 2024-09-22T01:34:56.726 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:56.726 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:56.730 INFO:teuthology.orchestra.run.smithi018.stdout:312 write 0x79ad6d3 thru 0x79b8eb2 (0xb7e0 bytes) 2024-09-22T01:34:56.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:34:56.747 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:56.742+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:56.761 INFO:teuthology.orchestra.run.smithi018.stdout:314 trunc from 0xe5fe43c to 0x215ae23 2024-09-22T01:34:56.796 INFO:teuthology.orchestra.run.smithi018.stdout:315 read 0x1b7d3fb thru 0x1b8ac0a (0xd810 bytes) 2024-09-22T01:34:56.830 INFO:teuthology.orchestra.run.smithi018.stdout:316 writesame 0xa6648d4 thru 0xa671e17 data_size 0x2(0xd544 bytes) 2024-09-22T01:34:56.830 INFO:teuthology.orchestra.run.smithi018.stdout:317 punch from 0x42b78aa to 0x42c34f4, (0xbc4a bytes) 2024-09-22T01:34:56.830 INFO:teuthology.orchestra.run.smithi018.stdout:318 writesame 0x74350b4 thru 0x7437664 data_size 0x1(0x25b1 bytes) 2024-09-22T01:34:56.842 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:56.842 INFO:teuthology.orchestra.run.smithi018.stdout:322 write 0x9dc2707 thru 0x9dd236e (0xfc68 bytes) 2024-09-22T01:34:56.848 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:56.842+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:56.856 INFO:teuthology.orchestra.run.smithi018.stdout:324 trunc from 0xa671e18 to 0x68f60cb 2024-09-22T01:34:56.876 INFO:teuthology.orchestra.run.smithi018.stdout:326 trunc from 0x68f60cb to 0x802684d 2024-09-22T01:34:56.887 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:56.887 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:56.889 INFO:teuthology.orchestra.run.smithi018.stdout:327 read 0x7356e5d thru 0x73627c3 (0xb967 bytes) 2024-09-22T01:34:56.890 INFO:teuthology.orchestra.run.smithi018.stdout:328 punch from 0x72fca5b to 0x7309906, (0xceab bytes) 2024-09-22T01:34:56.890 INFO:teuthology.orchestra.run.smithi018.stdout:332 punch from 0x73d90af to 0x73e71d7, (0xe128 bytes) 2024-09-22T01:34:56.890 INFO:teuthology.orchestra.run.smithi018.stdout:333 read 0x52d0897 thru 0x52d53bb (0x4b25 bytes) 2024-09-22T01:34:56.897 INFO:teuthology.orchestra.run.smithi018.stdout:335 trunc from 0x802684d to 0x49dad14 2024-09-22T01:34:56.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:34:56.916 INFO:teuthology.orchestra.run.smithi018.stdout:336 trunc from 0x49dad14 to 0x4f6aa63 2024-09-22T01:34:56.928 INFO:teuthology.orchestra.run.smithi018.stdout:337 read 0x2a7a8ed thru 0x2a7b16b (0x87f bytes) 2024-09-22T01:34:56.952 INFO:teuthology.orchestra.run.smithi018.stdout:341 write 0xc6e977b thru 0xc6ed75d (0x3fe3 bytes) 2024-09-22T01:34:56.956 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:56.954+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:56.960 INFO:teuthology.orchestra.run.smithi018.stdout:342 trunc from 0xc6ed75e to 0xe21386d 2024-09-22T01:34:56.971 INFO:teuthology.orchestra.run.smithi018.stdout:343 punch from 0x77b26ad to 0x77b74df, (0x4e32 bytes) 2024-09-22T01:34:56.971 INFO:teuthology.orchestra.run.smithi018.stdout:345 read 0x9431af1 thru 0x943aa60 (0x8f70 bytes) 2024-09-22T01:34:56.972 INFO:teuthology.orchestra.run.smithi018.stdout:346 writesame 0x63de36a thru 0x63e95a6 data_size 0x1(0xb23d bytes) 2024-09-22T01:34:57.002 INFO:teuthology.orchestra.run.smithi018.stdout:349 read 0x17a3c79 thru 0x17b0766 (0xcaee bytes) 2024-09-22T01:34:57.004 INFO:teuthology.orchestra.run.smithi018.stdout:350 read 0x3529ad5 thru 0x3539005 (0xf531 bytes) 2024-09-22T01:34:57.004 INFO:teuthology.orchestra.run.smithi018.stdout:351 writesame 0xa1779fb thru 0xa186c0e data_size 0x2(0xf214 bytes) 2024-09-22T01:34:57.037 INFO:teuthology.orchestra.run.smithi018.stdout:353 read 0xcf3f18f thru 0xcf4c0d9 (0xcf4b bytes) 2024-09-22T01:34:57.038 INFO:teuthology.orchestra.run.smithi018.stdout:354 write 0x538aa40 thru 0x538b0a6 (0x667 bytes) 2024-09-22T01:34:57.050 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:57.046+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:57.051 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:57.051 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:57.054 INFO:teuthology.orchestra.run.smithi018.stdout:356 write 0xe25301b thru 0xe259fe6 (0x6fcc bytes) 2024-09-22T01:34:57.062 INFO:teuthology.orchestra.run.smithi018.stdout:358 clone 3 order 21 su 65536 sc 15 2024-09-22T01:34:57.067 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:34:57.152 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:57.150+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:57.232 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:57.232 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:57.247 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:34:57.289 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:57.286+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:57.353 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:57.350+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:57.414 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:57.415 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:57.428 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:34:57.472 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:57.470+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:57.556 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:57.555+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:57.600 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:57.600 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:57.616 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:34:57.656 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:57.655+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:57.690 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:34:57.690 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:34:57.690 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-22T01:34:57.691 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2024-09-22T01:34:57.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-22T01:34:57.723 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone2 from 0xe259fe7 (overlap 0x215ae23) to 0x1403548 2024-09-22T01:34:57.748 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:57.749 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:57.757 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:57.755+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:57.764 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:34:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-22T01:34:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:359 write 0x92e624b thru 0x92ea293 (0x4049 bytes) 2024-09-22T01:34:57.858 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:57.854+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:360 read 0x65c3b19 thru 0x65cf058 (0xb540 bytes) 2024-09-22T01:34:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:362 read 0x29e2650 thru 0x29ee4bc (0xbe6d bytes) 2024-09-22T01:34:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:365 write 0xad85982 thru 0xad8954a (0x3bc9 bytes) 2024-09-22T01:34:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:368 read 0x6a22aac thru 0x6a287d7 (0x5d2c bytes) 2024-09-22T01:34:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:370 writesame 0xf45bc5 thru 0xf4c22b data_size 0x31(0x6667 bytes) 2024-09-22T01:34:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:371 flatten 2024-09-22T01:34:57.910 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:57.910 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:57.930 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:34:57.977 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:34:57.974+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:34:58.060 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:58.054+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:58.115 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:58.115 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:58.131 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:34:58.172 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:58.170+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:58.197 INFO:teuthology.orchestra.run.smithi018.stdout:373 write 0x96f52f6 thru 0x9704605 (0xf310 bytes) 2024-09-22T01:34:58.203 INFO:teuthology.orchestra.run.smithi018.stdout:374 write 0xbb9986a thru 0xbb9ae8e (0x1625 bytes) 2024-09-22T01:34:58.209 INFO:teuthology.orchestra.run.smithi018.stdout:375 read 0x3771768 thru 0x37727d2 (0x106b bytes) 2024-09-22T01:34:58.209 INFO:teuthology.orchestra.run.smithi018.stdout:377 punch from 0x6da6bc2 to 0x6da9182, (0x25c0 bytes) 2024-09-22T01:34:58.209 INFO:teuthology.orchestra.run.smithi018.stdout:378 punch from 0x4df3cb5 to 0x4dfbb17, (0x7e62 bytes) 2024-09-22T01:34:58.209 INFO:teuthology.orchestra.run.smithi018.stdout:379 punch from 0xdbb176e to 0xdbbc776, (0xb008 bytes) 2024-09-22T01:34:58.209 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.209 INFO:teuthology.orchestra.run.smithi018.stdout:381 write 0x85d63fd thru 0x85e537a (0xef7e bytes) 2024-09-22T01:34:58.214 INFO:teuthology.orchestra.run.smithi018.stdout:382 write 0xc89ba3f thru 0xc8a7084 (0xb646 bytes) 2024-09-22T01:34:58.220 INFO:teuthology.orchestra.run.smithi018.stdout:383 write 0x479d978 thru 0x47a613c (0x87c5 bytes) 2024-09-22T01:34:58.227 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.227 INFO:teuthology.orchestra.run.smithi018.stdout:385 writesame 0x4a4ba72 thru 0x4a5687a data_size 0x1(0xae09 bytes) 2024-09-22T01:34:58.259 INFO:teuthology.orchestra.run.smithi018.stdout:386 write 0xae9114c thru 0xaea05d4 (0xf489 bytes) 2024-09-22T01:34:58.262 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:58.259+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:58.263 INFO:teuthology.orchestra.run.smithi018.stdout:389 write 0x6d3bd3e thru 0x6d3dd08 (0x1fcb bytes) 2024-09-22T01:34:58.267 INFO:teuthology.orchestra.run.smithi018.stdout:390 writesame 0xc4f496 thru 0xc57046 data_size 0x5(0x7bb1 bytes) 2024-09-22T01:34:58.278 INFO:teuthology.orchestra.run.smithi018.stdout:391 writesame 0x10ca43 thru 0x11b2f2 data_size 0x4(0xe8b0 bytes) 2024-09-22T01:34:58.293 INFO:teuthology.orchestra.run.smithi018.stdout:392 writesame 0xcf8f817 thru 0xcf94fd5 data_size 0x1(0x57bf bytes) 2024-09-22T01:34:58.293 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:58.293 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:58.308 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:34:58.308 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:34:58.328 INFO:teuthology.orchestra.run.smithi018.stdout:393 read 0x62fb053 thru 0x6303efc (0x8eaa bytes) 2024-09-22T01:34:58.328 INFO:teuthology.orchestra.run.smithi018.stdout:394 write 0xb44a80c thru 0xb459d06 (0xf4fb bytes) 2024-09-22T01:34:58.334 INFO:teuthology.orchestra.run.smithi018.stdout:395 write 0x6df654c thru 0x6dfe380 (0x7e35 bytes) 2024-09-22T01:34:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:397 read 0x9c171c6 thru 0x9c1da51 (0x688c bytes) 2024-09-22T01:34:58.339 INFO:teuthology.orchestra.run.smithi018.stdout:398 write 0x2707bfd thru 0x27087c5 (0xbc9 bytes) 2024-09-22T01:34:58.344 INFO:teuthology.orchestra.run.smithi018.stdout:399 write 0x3134283 thru 0x3136cb8 (0x2a36 bytes) 2024-09-22T01:34:58.349 INFO:teuthology.orchestra.run.smithi018.stdout:401 writesame 0x9a3b29b thru 0x9a42408 data_size 0x1(0x716e bytes) 2024-09-22T01:34:58.363 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:58.358+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:58.365 INFO:teuthology.orchestra.run.smithi018.stdout:402 write 0x2502f3a thru 0x25108c1 (0xd988 bytes) 2024-09-22T01:34:58.370 INFO:teuthology.orchestra.run.smithi018.stdout:403 read 0x237056d thru 0x237b254 (0xace8 bytes) 2024-09-22T01:34:58.370 INFO:teuthology.orchestra.run.smithi018.stdout:405 read 0xdd42dc4 thru 0xdd462f2 (0x352f bytes) 2024-09-22T01:34:58.370 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.370 INFO:teuthology.orchestra.run.smithi018.stdout:407 writesame 0x74aec49 thru 0x74b3c19 data_size 0x15(0x4fd1 bytes) 2024-09-22T01:34:58.376 INFO:teuthology.orchestra.run.smithi018.stdout:408 writesame 0xe1a699e thru 0xe1a93ef data_size 0x1(0x2a52 bytes) 2024-09-22T01:34:58.387 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.387 INFO:teuthology.orchestra.run.smithi018.stdout:410 read 0x996bf33 thru 0x9975b7e (0x9c4c bytes) 2024-09-22T01:34:58.387 INFO:teuthology.orchestra.run.smithi018.stdout:411 punch from 0x939774e to 0x93979d7, (0x289 bytes) 2024-09-22T01:34:58.387 INFO:teuthology.orchestra.run.smithi018.stdout:412 write 0x5f59d7f thru 0x5f679a5 (0xdc27 bytes) 2024-09-22T01:34:58.394 INFO:teuthology.orchestra.run.smithi018.stdout:414 read 0x23dee04 thru 0x23eda41 (0xec3e bytes) 2024-09-22T01:34:58.394 INFO:teuthology.orchestra.run.smithi018.stdout:416 punch from 0x682f71 to 0x692a54, (0xfae3 bytes) 2024-09-22T01:34:58.394 INFO:teuthology.orchestra.run.smithi018.stdout:417 write 0xe14aaad thru 0xe151f55 (0x74a9 bytes) 2024-09-22T01:34:58.401 INFO:teuthology.orchestra.run.smithi018.stdout:418 writesame 0xc8ff74c thru 0xc903aa2 data_size 0x1(0x4357 bytes) 2024-09-22T01:34:58.433 INFO:teuthology.orchestra.run.smithi018.stdout:419 trunc from 0xe259fe7 to 0x3cf721c 2024-09-22T01:34:58.440 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:34:58.440 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:34:58.459 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:34:58.464 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:58.463+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:58.473 INFO:teuthology.orchestra.run.smithi018.stdout:421 trunc from 0x3cf721c to 0xc879aa9 2024-09-22T01:34:58.479 INFO:teuthology.orchestra.run.smithi018.stdout:422 read 0x237bbf4 thru 0x2386b07 (0xaf14 bytes) 2024-09-22T01:34:58.479 INFO:teuthology.orchestra.run.smithi018.stdout:423 punch from 0xc469194 to 0xc46af30, (0x1d9c bytes) 2024-09-22T01:34:58.484 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:34:58.484 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:34:58.484 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-22T01:34:58.492 INFO:teuthology.orchestra.run.smithi018.stdout:424 write 0xe845c86 thru 0xe84c993 (0x6d0e bytes) 2024-09-22T01:34:58.505 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:34:58.506 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:34:58.510 INFO:teuthology.orchestra.run.smithi018.stdout:425 punch from 0x3844dab to 0x384b5e2, (0x6837 bytes) 2024-09-22T01:34:58.510 INFO:teuthology.orchestra.run.smithi018.stdout:426 punch from 0xce2feaa to 0xce359b2, (0x5b08 bytes) 2024-09-22T01:34:58.510 INFO:teuthology.orchestra.run.smithi018.stdout:427 read 0x8eac29d thru 0x8eb92e3 (0xd047 bytes) 2024-09-22T01:34:58.510 INFO:teuthology.orchestra.run.smithi018.stdout:428 punch from 0x30768fe to 0x307e53c, (0x7c3e bytes) 2024-09-22T01:34:58.510 INFO:teuthology.orchestra.run.smithi018.stdout:429 write 0x1eeaa8 thru 0x1fdc8c (0xf1e5 bytes) 2024-09-22T01:34:58.514 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.514 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.514 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.514 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.514 INFO:teuthology.orchestra.run.smithi018.stdout:434 punch from 0x494c4d8 to 0x494d95e, (0x1486 bytes) 2024-09-22T01:34:58.515 INFO:teuthology.orchestra.run.smithi018.stdout:435 punch from 0x72f1e59 to 0x72feddf, (0xcf86 bytes) 2024-09-22T01:34:58.515 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.522 INFO:teuthology.orchestra.run.smithi018.stdout:438 write 0xeb0f1a7 thru 0xeb1e8e8 (0xf742 bytes) 2024-09-22T01:34:58.525 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:34:58.525 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:34:58.525 INFO:teuthology.orchestra.run.smithi018.stdout:439 write 0x620e7ef thru 0x6219954 (0xb166 bytes) 2024-09-22T01:34:58.532 INFO:teuthology.orchestra.run.smithi018.stdout:440 trunc from 0xeb1e8e9 to 0xd2b18ed 2024-09-22T01:34:58.540 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.544 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:34:58.544 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:34:58.550 INFO:teuthology.orchestra.run.smithi018.stdout:443 trunc from 0xd2b18ed to 0x621a3e7 2024-09-22T01:34:58.564 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:58.562+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:58.566 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:34:58.566 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:34:58.566 INFO:teuthology.orchestra.run.smithi018.stdout:444 write 0x3aae380 thru 0x3ab4dbd (0x6a3e bytes) 2024-09-22T01:34:58.568 INFO:teuthology.orchestra.run.smithi018.stdout:445 writesame 0x3bc395 thru 0x3c7d58 data_size 0x12(0xb9c4 bytes) 2024-09-22T01:34:58.585 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:34:58.585 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:34:58.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:34:58.588 INFO:teuthology.orchestra.run.smithi018.stdout:446 writesame 0xb371012 thru 0xb371f13 data_size 0x2(0xf02 bytes) 2024-09-22T01:34:58.588 INFO:teuthology.orchestra.run.smithi018.stdout:447 read 0x9d12100 thru 0x9d13b32 (0x1a33 bytes) 2024-09-22T01:34:58.588 INFO:teuthology.orchestra.run.smithi018.stdout:449 punch from 0x676a6dc to 0x676f8c2, (0x51e6 bytes) 2024-09-22T01:34:58.588 INFO:teuthology.orchestra.run.smithi018.stdout:450 read 0x590384b thru 0x590f96b (0xc121 bytes) 2024-09-22T01:34:58.588 INFO:teuthology.orchestra.run.smithi018.stdout:451 read 0xb21f65 thru 0xb2cc60 (0xacfc bytes) 2024-09-22T01:34:58.590 INFO:teuthology.orchestra.run.smithi018.stdout:452 trunc from 0xb371f14 to 0x9bb0d00 2024-09-22T01:34:58.600 INFO:teuthology.orchestra.run.smithi018.stdout:454 writesame 0x4d5daf1 thru 0x4d6aea4 data_size 0x22(0xd3b4 bytes) 2024-09-22T01:34:58.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:34:58.604 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:34:58.607 INFO:teuthology.orchestra.run.smithi018.stdout:455 write 0x592fae1 thru 0x59361e6 (0x6706 bytes) 2024-09-22T01:34:58.611 INFO:teuthology.orchestra.run.smithi018.stdout:456 read 0x806b6be thru 0x806ccc3 (0x1606 bytes) 2024-09-22T01:34:58.612 INFO:teuthology.orchestra.run.smithi018.stdout:457 punch from 0xac805b to 0xad4d28, (0xcccd bytes) 2024-09-22T01:34:58.612 INFO:teuthology.orchestra.run.smithi018.stdout:458 read 0x61a193 thru 0x61d2ce (0x313c bytes) 2024-09-22T01:34:58.621 INFO:teuthology.orchestra.run.smithi018.stdout:460 trunc from 0x9bb0d00 to 0x3460014 2024-09-22T01:34:58.623 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:34:58.623 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:34:58.629 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:58.629 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:34:58.629 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:34:58.629 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:58.637 INFO:teuthology.orchestra.run.smithi018.stdout:462 punch from 0x12a3eb1 to 0x12a3ee2, (0x31 bytes) 2024-09-22T01:34:58.644 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:34:58.649 INFO:teuthology.orchestra.run.smithi018.stdout:463 writesame 0x6e20717 thru 0x6e2b570 data_size 0x56(0xae5a bytes) 2024-09-22T01:34:58.664 INFO:teuthology.orchestra.run.smithi018.stdout:464 writesame 0xd089810 thru 0xd08dd13 data_size 0xe(0x4504 bytes) 2024-09-22T01:34:58.664 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:34:58.667 INFO:teuthology.orchestra.run.smithi018.stdout:466 trunc from 0xd08dd14 to 0xb3f4d41 2024-09-22T01:34:58.682 INFO:teuthology.orchestra.run.smithi018.stdout:467 write 0xce1bb52 thru 0xce2166b (0x5b1a bytes) 2024-09-22T01:34:58.686 INFO:teuthology.orchestra.run.smithi018.stdout:468 write 0x83894aa thru 0x838d391 (0x3ee8 bytes) 2024-09-22T01:34:58.689 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:58.686+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:58.690 INFO:teuthology.orchestra.run.smithi018.stdout:470 write 0x995e813 thru 0x996c9b5 (0xe1a3 bytes) 2024-09-22T01:34:58.694 INFO:teuthology.orchestra.run.smithi018.stdout:472 clone 4 order 25 su 1048576 sc 13 2024-09-22T01:34:58.766 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:58.762+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:58.805 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:58.806 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:34:58.806 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:34:58.806 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:34:58.806 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:58.819 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:34:58.905 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:34:58.902+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:34:58.968 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:34:58.967+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:34:58.991 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:34:58.991 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:34:58.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:34:58.991 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:34:58.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.991 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.679339807000002, 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.992 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:34:58.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:34:58.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.212510+0000", 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.775868665000001, 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011227233, 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:58.998 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 37 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212510+0000", 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212510+0000", 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:58.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212511+0000", 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3799999999999997e-07 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212517+0000", 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.934e-06 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212536+0000", 2024-09-22T01:34:59.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8563000000000002e-05 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.212548+0000", 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1471000000000001e-05 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.221623+0000", 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0090758760000000001 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.221758+0000", 2024-09-22T01:34:59.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013510900000000001 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.221953+0000", 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019497199999999999 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.222951+0000", 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00099787899999999991 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.223595+0000", 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00064393499999999999 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.223678+0000", 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3053000000000006e-05 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.223737+0000", 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8903000000000002e-05 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.310510+0000", 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.677868466, 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010601688999999999, 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 87 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310510+0000", 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310510+0000", 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310512+0000", 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.347e-06 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310672+0000", 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016020499999999999 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310696+0000", 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4669999999999999e-05 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310714+0000", 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7827000000000001e-05 2024-09-22T01:34:59.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.317310+0000", 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0065959859999999999 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.317522+0000", 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021203199999999999 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.317772+0000", 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000249638 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.320432+0000", 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0026597819999999999 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.320958+0000", 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00052596999999999995 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321047+0000", 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9191999999999996e-05 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321112+0000", 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5040000000000001e-05 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.310753+0000", 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.677626066999998, 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011208645999999999, 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.009 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 88 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310753+0000", 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310753+0000", 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310754+0000", 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.443e-06 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310766+0000", 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.203e-05 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310818+0000", 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1502999999999998e-05 2024-09-22T01:34:59.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.310835+0000", 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.702e-05 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.319339+0000", 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0085041579999999995 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.319445+0000", 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000105766 2024-09-22T01:34:59.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.319633+0000", 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018881400000000001 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.320882+0000", 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001249144 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321825+0000", 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00094259300000000003 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321902+0000", 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6969000000000001e-05 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.321961+0000", 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9206000000000002e-05 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.014 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.498874219000001, 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014449178, 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:34:59.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489506+0000", 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6700000000000001e-06 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489518+0000", 2024-09-22T01:34:59.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2323e-05 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489537+0000", 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8960000000000001e-05 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489551+0000", 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3243e-05 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497558+0000", 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0080073049999999993 2024-09-22T01:34:59.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497686+0000", 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012775899999999999 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497883+0000", 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000197622 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500679+0000", 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002795708 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503694+0000", 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030148739999999999 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503838+0000", 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014412499999999999 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503954+0000", 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011558899999999999 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.019 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.498765909999999, 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014775508999999999, 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111 2024-09-22T01:34:59.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489614+0000", 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6360000000000001e-06 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489627+0000", 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2493999999999999e-05 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489656+0000", 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8770000000000001e-05 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489671+0000", 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4866e-05 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499567+0000", 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0098963839999999994 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499697+0000", 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000130106 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499889+0000", 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019192499999999999 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504109+0000", 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0042195770000000004 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504146+0000", 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7639999999999999e-05 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504270+0000", 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123409 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504388+0000", 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000118702 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:34:59.025 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.498680203999999, 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.019730597999999998, 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 112 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489700+0000", 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.26e-06 2024-09-22T01:34:59.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489899+0000", 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000199672 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489924+0000", 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4136000000000001e-05 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489939+0000", 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5457000000000001e-05 2024-09-22T01:34:59.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500788+0000", 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010848806000000001 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500909+0000", 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000121322 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.501195+0000", 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028595500000000001 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504533+0000", 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0033380369999999999 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509171+0000", 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0046382649999999999 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509312+0000", 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014064200000000001 2024-09-22T01:34:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509429+0000", 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117046 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.498409988999999, 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.021089374000000001, 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.031 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 113 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:34:59.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489970+0000", 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.426e-06 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489982+0000", 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1547e-05 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490011+0000", 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9119e-05 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490024+0000", 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3667e-05 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502168+0000", 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012143693000000001 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502411+0000", 2024-09-22T01:34:59.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024248499999999999 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502788+0000", 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00037754100000000001 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504678+0000", 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0018899450000000001 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510804+0000", 2024-09-22T01:34:59.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.006125836 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510947+0000", 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142712 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511058+0000", 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111403 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.036 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.498324799999999, 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.021258902999999999, 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 114 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490055+0000", 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:34:59.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490066+0000", 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.097e-05 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490097+0000", 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0470000000000001e-05 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490112+0000", 2024-09-22T01:34:59.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5213e-05 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504774+0000", 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014662669999999999 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504905+0000", 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013048500000000001 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.505109+0000", 2024-09-22T01:34:59.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000204539 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509133+0000", 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.004023403 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511078+0000", 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0019454749999999999 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511196+0000", 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011812200000000001 2024-09-22T01:34:59.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511313+0000", 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000116286 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.498231190999999, 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.022115017000000001, 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.042 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 115 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:34:59.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490149+0000", 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3769999999999999e-06 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490346+0000", 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019744200000000001 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490363+0000", 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6973000000000002e-05 2024-09-22T01:34:59.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490374+0000", 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.06e-05 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.505802+0000", 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015427946999999999 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.506040+0000", 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023778199999999999 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.506469+0000", 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042951300000000002 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509495+0000", 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030255199999999999 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512030+0000", 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025350049999999999 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512162+0000", 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013271800000000001 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512262+0000", 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010014 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:34:59.047 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.497983426000001, 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.02212739, 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 116 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490396+0000", 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0160000000000001e-06 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490404+0000", 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7039999999999994e-06 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490417+0000", 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.341e-05 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490425+0000", 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0160000000000008e-06 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.507941+0000", 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.017515414999999999 2024-09-22T01:34:59.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.508122+0000", 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000181452 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.508335+0000", 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021324199999999999 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511427+0000", 2024-09-22T01:34:59.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030917090000000002 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512288+0000", 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00086098100000000003 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512420+0000", 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013192499999999999 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512523+0000", 2024-09-22T01:34:59.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010252 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.497939876, 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.022626255000000001, 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.053 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 117 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490440+0000", 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.1600000000000001e-07 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490448+0000", 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0339999999999997e-06 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.055 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490486+0000", 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8065999999999998e-05 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490500+0000", 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4583000000000001e-05 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509568+0000", 2024-09-22T01:34:59.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.019067589999999999 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509809+0000", 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000240738 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510189+0000", 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000380281 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511540+0000", 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013514759999999999 2024-09-22T01:34:59.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512847+0000", 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013063860000000001 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512970+0000", 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123106 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.513065+0000", 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5278999999999994e-05 2024-09-22T01:34:59.058 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005421+0000", 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.982957405000001, 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012578448000000001, 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 136 2024-09-22T01:34:59.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005421+0000", 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005421+0000", 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005422+0000", 2024-09-22T01:34:59.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4099999999999999e-07 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005427+0000", 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8879999999999996e-06 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005437+0000", 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0196e-05 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005442+0000", 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4260000000000002e-06 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.013089+0000", 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.007646506 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.013263+0000", 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174375 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.013516+0000", 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00025259099999999998 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016006+0000", 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024905510000000001 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017939+0000", 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0019327459999999999 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.063 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017973+0000", 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4337e-05 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018000+0000", 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6291e-05 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005489+0000", 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.982889337, 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012782085, 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.064 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 137 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005489+0000", 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005489+0000", 2024-09-22T01:34:59.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005490+0000", 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.27e-07 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005552+0000", 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2180000000000004e-05 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005565+0000", 2024-09-22T01:34:59.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2928999999999999e-05 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005572+0000", 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2019999999999998e-06 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.014223+0000", 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0086508520000000005 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.014332+0000", 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000108999 2024-09-22T01:34:59.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.014530+0000", 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000198557 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017893+0000", 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00336266 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018098+0000", 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000204601 2024-09-22T01:34:59.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018207+0000", 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109242 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018271+0000", 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4436000000000004e-05 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.069 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.982773093999999, 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014112458, 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 138 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005606+0000", 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4099999999999998e-07 2024-09-22T01:34:59.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005612+0000", 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4700000000000001e-06 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005622+0000", 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0593e-05 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005627+0000", 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2560000000000004e-06 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016043+0000", 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010416383 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016182+0000", 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013903200000000001 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.016412+0000", 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023044499999999999 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019539+0000", 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031267230000000001 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019564+0000", 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5245999999999999e-05 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019651+0000", 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6782999999999999e-05 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019718+0000", 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6785999999999994e-05 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.982740371999999, 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014654660999999999, 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.075 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 139 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005639+0000", 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8200000000000001e-07 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005642+0000", 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3330000000000001e-06 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005649+0000", 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7279999999999998e-06 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005654+0000", 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5790000000000003e-06 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017113+0000", 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011458822 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017220+0000", 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000107354 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017393+0000", 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017226700000000001 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019736+0000", 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0023427639999999998 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020234+0000", 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000498856 2024-09-22T01:34:59.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020267+0000", 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2160999999999999e-05 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020293+0000", 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6415e-05 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.982628513000002, 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015246857000000001, 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 140 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.081 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005751+0000", 2024-09-22T01:34:59.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.34e-07 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005811+0000", 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9935999999999997e-05 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005821+0000", 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0617e-05 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005825+0000", 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0090000000000001e-06 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018312+0000", 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012486919000000001 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018371+0000", 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8548000000000003e-05 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018462+0000", 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1254000000000004e-05 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019978+0000", 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0015163010000000001 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020947+0000", 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00096895599999999998 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020976+0000", 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8731999999999999e-05 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020997+0000", 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1151000000000001e-05 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.086 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.982531521999999, 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015779920999999999, 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 141 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005848+0000", 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1800000000000001e-07 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005851+0000", 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.878e-06 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005874+0000", 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3014e-05 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005882+0000", 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019064+0000", 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.013182268 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019124+0000", 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9358000000000003e-05 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019202+0000", 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7906999999999998e-05 2024-09-22T01:34:59.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020379+0000", 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0011774940000000001 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021577+0000", 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0011975759999999999 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021605+0000", 2024-09-22T01:34:59.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7968000000000001e-05 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021627+0000", 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2480000000000002e-05 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.247587957, 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010640472999999999, 2024-09-22T01:34:59.092 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 158 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740791+0000", 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8000000000000005e-07 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740917+0000", 2024-09-22T01:34:59.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012581499999999999 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740938+0000", 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0574e-05 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740950+0000", 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1779e-05 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.747810+0000", 2024-09-22T01:34:59.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0068605430000000002 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.748039+0000", 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022844200000000001 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.748307+0000", 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000268375 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751089+0000", 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0027817749999999998 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751220+0000", 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013090899999999999 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751359+0000", 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013917199999999999 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751431+0000", 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2309000000000002e-05 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.097 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.740966+0000", 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.247412179000001, 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012971455999999999, 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 159 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.098 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740966+0000", 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740966+0000", 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740967+0000", 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7000000000000004e-07 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740974+0000", 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6969999999999996e-06 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740985+0000", 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0723000000000001e-05 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.740992+0000", 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4359999999999996e-06 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:34:59.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.749836+0000", 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0088437719999999997 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.749966+0000", 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013021899999999999 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.750165+0000", 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019899800000000001 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.751512+0000", 2024-09-22T01:34:59.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013465969999999999 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.753769+0000", 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0022572590000000002 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.753840+0000", 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0660000000000004e-05 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:34:59.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.753938+0000", 2024-09-22T01:34:59.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8325000000000005e-05 2024-09-22T01:34:59.103 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.103 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.103 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.103 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:34:59.103 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:34:59.103 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:34:59.105 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:59.102+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:59.105 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:34:59.205 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:34:59.203+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:34:59.238 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:59.239 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:34:59.239 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:59.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:34:59.306 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:59.306+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:59.407 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:59.402+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:59.414 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:34:59.414 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:34:59.414 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:59.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:34:59.508 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:34:59.507+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:34:59.559 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:34:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:34:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:34:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-22T01:34:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:50.542145+0000", 2024-09-22T01:34:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0132043240000002, 2024-09-22T01:34:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047856670000000004, 2024-09-22T01:34:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542145+0000", 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542145+0000", 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542147+0000", 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3970000000000001e-06 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542160+0000", 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2788e-05 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542184+0000", 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3672e-05 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542197+0000", 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3746e-05 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542292+0000", 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4823999999999999e-05 2024-09-22T01:34:59.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.542303+0000", 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0648e-05 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.544487+0000", 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021844970000000001 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.544585+0000", 2024-09-22T01:34:59.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7621999999999995e-05 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5", 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.544740+0000", 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000155076 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.545896+0000", 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011557780000000001 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.546824+0000", 2024-09-22T01:34:59.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092794800000000005 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.546887+0000", 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2921000000000003e-05 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:50.546930+0000", 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.375e-05 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.565 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:426 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.230764+0000", 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.3245854880000003, 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056485270000000004, 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 426 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230764+0000", 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230764+0000", 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230765+0000", 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0160000000000001e-06 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230771+0000", 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2999999999999998e-06 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230785+0000", 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4430000000000001e-05 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.230795+0000", 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2529999999999993e-06 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.232388+0000", 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015937779999999999 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.232686+0000", 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029723100000000001 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.233838+0000", 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001152754 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.235585+0000", 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017462840000000001 2024-09-22T01:34:59.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.236106+0000", 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00052182900000000002 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.236270+0000", 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016395599999999999 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.236412+0000", 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014169599999999999 2024-09-22T01:34:59.570 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:440 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.255362+0000", 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.299987325, 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060629999999999998, 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 440 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255362+0000", 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255362+0000", 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255364+0000", 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.843e-06 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255374+0000", 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0814e-05 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255399+0000", 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4306000000000001e-05 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.255415+0000", 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6137000000000002e-05 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.256998+0000", 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015827009999999999 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.257149+0000", 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151695 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.257699+0000", 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00055019300000000004 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259385+0000", 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001685897 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.261136+0000", 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001750653 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.261303+0000", 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016701800000000001 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.261425+0000", 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121743 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.576 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:463 3.1 3:8736d36c:::rbd_data.110fc6985e86.000000000000001a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328292+0000", 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.2270568510000004, 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048201930000000004, 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 463 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328292+0000", 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328292+0000", 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328303+0000", 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0672999999999999e-05 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328315+0000", 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1703e-05 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328348+0000", 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3303000000000003e-05 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328367+0000", 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8862999999999999e-05 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328554+0000", 2024-09-22T01:34:59.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018755900000000001 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328780+0000", 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000225975 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329110+0000", 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032994399999999998 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330916+0000", 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001805706 2024-09-22T01:34:59.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332952+0000", 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020358379999999999 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333042+0000", 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0202000000000001e-05 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333112+0000", 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0426999999999995e-05 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.581 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:483 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.352981+0000", 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.2023685119999996, 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007806431, 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.582 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 483 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352981+0000", 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352981+0000", 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352983+0000", 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.497e-06 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352997+0000", 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3566e-05 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353034+0000", 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7799999999999997e-05 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353056+0000", 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1399999999999998e-05 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353192+0000", 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013588900000000001 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353336+0000", 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144196 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.354694+0000", 2024-09-22T01:34:59.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013579690000000001 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360544+0000", 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058505720000000001 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360586+0000", 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1465999999999999e-05 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360706+0000", 2024-09-22T01:34:59.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119943 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360787+0000", 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1132999999999997e-05 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:496 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.406637+0000", 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.1487123190000004, 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046489770000000003, 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 496 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406637+0000", 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406637+0000", 2024-09-22T01:34:59.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406638+0000", 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.623e-06 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406648+0000", 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4669999999999993e-06 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406673+0000", 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5289000000000001e-05 2024-09-22T01:34:59.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406686+0000", 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2524000000000001e-05 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406788+0000", 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000102569 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406921+0000", 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133122 2024-09-22T01:34:59.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.407500+0000", 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00057851599999999995 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.410876+0000", 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0033764469999999999 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.410993+0000", 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116939 2024-09-22T01:34:59.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411159+0000", 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016544500000000001 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411286+0000", 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012703599999999999 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:497 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.592 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.406742+0000", 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.1486071730000003, 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049671139999999999, 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 497 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406742+0000", 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406742+0000", 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406743+0000", 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5000000000000001e-07 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406751+0000", 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7499999999999992e-06 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406766+0000", 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4873e-05 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.406775+0000", 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.67e-06 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.408238+0000", 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001462655 2024-09-22T01:34:59.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.408499+0000", 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026130800000000003 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.409766+0000", 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001267333 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411544+0000", 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017775829999999999 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411562+0000", 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8513e-05 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411643+0000", 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.072e-05 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.411709+0000", 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5858999999999994e-05 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:511 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.449203+0000", 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.1061463910000002, 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0048177960000000001, 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 511 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.598 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449203+0000", 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449203+0000", 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449205+0000", 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449215+0000", 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0699999999999999e-05 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449249+0000", 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3283e-05 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449264+0000", 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5387e-05 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449398+0000", 2024-09-22T01:34:59.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000134375 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449652+0000", 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025375099999999998 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.450787+0000", 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011352389999999999 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.453594+0000", 2024-09-22T01:34:59.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002806364 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.453720+0000", 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012596600000000001 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.453896+0000", 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017638500000000001 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454020+0000", 2024-09-22T01:34:59.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012431599999999999 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:512 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.449299+0000", 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.1060497290000004, 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0053673690000000003, 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 512 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449299+0000", 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449299+0000", 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449300+0000", 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4399999999999999e-07 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449306+0000", 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9200000000000001e-06 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449321+0000", 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4705999999999999e-05 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.449329+0000", 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5040000000000002e-06 2024-09-22T01:34:59.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.451885+0000", 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025560230000000001 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.452073+0000", 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000187419 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.452778+0000", 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00070554400000000001 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454298+0000", 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001519255 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454404+0000", 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106473 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454547+0000", 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000143215 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454667+0000", 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119466 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:550 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,truncate 131072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.568697+0000", 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.986652136, 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052286390000000002, 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.608 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 550 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568697+0000", 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568697+0000", 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568699+0000", 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.626e-06 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568723+0000", 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4054e-05 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568748+0000", 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5299e-05 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568768+0000", 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9936999999999999e-05 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.568929+0000", 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000161008 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569147+0000", 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021770599999999999 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569504+0000", 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035783700000000001 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.571201+0000", 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001696393 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573658+0000", 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024571039999999999 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573797+0000", 2024-09-22T01:34:59.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872600000000001 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573926+0000", 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128949 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:556 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.569109+0000", 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9862398829999997, 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072176740000000003, 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.613 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 556 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569109+0000", 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569109+0000", 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569112+0000", 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0170000000000001e-06 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569128+0000", 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6047000000000001e-05 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569162+0000", 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4199000000000002e-05 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569184+0000", 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1206e-05 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569367+0000", 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182969 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569967+0000", 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060015899999999996 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.571991+0000", 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020240810000000001 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573950+0000", 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019593240000000001 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.576117+0000", 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021672200000000001 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.576256+0000", 2024-09-22T01:34:59.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000138269 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.576327+0000", 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1182999999999999e-05 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:557 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.569250+0000", 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9860995539999999, 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096288420000000003, 2024-09-22T01:34:59.618 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 557 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569250+0000", 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569250+0000", 2024-09-22T01:34:59.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569251+0000", 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5e-06 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569261+0000", 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7929999999999992e-06 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569290+0000", 2024-09-22T01:34:59.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8912999999999999e-05 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569310+0000", 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0403000000000001e-05 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.572853+0000", 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035429369999999999 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.572942+0000", 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8760999999999999e-05 2024-09-22T01:34:59.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573389+0000", 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044766100000000002 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.574748+0000", 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013586760000000001 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.578712+0000", 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039640889999999996 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.578810+0000", 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8208999999999994e-05 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.578878+0000", 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7899999999999997e-05 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:561 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.582156+0000", 2024-09-22T01:34:59.623 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9731932939999997, 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054648179999999998, 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 561 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582156+0000", 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582156+0000", 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582158+0000", 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3070000000000001e-06 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582172+0000", 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3876999999999999e-05 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582203+0000", 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1306000000000001e-05 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.582229+0000", 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5908999999999999e-05 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.583548+0000", 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013188640000000001 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.583719+0000", 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171199 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.584398+0000", 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000679081 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.586079+0000", 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001680604 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.587393+0000", 2024-09-22T01:34:59.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013142589999999999 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.587494+0000", 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010071 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.587621+0000", 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012670199999999999 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.628 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:572 3.1b 3:dbcd4bbe:::rbd_header.110fc6985e86:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.622101+0000", 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9332480949999997, 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00475874, 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 572 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622101+0000", 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622101+0000", 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622103+0000", 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.77e-06 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622113+0000", 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0105999999999999e-05 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622139+0000", 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6383000000000001e-05 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622153+0000", 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4123e-05 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622336+0000", 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018248599999999999 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622490+0000", 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015436200000000001 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.622802+0000", 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00031133099999999998 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.623912+0000", 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001110818 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.626698+0000", 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027852179999999999 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.626790+0000", 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2916000000000003e-05 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.626860+0000", 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9227000000000007e-05 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:638 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,truncate 3801088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.864722+0000", 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.6906269360000001, 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085411020000000001, 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 638 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864722+0000", 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864722+0000", 2024-09-22T01:34:59.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864725+0000", 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0309999999999999e-06 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864740+0000", 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.47e-05 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864788+0000", 2024-09-22T01:34:59.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8457e-05 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864913+0000", 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012486999999999999 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865070+0000", 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015637600000000001 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865284+0000", 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021468400000000001 2024-09-22T01:34:59.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865628+0000", 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034399700000000002 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.867307+0000", 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016784059999999999 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.873152+0000", 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058457200000000004 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.873212+0000", 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9775999999999998e-05 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.873263+0000", 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1085000000000003e-05 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:670 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.937639+0000", 2024-09-22T01:34:59.639 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.6177102159999999, 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051990609999999996, 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 670 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937639+0000", 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937639+0000", 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937640+0000", 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7199999999999997e-07 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937644+0000", 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.25e-06 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937655+0000", 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1027e-05 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937660+0000", 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4450000000000004e-06 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937724+0000", 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3917999999999993e-05 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.937807+0000", 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2774000000000004e-05 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.938028+0000", 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000220404 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.938776+0000", 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00074844099999999997 2024-09-22T01:34:59.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.942777+0000", 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040009909999999997 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.942810+0000", 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2880999999999999e-05 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.942838+0000", 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8058000000000001e-05 2024-09-22T01:34:59.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:722 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.038147+0000", 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.5172022199999997, 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058652280000000001, 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 722 2024-09-22T01:34:59.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038147+0000", 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038147+0000", 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038148+0000", 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0219999999999999e-06 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038153+0000", 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2109999999999997e-06 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038167+0000", 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.376e-05 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038174+0000", 2024-09-22T01:34:59.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8170000000000001e-06 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038236+0000", 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1895000000000003e-05 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.038298+0000", 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2860000000000005e-05 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.039389+0000", 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0010905629999999999 2024-09-22T01:34:59.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.043894+0000", 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0045046210000000003 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.043912+0000", 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8762000000000001e-05 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.043950+0000", 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7490000000000002e-05 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.044012+0000", 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2226999999999999e-05 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:764 3.6 3:6277f7f1:::rbd_data.110fc6985e86.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.124104+0000", 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.4312454099999998, 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086580210000000001, 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 764 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124104+0000", 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124104+0000", 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124105+0000", 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.528e-06 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124113+0000", 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8050000000000007e-06 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124129+0000", 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6364000000000001e-05 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124142+0000", 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2281e-05 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124227+0000", 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5395999999999994e-05 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124339+0000", 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011228199999999999 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.125728+0000", 2024-09-22T01:34:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013882810000000001 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132635+0000", 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006907219 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132654+0000", 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9347999999999998e-05 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132710+0000", 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5649000000000002e-05 2024-09-22T01:34:59.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132762+0000", 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1867999999999999e-05 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:878 3.1b 3:dbcd4bbe:::rbd_header.110fc6985e86:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.558368+0000", 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 3.9969806210000001, 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054265859999999997, 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 878 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.558368+0000", 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.558368+0000", 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.558371+0000", 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.734e-06 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.558383+0000", 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1593999999999999e-05 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.558410+0000", 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7084e-05 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.558427+0000", 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6884e-05 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.558524+0000", 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7555999999999999e-05 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.558532+0000", 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7330000000000003e-06 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.560952+0000", 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024196980000000001 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.561090+0000", 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013785699999999999 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.561675+0000", 2024-09-22T01:34:59.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00058559900000000002 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.562587+0000", 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00091171100000000005 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.563701+0000", 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001114458 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.563751+0000", 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0112999999999999e-05 2024-09-22T01:34:59.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.563795+0000", 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3565e-05 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:962 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,delete] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.684418+0000", 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 3.8709309429999998, 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046293360000000004, 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:34:59.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 962 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.684418+0000", 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.684418+0000", 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:34:59.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.684419+0000", 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2899999999999999e-06 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.684427+0000", 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7789999999999996e-06 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.684448+0000", 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1053999999999999e-05 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.684457+0000", 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9889999999999998e-06 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.684524+0000", 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7218999999999995e-05 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.684617+0000", 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2281000000000006e-05 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.684831+0000", 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021385600000000001 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.686996+0000", 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002164914 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.688904+0000", 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001908515 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:34:59.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.688986+0000", 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2242000000000003e-05 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.689047+0000", 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1197000000000004e-05 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:34:59.666 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:59.668 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:34:59.668 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:34:59.669 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:59.662+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:59.769 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:34:59.770+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:34:59.845 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:34:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:34:59.845 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:34:59.846 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:34:59.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:34:59.870 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:34:59.866+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:34:59.905 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-22T01:34:59.959 INFO:teuthology.orchestra.run.smithi018.stdout:473 write 0x27750ad thru 0x27754f3 (0x447 bytes) 2024-09-22T01:34:59.971 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:34:59.971+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:34:59.979 INFO:teuthology.orchestra.run.smithi018.stdout:474 write 0x599a62 thru 0x5a6387 (0xc926 bytes) 2024-09-22T01:34:59.995 INFO:teuthology.orchestra.run.smithi018.stdout:475 trunc from 0xce2166c to 0x993e094 2024-09-22T01:35:00.012 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:00.013 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:00.013 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:00.013 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:00.013 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:00.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:00.059 INFO:teuthology.orchestra.run.smithi018.stdout:476 trunc from 0x993e094 to 0xc3cf37d 2024-09-22T01:35:00.067 INFO:teuthology.orchestra.run.smithi018.stdout:477 read 0x68db549 thru 0x68df867 (0x431f bytes) 2024-09-22T01:35:00.067 INFO:teuthology.orchestra.run.smithi018.stdout:478 read 0x5d71eaa thru 0x5d811f7 (0xf34e bytes) 2024-09-22T01:35:00.068 INFO:teuthology.orchestra.run.smithi018.stdout:479 read 0x8c606d6 thru 0x8c60a45 (0x370 bytes) 2024-09-22T01:35:00.069 INFO:teuthology.orchestra.run.smithi018.stdout:481 read 0x4c6afe4 thru 0x4c79b27 (0xeb44 bytes) 2024-09-22T01:35:00.070 INFO:teuthology.orchestra.run.smithi018.stdout:483 read 0x8cf94d9 thru 0x8d01f41 (0x8a69 bytes) 2024-09-22T01:35:00.071 INFO:teuthology.orchestra.run.smithi018.stdout:484 writesame 0x7915e0d thru 0x7924e2a data_size 0x2d(0xf01e bytes) 2024-09-22T01:35:00.071 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:00.071+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:00.073 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.073 INFO:teuthology.orchestra.run.smithi018.stdout:486 write 0xb08a961 thru 0xb09875b (0xddfb bytes) 2024-09-22T01:35:00.076 INFO:teuthology.orchestra.run.smithi018.stdout:487 writesame 0x99dc610 thru 0x99ea044 data_size 0x1(0xda35 bytes) 2024-09-22T01:35:00.119 INFO:teuthology.orchestra.run.smithi018.stdout:488 write 0xced5fb3 thru 0xced808d (0x20db bytes) 2024-09-22T01:35:00.122 INFO:teuthology.orchestra.run.smithi018.stdout:489 read 0x5d2325c thru 0x5d2b58b (0x8330 bytes) 2024-09-22T01:35:00.123 INFO:teuthology.orchestra.run.smithi018.stdout:490 writesame 0x8db3c33 thru 0x8dbe89d data_size 0x1(0xac6b bytes) 2024-09-22T01:35:00.172 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:00.171+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:00.184 INFO:teuthology.orchestra.run.smithi018.stdout:491 writesame 0x1242b8e thru 0x124b111 data_size 0xa(0x8584 bytes) 2024-09-22T01:35:00.190 INFO:teuthology.orchestra.run.smithi018.stdout:492 write 0x68aa12d thru 0x68af20e (0x50e2 bytes) 2024-09-22T01:35:00.193 INFO:teuthology.orchestra.run.smithi018.stdout:493 write 0x4e8c4d6 thru 0x4e930c4 (0x6bef bytes) 2024-09-22T01:35:00.196 INFO:teuthology.orchestra.run.smithi018.stdout:494 write 0x5910195 thru 0x591102c (0xe98 bytes) 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:484 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.353045+0000", 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.8422937949999998, 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.021734202000000001, 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 484 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353045+0000", 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353045+0000", 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353048+0000", 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2069999999999998e-06 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353059+0000", 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1336e-05 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353088+0000", 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9507000000000001e-05 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353103+0000", 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5063e-05 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353228+0000", 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012486299999999999 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353367+0000", 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000138565 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.357229+0000", 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00386258 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374592+0000", 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.017362826000000001 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374621+0000", 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.887e-05 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374705+0000", 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3799000000000002e-05 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.374780+0000", 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4585999999999994e-05 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:602 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.4957145430000001, 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055897943999999998, 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 602 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699628+0000", 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6330000000000002e-06 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699650+0000", 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2056999999999999e-05 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699689+0000", 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9109000000000001e-05 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699707+0000", 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7207e-05 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699868+0000", 2024-09-22T01:35:00.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016106200000000001 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.700040+0000", 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171865 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.707678+0000", 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076380479999999997 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755348+0000", 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.047670037999999998 2024-09-22T01:35:00.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755387+0000", 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9662000000000001e-05 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755455+0000", 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7995000000000002e-05 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755523+0000", 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7267999999999994e-05 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.209 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop_reply(client.4367.0:602 3.19 e26/22 ondisk, result = 0)", 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.736255+0000", 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.4590840749999998, 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019105332999999999, 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736255+0000", 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736255+0000", 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736257+0000", 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2730000000000001e-06 2024-09-22T01:35:00.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736267+0000", 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4930000000000004e-06 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736301+0000", 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4252999999999999e-05 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.736319+0000", 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7779999999999999e-05 2024-09-22T01:35:00.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755323+0000", 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.019004271999999999 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755337+0000", 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4295e-05 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755360+0000", 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2966999999999999e-05 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5182 3.19 3:99c9a862:::rbd_data.110ff3dda363.0000000000000040:6 [sparse-read 458752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.012612+0000", 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.182726676, 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012076491, 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5182 2024-09-22T01:35:00.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012612+0000", 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012612+0000", 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012613+0000", 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2200000000000003e-07 2024-09-22T01:35:00.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012617+0000", 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2089999999999999e-06 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012634+0000", 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6447999999999999e-05 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012644+0000", 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0327e-05 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.024542+0000", 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011897316999999999 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.024597+0000", 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5086000000000001e-05 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.024689+0000", 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2281999999999995e-05 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.217 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5183 3.19 3:99c9a862:::rbd_data.110ff3dda363.0000000000000040:6 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.012660+0000", 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18267910100000001, 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012370394999999999, 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5183 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012660+0000", 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012660+0000", 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012661+0000", 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9999999999999996e-07 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012665+0000", 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5569999999999997e-06 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012680+0000", 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4317e-05 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012723+0000", 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3108000000000001e-05 2024-09-22T01:35:00.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.024737+0000", 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012014265999999999 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.024867+0000", 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000129672 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025030+0000", 2024-09-22T01:35:00.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016367500000000001 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5192 3.19 3:98aafe5f:::rbd_data.110ff3dda363.0000000000000067:6 [sparse-read 720896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.012736+0000", 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18260267399999999, 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012450496, 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5192 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012736+0000", 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012736+0000", 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012737+0000", 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1399999999999996e-07 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012742+0000", 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8749999999999999e-06 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012759+0000", 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7261e-05 2024-09-22T01:35:00.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012770+0000", 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1005999999999999e-05 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025050+0000", 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012279633 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025122+0000", 2024-09-22T01:35:00.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1728000000000002e-05 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025187+0000", 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5278999999999996e-05 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5193 3.19 3:98aafe5f:::rbd_data.110ff3dda363.0000000000000067:6 [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.012784+0000", 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18255517800000001, 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012649820000000001, 2024-09-22T01:35:00.226 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5193 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012784+0000", 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012784+0000", 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012785+0000", 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5600000000000004e-07 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012807+0000", 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2265000000000001e-05 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012821+0000", 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4095e-05 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012835+0000", 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3555e-05 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025234+0000", 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012398858 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025317+0000", 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3440000000000001e-05 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025434+0000", 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011675099999999999 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5216 3.19 3:985d2fd7:::rbd_data.110ff3dda363.0000000000000016:6 [sparse-read 393216~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.012850+0000", 2024-09-22T01:35:00.230 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.182489031, 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012737758, 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5216 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012850+0000", 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012850+0000", 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012851+0000", 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3799999999999996e-07 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012855+0000", 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.515e-06 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012893+0000", 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7246999999999998e-05 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012904+0000", 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1243999999999999e-05 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025470+0000", 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012566330000000001 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025532+0000", 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2187000000000006e-05 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025588+0000", 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5396999999999998e-05 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5217 3.19 3:985d2fd7:::rbd_data.110ff3dda363.0000000000000016:6 [sparse-read 1310720~10806] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.012924+0000", 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.182415087, 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013071166, 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5217 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012924+0000", 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012924+0000", 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012925+0000", 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012930+0000", 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8840000000000002e-06 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012944+0000", 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3937999999999999e-05 2024-09-22T01:35:00.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012954+0000", 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9899999999999992e-06 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025623+0000", 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.012669448 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025694+0000", 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1136000000000005e-05 2024-09-22T01:35:00.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.025995+0000", 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030084399999999998 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5222 3.19 3:99c9a862:::rbd_data.110ff3dda363.0000000000000040:6 [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.012967+0000", 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18237224599999999, 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013183594999999999, 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5222 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012967+0000", 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012967+0000", 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012968+0000", 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900000000000004e-07 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012972+0000", 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1729999999999997e-06 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.012988+0000", 2024-09-22T01:35:00.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6025999999999999e-05 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013016+0000", 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7812000000000001e-05 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026029+0000", 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013013168 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026095+0000", 2024-09-22T01:35:00.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6025000000000006e-05 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026150+0000", 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5652000000000002e-05 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5223 3.19 3:99c9a862:::rbd_data.110ff3dda363.0000000000000040:6 [sparse-read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.013030+0000", 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18230934400000001, 2024-09-22T01:35:00.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013352429000000001, 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5223 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013030+0000", 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013030+0000", 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013031+0000", 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7199999999999998e-07 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013035+0000", 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2590000000000002e-06 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013051+0000", 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5919000000000001e-05 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013061+0000", 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0308e-05 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026183+0000", 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013122025000000001 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026289+0000", 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105713 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026382+0000", 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3432999999999998e-05 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5232 3.19 3:98aafe5f:::rbd_data.110ff3dda363.0000000000000067:6 [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.246 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.013075+0000", 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18226410600000001, 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013452764000000001, 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5232 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013075+0000", 2024-09-22T01:35:00.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013075+0000", 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013076+0000", 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1100000000000005e-07 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013081+0000", 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6840000000000004e-06 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013094+0000", 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3315999999999999e-05 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013106+0000", 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2289e-05 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026412+0000", 2024-09-22T01:35:00.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013305613000000001 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026472+0000", 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0346999999999997e-05 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026528+0000", 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5704000000000001e-05 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5233 3.19 3:98aafe5f:::rbd_data.110ff3dda363.0000000000000067:6 [sparse-read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.013119+0000", 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.182220044, 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.01358178, 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5233 2024-09-22T01:35:00.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013119+0000", 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013119+0000", 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013120+0000", 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9299999999999997e-07 2024-09-22T01:35:00.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013141+0000", 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1605999999999999e-05 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013156+0000", 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4517e-05 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013166+0000", 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9639999999999998e-06 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026558+0000", 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013392461 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026618+0000", 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9089999999999998e-05 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026701+0000", 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3349000000000004e-05 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5256 3.19 3:985d2fd7:::rbd_data.110ff3dda363.0000000000000016:6 [sparse-read 458752~53446] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.013185+0000", 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18215410900000001, 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013822129000000001, 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5256 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013185+0000", 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013185+0000", 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013186+0000", 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5499999999999997e-07 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013190+0000", 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.566e-06 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013204+0000", 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3879999999999999e-05 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013215+0000", 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0383999999999999e-05 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026729+0000", 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013514394000000001 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.026792+0000", 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3062e-05 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027007+0000", 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000214988 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5257 3.19 3:985d2fd7:::rbd_data.110ff3dda363.0000000000000016:6 [sparse-read 1376256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.013228+0000", 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18211066400000001, 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014118778, 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.259 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5257 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013228+0000", 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013228+0000", 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013229+0000", 2024-09-22T01:35:00.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3500000000000005e-07 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013233+0000", 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.002e-06 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013248+0000", 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5167000000000001e-05 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013258+0000", 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0003999999999999e-05 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027065+0000", 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.013806710999999999 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027191+0000", 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012608500000000001 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027347+0000", 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015597399999999999 2024-09-22T01:35:00.262 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5262 3.19 3:99c9a862:::rbd_data.110ff3dda363.0000000000000040:6 [sparse-read 589824~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.013272+0000", 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18206744699999999, 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014235809, 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.263 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5262 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013272+0000", 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013272+0000", 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013272+0000", 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9100000000000003e-07 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013276+0000", 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9910000000000004e-06 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013292+0000", 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5821e-05 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013302+0000", 2024-09-22T01:35:00.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0016e-05 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027399+0000", 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014096607000000001 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027450+0000", 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1245000000000001e-05 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027507+0000", 2024-09-22T01:35:00.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7337999999999999e-05 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5263 3.19 3:99c9a862:::rbd_data.110ff3dda363.0000000000000040:6 [sparse-read 1507328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.013315+0000", 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.182024151, 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014429742000000001, 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5263 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013315+0000", 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013315+0000", 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013316+0000", 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4399999999999999e-07 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013320+0000", 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1200000000000004e-06 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013333+0000", 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3448000000000001e-05 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013346+0000", 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2329e-05 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027559+0000", 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014213442 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027657+0000", 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7917000000000005e-05 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027745+0000", 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7742000000000001e-05 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5271 3.19 3:98aafe5f:::rbd_data.110ff3dda363.0000000000000067:6 [sparse-read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.013359+0000", 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.181980527, 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014554609, 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.271 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5271 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013359+0000", 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013359+0000", 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013359+0000", 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6000000000000003e-07 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013373+0000", 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3764000000000001e-05 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013387+0000", 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3933e-05 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013397+0000", 2024-09-22T01:35:00.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027786+0000", 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014389384999999999 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027855+0000", 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8725000000000004e-05 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027913+0000", 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8180999999999997e-05 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5272 3.19 3:98aafe5f:::rbd_data.110ff3dda363.0000000000000067:6 [sparse-read 851968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.013413+0000", 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18192588700000001, 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014810903, 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5272 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013413+0000", 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013413+0000", 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013414+0000", 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900000000000004e-07 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013418+0000", 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1269999999999996e-06 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013431+0000", 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3081000000000001e-05 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013449+0000", 2024-09-22T01:35:00.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8241999999999999e-05 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.027954+0000", 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014504909 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.028067+0000", 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011254700000000001 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.028224+0000", 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015725799999999999 2024-09-22T01:35:00.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5273 3.19 3:98aafe5f:::rbd_data.110ff3dda363.0000000000000067:6 [read 1769472~5740] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.013463+0000", 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.18187589900000001, 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015249985000000001, 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5273 2024-09-22T01:35:00.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013463+0000", 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013463+0000", 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013464+0000", 2024-09-22T01:35:00.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1099999999999995e-07 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013468+0000", 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9310000000000001e-06 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013485+0000", 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7444000000000001e-05 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.013495+0000", 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0171e-05 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.028314+0000", 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.014818447 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.028428+0000", 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011382099999999999 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.028713+0000", 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00028546000000000002 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.283 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.283 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.283 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:00.284 INFO:teuthology.orchestra.run.smithi018.stdout:495 write 0xa903a61 thru 0xa90e541 (0xaae1 bytes) 2024-09-22T01:35:00.284 INFO:teuthology.orchestra.run.smithi018.stdout:496 writesame 0x9f80824 thru 0x9f8ab93 data_size 0x28(0xa370 bytes) 2024-09-22T01:35:00.284 INFO:teuthology.orchestra.run.smithi018.stdout:497 writesame 0x379fa87 thru 0x37aa180 data_size 0x43(0xa6fa bytes) 2024-09-22T01:35:00.284 INFO:teuthology.orchestra.run.smithi018.stdout:498 punch from 0x6aa9a39 to 0x6ab9060, (0xf627 bytes) 2024-09-22T01:35:00.284 INFO:teuthology.orchestra.run.smithi018.stdout:499 write 0xa39bc4 thru 0xa3e54f (0x498c bytes) 2024-09-22T01:35:00.285 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:00.286 INFO:teuthology.orchestra.run.smithi018.stdout:500 write 0x3127f59 thru 0x31321a3 (0xa24b bytes) 2024-09-22T01:35:00.286 INFO:teuthology.orchestra.run.smithi018.stdout:503 trunc from 0xced808e to 0xb277d4 2024-09-22T01:35:00.286 INFO:teuthology.orchestra.run.smithi018.stdout:505 read 0x7aea50 thru 0x7b33e6 (0x4997 bytes) 2024-09-22T01:35:00.286 INFO:teuthology.orchestra.run.smithi018.stdout:507 punch from 0x382a3d to 0x38c189, (0x974c bytes) 2024-09-22T01:35:00.286 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:00.283+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:00.286 INFO:teuthology.orchestra.run.smithi018.stdout:508 trunc from 0xb277d4 to 0x65dcc4e 2024-09-22T01:35:00.294 INFO:teuthology.orchestra.run.smithi018.stdout:509 read 0x16598a9 thru 0x165f6cc (0x5e24 bytes) 2024-09-22T01:35:00.295 INFO:teuthology.orchestra.run.smithi018.stdout:511 punch from 0x4da135c to 0x4dadf93, (0xcc37 bytes) 2024-09-22T01:35:00.295 INFO:teuthology.orchestra.run.smithi018.stdout:512 punch from 0xb5fd5 to 0xc1563, (0xb58e bytes) 2024-09-22T01:35:00.315 INFO:teuthology.orchestra.run.smithi018.stdout:513 write 0x9969f69 thru 0x996cf8c (0x3024 bytes) 2024-09-22T01:35:00.318 INFO:teuthology.orchestra.run.smithi018.stdout:515 write 0x2f2c482 thru 0x2f39d51 (0xd8d0 bytes) 2024-09-22T01:35:00.322 INFO:teuthology.orchestra.run.smithi018.stdout:516 read 0x81a3055 thru 0x81a529a (0x2246 bytes) 2024-09-22T01:35:00.331 INFO:teuthology.orchestra.run.smithi018.stdout:517 trunc from 0x996cf8d to 0xe818730 2024-09-22T01:35:00.341 INFO:teuthology.orchestra.run.smithi018.stdout:518 read 0xcf64dc thru 0xcfe1fd (0x7d22 bytes) 2024-09-22T01:35:00.341 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.341 INFO:teuthology.orchestra.run.smithi018.stdout:521 read 0x538a964 thru 0x538be78 (0x1515 bytes) 2024-09-22T01:35:00.341 INFO:teuthology.orchestra.run.smithi018.stdout:523 write 0xaed520e thru 0xaedf49f (0xa292 bytes) 2024-09-22T01:35:00.343 INFO:teuthology.orchestra.run.smithi018.stdout:524 read 0x58a4866 thru 0x58a51a0 (0x93b bytes) 2024-09-22T01:35:00.344 INFO:teuthology.orchestra.run.smithi018.stdout:526 read 0x81738ff thru 0x81818f4 (0xdff6 bytes) 2024-09-22T01:35:00.344 INFO:teuthology.orchestra.run.smithi018.stdout:527 writesame 0xe2cdda thru 0xe2d399 data_size 0x17(0x5c0 bytes) 2024-09-22T01:35:00.350 INFO:teuthology.orchestra.run.smithi018.stdout:528 punch from 0x216778e to 0x216be59, (0x46cb bytes) 2024-09-22T01:35:00.363 INFO:teuthology.orchestra.run.smithi018.stdout:529 trunc from 0xe818730 to 0x4a6a367 2024-09-22T01:35:00.385 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:00.382+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:00.404 INFO:teuthology.orchestra.run.smithi018.stdout:530 writesame 0xabe2ba8 thru 0xabe5f84 data_size 0x11(0x33dd bytes) 2024-09-22T01:35:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:532 read 0x353907a thru 0x3545b11 (0xca98 bytes) 2024-09-22T01:35:00.407 INFO:teuthology.orchestra.run.smithi018.stdout:534 read 0x7ded25a thru 0x7df5084 (0x7e2b bytes) 2024-09-22T01:35:00.423 INFO:teuthology.orchestra.run.smithi018.stdout:535 trunc from 0xabe5f85 to 0x1c56f73 2024-09-22T01:35:00.440 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:00.440 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:00.440 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:00.440 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:00.441 INFO:teuthology.orchestra.run.smithi018.stdout:536 read 0x17706ee thru 0x177248a (0x1d9d bytes) 2024-09-22T01:35:00.442 INFO:teuthology.orchestra.run.smithi018.stdout:537 write 0xc49da1 thru 0xc5388e (0x9aee bytes) 2024-09-22T01:35:00.450 INFO:teuthology.orchestra.run.smithi018.stdout:538 read 0x19657a4 thru 0x1969191 (0x39ee bytes) 2024-09-22T01:35:00.459 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:00.479 INFO:teuthology.orchestra.run.smithi018.stdout:539 write 0xcee3ef1 thru 0xcee8981 (0x4a91 bytes) 2024-09-22T01:35:00.482 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.482 INFO:teuthology.orchestra.run.smithi018.stdout:542 read 0x4acdeec thru 0x4ad7b18 (0x9c2d bytes) 2024-09-22T01:35:00.485 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:00.482+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:00.495 INFO:teuthology.orchestra.run.smithi018.stdout:543 write 0xea5df44 thru 0xea674f6 (0x95b3 bytes) 2024-09-22T01:35:00.497 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.511 INFO:teuthology.orchestra.run.smithi018.stdout:546 trunc from 0xea674f7 to 0x70d48df 2024-09-22T01:35:00.528 INFO:teuthology.orchestra.run.smithi018.stdout:547 write 0x189b8f6 thru 0x18a6520 (0xac2b bytes) 2024-09-22T01:35:00.542 INFO:teuthology.orchestra.run.smithi018.stdout:548 trunc from 0x70d48df to 0x1056ac3 2024-09-22T01:35:00.559 INFO:teuthology.orchestra.run.smithi018.stdout:549 read 0xfa8fc1 thru 0xfb1961 (0x89a1 bytes) 2024-09-22T01:35:00.559 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.559 INFO:teuthology.orchestra.run.smithi018.stdout:554 read 0xd59e61 thru 0xd5b3d7 (0x1577 bytes) 2024-09-22T01:35:00.560 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.572 INFO:teuthology.orchestra.run.smithi018.stdout:557 write 0x112968f thru 0x1131f35 (0x88a7 bytes) 2024-09-22T01:35:00.574 INFO:teuthology.orchestra.run.smithi018.stdout:558 read 0x15cc52 thru 0x164504 (0x78b3 bytes) 2024-09-22T01:35:00.586 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:00.583+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:00.608 INFO:teuthology.orchestra.run.smithi018.stdout:559 write 0xe299012 thru 0xe2a61d4 (0xd1c3 bytes) 2024-09-22T01:35:00.611 INFO:teuthology.orchestra.run.smithi018.stdout:560 writesame 0xa96fe1f thru 0xa97dab2 data_size 0x26(0xdc94 bytes) 2024-09-22T01:35:00.614 INFO:teuthology.orchestra.run.smithi018.stdout:561 punch from 0x4e95ce3 to 0x4ea0f69, (0xb286 bytes) 2024-09-22T01:35:00.614 INFO:teuthology.orchestra.run.smithi018.stdout:562 write 0x42c9ced thru 0x42d01b6 (0x64ca bytes) 2024-09-22T01:35:00.617 INFO:teuthology.orchestra.run.smithi018.stdout:563 punch from 0x7fd55fe to 0x7fd689f, (0x12a1 bytes) 2024-09-22T01:35:00.619 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:00.619 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:00.619 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:00.619 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:00.619 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:00.632 INFO:teuthology.orchestra.run.smithi018.stdout:564 trunc from 0xe2a61d5 to 0x5ab66b5 2024-09-22T01:35:00.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:00.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:00.648 INFO:teuthology.orchestra.run.smithi018.stdout:565 trunc from 0x5ab66b5 to 0x6978864 2024-09-22T01:35:00.657 INFO:teuthology.orchestra.run.smithi018.stdout:566 read 0x11e46c6 thru 0x11f40ed (0xfa28 bytes) 2024-09-22T01:35:00.674 INFO:teuthology.orchestra.run.smithi018.stdout:568 write 0xbeaa790 thru 0xbeb718b (0xc9fc bytes) 2024-09-22T01:35:00.678 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.678 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.678 INFO:teuthology.orchestra.run.smithi018.stdout:572 write 0x1ff3c12 thru 0x1ffbafe (0x7eed bytes) 2024-09-22T01:35:00.680 INFO:teuthology.orchestra.run.smithi018.stdout:573 write 0x9f7e45b thru 0x9f80578 (0x211e bytes) 2024-09-22T01:35:00.683 INFO:teuthology.orchestra.run.smithi018.stdout:574 write 0x15c62ee thru 0x15d349e (0xd1b1 bytes) 2024-09-22T01:35:00.687 INFO:teuthology.orchestra.run.smithi018.stdout:575 writesame 0x66b4e01 thru 0x66ba54a data_size 0x1(0x574a bytes) 2024-09-22T01:35:00.687 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:00.687+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:00.721 INFO:teuthology.orchestra.run.smithi018.stdout:576 write 0x63f7a2a thru 0x63f8f77 (0x154e bytes) 2024-09-22T01:35:00.738 INFO:teuthology.orchestra.run.smithi018.stdout:579 trunc from 0xbeb718c to 0x32191b3 2024-09-22T01:35:00.762 INFO:teuthology.orchestra.run.smithi018.stdout:580 read 0x16603a0 thru 0x1667366 (0x6fc7 bytes) 2024-09-22T01:35:00.763 INFO:teuthology.orchestra.run.smithi018.stdout:581 read 0x1381708 thru 0x1390903 (0xf1fc bytes) 2024-09-22T01:35:00.764 INFO:teuthology.orchestra.run.smithi018.stdout:582 read 0x2292ae2 thru 0x229e718 (0xbc37 bytes) 2024-09-22T01:35:00.765 INFO:teuthology.orchestra.run.smithi018.stdout:584 punch from 0x3210053 to 0x321854d, (0x84fa bytes) 2024-09-22T01:35:00.765 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.773 INFO:teuthology.orchestra.run.smithi018.stdout:586 writesame 0x335c648 thru 0x335e991 data_size 0x1(0x234a bytes) 2024-09-22T01:35:00.775 INFO:teuthology.orchestra.run.smithi018.stdout:587 read 0xf8b00f thru 0xf8f54c (0x453e bytes) 2024-09-22T01:35:00.776 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.779 INFO:teuthology.orchestra.run.smithi018.stdout:592 trunc from 0x335e992 to 0x1764595 2024-09-22T01:35:00.788 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:00.787+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.7890856670000002, 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:364 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'5, mlcod=26'3)", 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.087130+0000", 2024-09-22T01:35:00.793 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.7005773360000003, 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023533450000000002, 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.087130+0000", 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.087130+0000", 2024-09-22T01:35:00.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.087132+0000", 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2699999999999999e-06 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.087369+0000", 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023755799999999999 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.087402+0000", 2024-09-22T01:35:00.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2943e-05 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.087418+0000", 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5633000000000001e-05 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.087537+0000", 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119543 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.087582+0000", 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4146000000000001e-05 2024-09-22T01:35:00.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.089393+0000", 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001811226 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.089483+0000", 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0025999999999995e-05 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:401 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 2722870~26550] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.183502+0000", 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.6042048500000003, 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003583546, 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 401 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183502+0000", 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183502+0000", 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183505+0000", 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183537+0000", 2024-09-22T01:35:00.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2387e-05 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183574+0000", 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6792000000000003e-05 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183592+0000", 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7594000000000001e-05 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183765+0000", 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017329199999999999 2024-09-22T01:35:00.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.184174+0000", 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040908699999999998 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.184570+0000", 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00039599699999999998 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.186552+0000", 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019815039999999998 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.186919+0000", 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036720999999999998 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.187005+0000", 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6377000000000003e-05 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.187086+0000", 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0436e-05 2024-09-22T01:35:00.802 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:441 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 1698514~5422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.259092+0000", 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.5286152170000005, 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035962960000000001, 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.803 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 441 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259092+0000", 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259092+0000", 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259095+0000", 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.033e-06 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259116+0000", 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0964000000000001e-05 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259153+0000", 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7539000000000001e-05 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259171+0000", 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8122999999999999e-05 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259335+0000", 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016369900000000001 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259476+0000", 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014099199999999999 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259744+0000", 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026825200000000002 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.261485+0000", 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017411099999999999 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.262375+0000", 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088960000000000005 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.262560+0000", 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018467200000000001 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.262688+0000", 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128312 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:455 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.294520+0000", 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.4931870600000003, 2024-09-22T01:35:00.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038360400000000002, 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 455 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294520+0000", 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294520+0000", 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294523+0000", 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1930000000000002e-06 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294538+0000", 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4824000000000001e-05 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294572+0000", 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4452999999999997e-05 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294589+0000", 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6342999999999999e-05 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294735+0000", 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014678200000000001 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.295131+0000", 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000395423 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.295756+0000", 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062471599999999999 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298058+0000", 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002302662 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298164+0000", 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106156 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298265+0000", 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100416 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298356+0000", 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1071999999999998e-05 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.4594360139999996, 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.814 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:35:00.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.459292509, 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.819 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:00.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:35:00.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:35:00.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:35:00.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.824 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:460 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328544+0000", 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.4591626929999997, 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037580539999999998, 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 460 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328544+0000", 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328544+0000", 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328545+0000", 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3030000000000001e-06 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328553+0000", 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2799999999999998e-06 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328576+0000", 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3390000000000001e-05 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328594+0000", 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7537000000000002e-05 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328743+0000", 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014983499999999999 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328943+0000", 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00019979899999999999 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329312+0000", 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036868699999999998 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331648+0000", 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023359679999999999 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332048+0000", 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000399971 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332206+0000", 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000157725 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332302+0000", 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6558999999999995e-05 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:470 3.9 e26/22 3:95a7fb5f:::rbd_data.110fc6985e86.0000000000000005:head v 26'8, mlcod=26'6)", 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.339016+0000", 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.4486908500000002, 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022579660000000001, 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.339016+0000", 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.339016+0000", 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.339018+0000", 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2630000000000002e-06 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.339037+0000", 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8953e-05 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.339075+0000", 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.799e-05 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.339119+0000", 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3925999999999999e-05 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.339342+0000", 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022336900000000001 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.339377+0000", 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4792999999999997e-05 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.341157+0000", 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001779826 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.341274+0000", 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116846 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:501 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 747835~19156] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.419429+0000", 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.3682775840000003, 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029796340000000001, 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.834 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 501 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419429+0000", 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419429+0000", 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419433+0000", 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.343e-06 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419462+0000", 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.915e-05 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419500+0000", 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8742999999999998e-05 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419520+0000", 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9996e-05 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419649+0000", 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128293 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419795+0000", 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014619200000000001 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.420087+0000", 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000292145 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.421930+0000", 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018432279999999999 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.422229+0000", 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029903500000000001 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.422328+0000", 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8951999999999997e-05 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.422409+0000", 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0556999999999995e-05 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:514 3.0 3:023caaec:::rbd_data.110fc6985e86.0000000000000011:head [set-alloc-hint object_size 8388608 write_size 8388608,write 524288~47387] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.839 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.454885+0000", 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.3328217149999997, 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0031286930000000001, 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 514 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454885+0000", 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454885+0000", 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454888+0000", 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454934+0000", 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5745999999999999e-05 2024-09-22T01:35:00.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454970+0000", 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6566000000000002e-05 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454988+0000", 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7204e-05 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.455119+0000", 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013154200000000001 2024-09-22T01:35:00.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.455362+0000", 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024244800000000001 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.455602+0000", 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024033799999999999 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.457426+0000", 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018243230000000001 2024-09-22T01:35:00.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.457838+0000", 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00041149699999999998 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.457938+0000", 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100282 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.458014+0000", 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5840000000000006e-05 2024-09-22T01:35:00.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:519 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.489143+0000", 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.2985635489999998, 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003715168, 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 519 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489143+0000", 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489143+0000", 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489147+0000", 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0500000000000002e-06 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489164+0000", 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6629999999999998e-05 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489209+0000", 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4563e-05 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489234+0000", 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5636e-05 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489408+0000", 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017384900000000001 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489660+0000", 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025238799999999998 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489951+0000", 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029059499999999999 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.491583+0000", 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016318839999999999 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492558+0000", 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097499800000000003 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492727+0000", 2024-09-22T01:35:00.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016943899999999999 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492858+0000", 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013113600000000001 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:522 3.0 3:023caaec:::rbd_data.110fc6985e86.0000000000000011:head [truncate 2883584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.497897+0000", 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.2898102429999998, 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002816359, 2024-09-22T01:35:00.850 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 522 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497897+0000", 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497897+0000", 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497899+0000", 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3029999999999998e-06 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497911+0000", 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2527000000000001e-05 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497941+0000", 2024-09-22T01:35:00.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9635999999999999e-05 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497956+0000", 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.517e-05 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.498075+0000", 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119103 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.498224+0000", 2024-09-22T01:35:00.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014880500000000001 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.498430+0000", 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020570199999999999 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.499625+0000", 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001195261 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.500385+0000", 2024-09-22T01:35:00.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076031000000000004 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.500553+0000", 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167376 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.500713+0000", 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160166 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.855 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:547 3.0 3:023caaec:::rbd_data.110fc6985e86.0000000000000011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.560754+0000", 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.2269523949999996, 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027911469999999999, 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 547 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560754+0000", 2024-09-22T01:35:00.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560754+0000", 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560779+0000", 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4147000000000001e-05 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560792+0000", 2024-09-22T01:35:00.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3036e-05 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560829+0000", 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560847+0000", 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7286e-05 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560971+0000", 2024-09-22T01:35:00.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012449100000000001 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.561153+0000", 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000181533 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.561379+0000", 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022662600000000001 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.562490+0000", 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011111039999999999 2024-09-22T01:35:00.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.563345+0000", 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00085425099999999999 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.563454+0000", 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010930299999999999 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.563546+0000", 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1557000000000004e-05 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.860 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:689 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 505455~18833] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.970312+0000", 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.8173950689999998, 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00277991, 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 689 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970312+0000", 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970312+0000", 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970315+0000", 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8499999999999998e-06 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970343+0000", 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7963e-05 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970380+0000", 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.773e-05 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970398+0000", 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7240000000000001e-05 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970509+0000", 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111172 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970612+0000", 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103523 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970783+0000", 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017049900000000001 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.972334+0000", 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001550877 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.972968+0000", 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063434500000000003 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.973039+0000", 2024-09-22T01:35:00.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1475000000000003e-05 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.973092+0000", 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2235999999999999e-05 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:926 3.0 3:04479396:::rbd_id.image_client.0-clone2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.624791+0000", 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.1629161659999996, 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038771449999999998, 2024-09-22T01:35:00.866 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 926 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624791+0000", 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624791+0000", 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624793+0000", 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5069999999999999e-06 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624803+0000", 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7159999999999998e-06 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624827+0000", 2024-09-22T01:35:00.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3685000000000001e-05 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624840+0000", 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3472000000000001e-05 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624912+0000", 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1464999999999994e-05 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624918+0000", 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3239999999999999e-06 2024-09-22T01:35:00.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.627061+0000", 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021427379999999999 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.627157+0000", 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6825999999999998e-05 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.627290+0000", 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013283500000000001 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628069+0000", 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000779216 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628548+0000", 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00047880699999999998 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628616+0000", 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7842000000000005e-05 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628668+0000", 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1712000000000002e-05 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:4527 3.4 3:277b6bc9:::rbd_data.110ff3dda363.0000000000000025:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:58.625681+0000", 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 2.1620262459999999, 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025441489999999999, 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.872 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 4527 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625681+0000", 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625681+0000", 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625683+0000", 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2639999999999998e-06 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625691+0000", 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4950000000000008e-06 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625711+0000", 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.986e-05 2024-09-22T01:35:00.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625722+0000", 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625795+0000", 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3517999999999996e-05 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625879+0000", 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3183999999999995e-05 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.626012+0000", 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013331899999999999 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.627754+0000", 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017424140000000001 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.628111+0000", 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035656300000000001 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.628173+0000", 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2651999999999996e-05 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.628225+0000", 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1292000000000003e-05 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:4737 3.4 3:229a9282:::rbd_header.110f880def8d:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:59.961603+0000", 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.82610362100000001, 2024-09-22T01:35:00.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024672359999999998, 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 4737 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.961603+0000", 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.961603+0000", 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.961605+0000", 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9230000000000001e-06 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.961616+0000", 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0438999999999999e-05 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.961646+0000", 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0275000000000001e-05 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.961663+0000", 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7226000000000001e-05 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.961746+0000", 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2682000000000006e-05 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.961837+0000", 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1113000000000007e-05 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.962058+0000", 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022082300000000001 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.963217+0000", 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001158996 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.963952+0000", 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00073572899999999996 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.964022+0000", 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9494999999999998e-05 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:59.964070+0000", 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8535000000000002e-05 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5453 3.4 3:229a9282:::rbd_header.110f880def8d:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.375271+0000", 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.41243561299999998, 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024513719999999998, 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5453 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.375271+0000", 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.375271+0000", 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.375274+0000", 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.385e-06 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.375281+0000", 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.126e-06 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.375298+0000", 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7133999999999999e-05 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.375308+0000", 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7499999999999998e-06 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.375416+0000", 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000108764 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.375577+0000", 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016068500000000001 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.375944+0000", 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036685199999999998 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.377052+0000", 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011079989999999999 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.377588+0000", 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00053620199999999995 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.377664+0000", 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5914000000000005e-05 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.377723+0000", 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8560999999999997e-05 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5650 3.4 3:229a9282:::rbd_header.110f880def8d:head [call rbd.set_size in=11b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.752927+0000", 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.034780210999999998, 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025288049999999999, 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:00.888 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5650 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.752927+0000", 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.752927+0000", 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.752930+0000", 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8949999999999998e-06 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.752941+0000", 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.752965+0000", 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4179999999999999e-05 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.752977+0000", 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1671000000000001e-05 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.753121+0000", 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014388000000000001 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.753282+0000", 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000161392 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.753643+0000", 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036140500000000003 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.754683+0000", 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001039985 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.755303+0000", 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062005199999999995 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:00.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.755386+0000", 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2706000000000004e-05 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.755455+0000", 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9326999999999995e-05 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:00.893 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:00.894 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:00.894 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:00.895 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:00.896 INFO:teuthology.orchestra.run.smithi018.stdout:593 write 0xedad338 thru 0xedbcd40 (0xfa09 bytes) 2024-09-22T01:35:00.896 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.896 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.896 INFO:teuthology.orchestra.run.smithi018.stdout:596 read 0x5c9d0f1 thru 0x5ca241c (0x532c bytes) 2024-09-22T01:35:00.896 INFO:teuthology.orchestra.run.smithi018.stdout:597 writesame 0x7525a13 thru 0x752a5ce data_size 0x4a(0x4bbc bytes) 2024-09-22T01:35:00.896 INFO:teuthology.orchestra.run.smithi018.stdout:599 write 0x32d7b27 thru 0x32dad2f (0x3209 bytes) 2024-09-22T01:35:00.896 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:00.897 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:00.897 INFO:teuthology.orchestra.run.smithi018.stdout:601 write 0x56816f2 thru 0x5683a47 (0x2356 bytes) 2024-09-22T01:35:00.898 INFO:teuthology.orchestra.run.smithi018.stdout:603 write 0x4645ab4 thru 0x464efa7 (0x94f4 bytes) 2024-09-22T01:35:00.898 INFO:teuthology.orchestra.run.smithi018.stdout:604 read 0x6585a5c thru 0x65903ff (0xa9a4 bytes) 2024-09-22T01:35:00.898 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.898 INFO:teuthology.orchestra.run.smithi018.stdout:606 writesame 0xa6df543 thru 0xa6e8e7b data_size 0x19(0x9939 bytes) 2024-09-22T01:35:00.898 INFO:teuthology.orchestra.run.smithi018.stdout:610 read 0x164c795 thru 0x1659bb4 (0xd420 bytes) 2024-09-22T01:35:00.898 INFO:teuthology.orchestra.run.smithi018.stdout:611 read 0xc0c7b78 thru 0xc0cbd2a (0x41b3 bytes) 2024-09-22T01:35:00.898 INFO:teuthology.orchestra.run.smithi018.stdout:612 write 0x108352b thru 0x108ac28 (0x76fe bytes) 2024-09-22T01:35:00.898 INFO:teuthology.orchestra.run.smithi018.stdout:613 write 0xe58ef5 thru 0xe5a4f9 (0x1605 bytes) 2024-09-22T01:35:00.898 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:00.899 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:00.899 INFO:teuthology.orchestra.run.smithi018.stdout:615 writesame 0xd2c18dd thru 0xd2cb0ab data_size 0x1(0x97cf bytes) 2024-09-22T01:35:00.899 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:00.899 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:00.899 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:00.900 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:00.900 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:00.891+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:00.905 INFO:teuthology.orchestra.run.smithi018.stdout:617 write 0xc894498 thru 0xc89992c (0x5495 bytes) 2024-09-22T01:35:00.907 INFO:teuthology.orchestra.run.smithi018.stdout:618 write 0x7428447 thru 0x742b764 (0x331e bytes) 2024-09-22T01:35:00.909 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:00.909 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:00.909 INFO:teuthology.orchestra.run.smithi018.stdout:619 read 0xb54f7c6 thru 0xb55b994 (0xc1cf bytes) 2024-09-22T01:35:00.910 INFO:teuthology.orchestra.run.smithi018.stdout:620 read 0x916797 thru 0x9193d0 (0x2c3a bytes) 2024-09-22T01:35:00.910 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:00.916 INFO:teuthology.orchestra.run.smithi018.stdout:622 trunc from 0xedbcd41 to 0xb17274e 2024-09-22T01:35:00.933 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:00.933 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:00.934 INFO:teuthology.orchestra.run.smithi018.stdout:623 trunc from 0xb17274e to 0xe8c5b7c 2024-09-22T01:35:00.956 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:00.963 INFO:teuthology.orchestra.run.smithi018.stdout:624 trunc from 0xe8c5b7c to 0xc33631 2024-09-22T01:35:00.994 INFO:teuthology.orchestra.run.smithi018.stdout:625 write 0x881cab8 thru 0x881e851 (0x1d9a bytes) 2024-09-22T01:35:00.995 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:00.990+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:01.015 INFO:teuthology.orchestra.run.smithi018.stdout:626 writesame 0xe361e9c thru 0xe36df7a data_size 0x4f(0xc0df bytes) 2024-09-22T01:35:01.018 INFO:teuthology.orchestra.run.smithi018.stdout:627 write 0x6e14c15 thru 0x6e15c16 (0x1002 bytes) 2024-09-22T01:35:01.021 INFO:teuthology.orchestra.run.smithi018.stdout:628 write 0xd3e9710 thru 0xd3f30dc (0x99cd bytes) 2024-09-22T01:35:01.025 INFO:teuthology.orchestra.run.smithi018.stdout:629 read 0xb42ae4c thru 0xb434f9a (0xa14f bytes) 2024-09-22T01:35:01.025 INFO:teuthology.orchestra.run.smithi018.stdout:630 read 0x9d44de9 thru 0x9d4d422 (0x863a bytes) 2024-09-22T01:35:01.026 INFO:teuthology.orchestra.run.smithi018.stdout:632 write 0xa3d24c1 thru 0xa3d5dce (0x390e bytes) 2024-09-22T01:35:01.029 INFO:teuthology.orchestra.run.smithi018.stdout:633 writesame 0x493b7ca thru 0x493d1bb data_size 0x29(0x19f2 bytes) 2024-09-22T01:35:01.033 INFO:teuthology.orchestra.run.smithi018.stdout:634 read 0xcde30f8 thru 0xcdedb6c (0xaa75 bytes) 2024-09-22T01:35:01.034 INFO:teuthology.orchestra.run.smithi018.stdout:635 write 0x6f4ac05 thru 0x6f52dee (0x81ea bytes) 2024-09-22T01:35:01.037 INFO:teuthology.orchestra.run.smithi018.stdout:636 read 0xb7f5024 thru 0xb8014de (0xc4bb bytes) 2024-09-22T01:35:01.038 INFO:teuthology.orchestra.run.smithi018.stdout:637 write 0x4985119 thru 0x49901c1 (0xb0a9 bytes) 2024-09-22T01:35:01.040 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:01.040 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:01.042 INFO:teuthology.orchestra.run.smithi018.stdout:638 punch from 0x44fd02d to 0x4509c14, (0xcbe7 bytes) 2024-09-22T01:35:01.042 INFO:teuthology.orchestra.run.smithi018.stdout:639 read 0xdc7af12 thru 0xdc8862b (0xd71a bytes) 2024-09-22T01:35:01.042 INFO:teuthology.orchestra.run.smithi018.stdout:641 writesame 0xa079c4e thru 0xa0816df data_size 0x1d(0x7a92 bytes) 2024-09-22T01:35:01.045 INFO:teuthology.orchestra.run.smithi018.stdout:642 writesame 0xdc5f232 thru 0xdc6bc05 data_size 0x2(0xc9d4 bytes) 2024-09-22T01:35:01.058 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:01.059 INFO:teuthology.orchestra.run.smithi018.stdout:643 read 0x60079dc thru 0x600b0a9 (0x36ce bytes) 2024-09-22T01:35:01.060 INFO:teuthology.orchestra.run.smithi018.stdout:644 write 0xda8519e thru 0xda88012 (0x2e75 bytes) 2024-09-22T01:35:01.062 INFO:teuthology.orchestra.run.smithi018.stdout:646 punch from 0x7cf91e3 to 0x7d03d18, (0xab35 bytes) 2024-09-22T01:35:01.062 INFO:teuthology.orchestra.run.smithi018.stdout:647 read 0xaec5c9c thru 0xaed39e0 (0xdd45 bytes) 2024-09-22T01:35:01.063 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.063 INFO:teuthology.orchestra.run.smithi018.stdout:649 write 0xcb829c thru 0xcbf2cf (0x7034 bytes) 2024-09-22T01:35:01.074 INFO:teuthology.orchestra.run.smithi018.stdout:650 write 0xe4138e7 thru 0xe41b4b8 (0x7bd2 bytes) 2024-09-22T01:35:01.078 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.078 INFO:teuthology.orchestra.run.smithi018.stdout:653 punch from 0x3f1bd99 to 0x3f2331a, (0x7581 bytes) 2024-09-22T01:35:01.078 INFO:teuthology.orchestra.run.smithi018.stdout:654 read 0xaa8089f thru 0xaa8836f (0x7ad1 bytes) 2024-09-22T01:35:01.079 INFO:teuthology.orchestra.run.smithi018.stdout:655 read 0x10495ba thru 0x104ca90 (0x34d7 bytes) 2024-09-22T01:35:01.086 INFO:teuthology.orchestra.run.smithi018.stdout:657 trunc from 0xe41b4b9 to 0x99476dc 2024-09-22T01:35:01.096 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:01.090+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:01.121 INFO:teuthology.orchestra.run.smithi018.stdout:659 write 0xcb7f8ca thru 0xcb88e77 (0x95ae bytes) 2024-09-22T01:35:01.125 INFO:teuthology.orchestra.run.smithi018.stdout:660 write 0xa101b9 thru 0xa13dcc (0x3c14 bytes) 2024-09-22T01:35:01.127 INFO:teuthology.orchestra.run.smithi018.stdout:661 writesame 0x27b7913 thru 0x27bba6b data_size 0x1(0x4159 bytes) 2024-09-22T01:35:01.143 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.144 INFO:teuthology.orchestra.run.smithi018.stdout:663 write 0x7490f1f thru 0x749b90b (0xa9ed bytes) 2024-09-22T01:35:01.155 INFO:teuthology.orchestra.run.smithi018.stdout:665 trunc from 0xcb88e78 to 0x8a239e0 2024-09-22T01:35:01.188 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:01.189 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:01.193 INFO:teuthology.orchestra.run.smithi018.stdout:666 write 0xc0c27fe thru 0xc0ce22f (0xba32 bytes) 2024-09-22T01:35:01.197 INFO:teuthology.orchestra.run.smithi018.stdout:667 punch from 0xa9329fe to 0xa9335cc, (0xbce bytes) 2024-09-22T01:35:01.197 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.197 INFO:teuthology.orchestra.run.smithi018.stdout:670 writesame 0x886984 thru 0x88e201 data_size 0x6a(0x787e bytes) 2024-09-22T01:35:01.197 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:01.194+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:01.200 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.200 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.205 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:01.212 INFO:teuthology.orchestra.run.smithi018.stdout:675 write 0xd64d0d7 thru 0xd6518a5 (0x47cf bytes) 2024-09-22T01:35:01.216 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.216 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.216 INFO:teuthology.orchestra.run.smithi018.stdout:680 write 0x58a2ac0 thru 0x58aba18 (0x8f59 bytes) 2024-09-22T01:35:01.219 INFO:teuthology.orchestra.run.smithi018.stdout:681 punch from 0x362c6f3 to 0x3631384, (0x4c91 bytes) 2024-09-22T01:35:01.219 INFO:teuthology.orchestra.run.smithi018.stdout:683 writesame 0xeb0676 thru 0xeba3fa data_size 0x5(0x9d85 bytes) 2024-09-22T01:35:01.230 INFO:teuthology.orchestra.run.smithi018.stdout:684 write 0x9c62196 thru 0x9c64429 (0x2294 bytes) 2024-09-22T01:35:01.231 INFO:teuthology.orchestra.run.smithi018.stdout:685 read 0xbccea35 thru 0xbcd87d6 (0x9da2 bytes) 2024-09-22T01:35:01.233 INFO:teuthology.orchestra.run.smithi018.stdout:686 read 0x6b11fe1 thru 0x6b16960 (0x4980 bytes) 2024-09-22T01:35:01.233 INFO:teuthology.orchestra.run.smithi018.stdout:687 write 0x6a443cf thru 0x6a517d2 (0xd404 bytes) 2024-09-22T01:35:01.245 INFO:teuthology.orchestra.run.smithi018.stdout:688 write 0xd833bbb thru 0xd835489 (0x18cf bytes) 2024-09-22T01:35:01.262 INFO:teuthology.orchestra.run.smithi018.stdout:689 trunc from 0xd83548a to 0x5a0a779 2024-09-22T01:35:01.290 INFO:teuthology.orchestra.run.smithi018.stdout:690 write 0x83c0b3d thru 0x83cd224 (0xc6e8 bytes) 2024-09-22T01:35:01.298 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:01.295+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:01.311 INFO:teuthology.orchestra.run.smithi018.stdout:691 write 0xc852910 thru 0xc859b1e (0x720f bytes) 2024-09-22T01:35:01.314 INFO:teuthology.orchestra.run.smithi018.stdout:692 writesame 0xb5d193e thru 0xb5de2e4 data_size 0x13(0xc9a7 bytes) 2024-09-22T01:35:01.318 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.319 INFO:teuthology.orchestra.run.smithi018.stdout:694 read 0xa2bdb15 thru 0xa2be47a (0x966 bytes) 2024-09-22T01:35:01.319 INFO:teuthology.orchestra.run.smithi018.stdout:695 write 0x706db4c thru 0x7076a4e (0x8f03 bytes) 2024-09-22T01:35:01.323 INFO:teuthology.orchestra.run.smithi018.stdout:697 writesame 0xa2a285d thru 0xa2a5f9b data_size 0x1(0x373f bytes) 2024-09-22T01:35:01.339 INFO:teuthology.orchestra.run.smithi018.stdout:698 punch from 0x7b18730 to 0x7b22a72, (0xa342 bytes) 2024-09-22T01:35:01.339 INFO:teuthology.orchestra.run.smithi018.stdout:699 write 0x2ff81e6 thru 0x30010bd (0x8ed8 bytes) 2024-09-22T01:35:01.346 INFO:teuthology.orchestra.run.smithi018.stdout:700 write 0x85d220c thru 0x85d9413 (0x7208 bytes) 2024-09-22T01:35:01.347 INFO:teuthology.orchestra.run.smithi018.stdout:702 writesame 0xa052462 thru 0xa0549ad data_size 0x3e(0x254c bytes) 2024-09-22T01:35:01.349 INFO:teuthology.orchestra.run.smithi018.stdout:703 read 0x4f7e5 thru 0x5a0ff (0xa91b bytes) 2024-09-22T01:35:01.350 INFO:teuthology.orchestra.run.smithi018.stdout:705 read 0xc437a95 thru 0xc4462e8 (0xe854 bytes) 2024-09-22T01:35:01.351 INFO:teuthology.orchestra.run.smithi018.stdout:711 read 0x9b3778e thru 0x9b387eb (0x105e bytes) 2024-09-22T01:35:01.351 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:01.351 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:01.352 INFO:teuthology.orchestra.run.smithi018.stdout:712 write 0x76870cd thru 0x76891f8 (0x212c bytes) 2024-09-22T01:35:01.369 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:01.370 INFO:teuthology.orchestra.run.smithi018.stdout:715 write 0xe7e3547 thru 0xe7e621d (0x2cd7 bytes) 2024-09-22T01:35:01.372 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.373 INFO:teuthology.orchestra.run.smithi018.stdout:717 punch from 0x3b85313 to 0x3b92b78, (0xd865 bytes) 2024-09-22T01:35:01.373 INFO:teuthology.orchestra.run.smithi018.stdout:719 writesame 0xc81dc8a thru 0xc8277f9 data_size 0x18(0x9b70 bytes) 2024-09-22T01:35:01.379 INFO:teuthology.orchestra.run.smithi018.stdout:720 trunc from 0xe7e621e to 0xc65c990 2024-09-22T01:35:01.394 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.394 INFO:teuthology.orchestra.run.smithi018.stdout:722 read 0x5649ade thru 0x564eb6d (0x5090 bytes) 2024-09-22T01:35:01.395 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.395 INFO:teuthology.orchestra.run.smithi018.stdout:725 write 0xb8b2bbc thru 0xb8befeb (0xc430 bytes) 2024-09-22T01:35:01.398 INFO:teuthology.orchestra.run.smithi018.stdout:726 trunc from 0xc65c990 to 0xcb8e122 2024-09-22T01:35:01.398 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:01.395+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:01.406 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.406 INFO:teuthology.orchestra.run.smithi018.stdout:728 read 0x8e4520c thru 0x8e49a13 (0x4808 bytes) 2024-09-22T01:35:01.407 INFO:teuthology.orchestra.run.smithi018.stdout:729 punch from 0xb07c5e9 to 0xb08a648, (0xe05f bytes) 2024-09-22T01:35:01.407 INFO:teuthology.orchestra.run.smithi018.stdout:731 punch from 0x1e39cbe to 0x1e45517, (0xb859 bytes) 2024-09-22T01:35:01.422 INFO:teuthology.orchestra.run.smithi018.stdout:732 trunc from 0xcb8e122 to 0x44afa59 2024-09-22T01:35:01.438 INFO:teuthology.orchestra.run.smithi018.stdout:733 punch from 0x2991b8a to 0x2993a9b, (0x1f11 bytes) 2024-09-22T01:35:01.470 INFO:teuthology.orchestra.run.smithi018.stdout:734 write 0xe4e6259 thru 0xe4e9662 (0x340a bytes) 2024-09-22T01:35:01.474 INFO:teuthology.orchestra.run.smithi018.stdout:735 punch from 0x5aaeb1b to 0x5ab4be2, (0x60c7 bytes) 2024-09-22T01:35:01.474 INFO:teuthology.orchestra.run.smithi018.stdout:739 punch from 0x6cac044 to 0x6cb8a19, (0xc9d5 bytes) 2024-09-22T01:35:01.479 INFO:teuthology.orchestra.run.smithi018.stdout:740 trunc from 0xe4e9663 to 0xbde5f81 2024-09-22T01:35:01.499 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:01.494+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:01.509 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:01.509 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:01.514 INFO:teuthology.orchestra.run.smithi018.stdout:742 writesame 0xd53635d thru 0xd542d0d data_size 0x3(0xc9b1 bytes) 2024-09-22T01:35:01.516 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.516 INFO:teuthology.orchestra.run.smithi018.stdout:744 read 0xe960f3 thru 0xe9cad0 (0x69de bytes) 2024-09-22T01:35:01.517 INFO:teuthology.orchestra.run.smithi018.stdout:745 writesame 0x6a82874 thru 0x6a89d9c data_size 0x1(0x7529 bytes) 2024-09-22T01:35:01.524 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:01.557 INFO:teuthology.orchestra.run.smithi018.stdout:747 write 0x2d4360c thru 0x2d45799 (0x218e bytes) 2024-09-22T01:35:01.561 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.561 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.582 INFO:teuthology.orchestra.run.smithi018.stdout:750 trunc from 0xd542d0e to 0x5955a91 2024-09-22T01:35:01.603 INFO:teuthology.orchestra.run.smithi018.stdout:752 write 0x3255a05 thru 0x325d5a2 (0x7b9e bytes) 2024-09-22T01:35:01.606 INFO:teuthology.orchestra.run.smithi018.stdout:754 punch from 0x652d0 to 0x722b9, (0xcfe9 bytes) 2024-09-22T01:35:01.606 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.606 INFO:teuthology.orchestra.run.smithi018.stdout:758 write 0x1ac8b9b thru 0x1ad68c5 (0xdd2b bytes) 2024-09-22T01:35:01.608 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:01.606+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:01.644 INFO:teuthology.orchestra.run.smithi018.stdout:759 writesame 0xd7d970d thru 0xd7e91ae data_size 0x7(0xfaa2 bytes) 2024-09-22T01:35:01.646 INFO:teuthology.orchestra.run.smithi018.stdout:760 writesame 0x6ef5f77 thru 0x6efcd93 data_size 0x1(0x6e1d bytes) 2024-09-22T01:35:01.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:35:01.670 INFO:teuthology.orchestra.run.smithi018.stdout:761 read 0x2464b4c thru 0x246cb38 (0x7fed bytes) 2024-09-22T01:35:01.684 INFO:teuthology.orchestra.run.smithi018.stdout:763 trunc from 0xd7e91af to 0x8a712a0 2024-09-22T01:35:01.694 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:01.694 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:01.700 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.700 INFO:teuthology.orchestra.run.smithi018.stdout:766 writesame 0x1d36e05 thru 0x1d460cb data_size 0x1(0xf2c7 bytes) 2024-09-22T01:35:01.700 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:01.698+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:01.709 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:01.726 INFO:teuthology.orchestra.run.smithi018.stdout:767 read 0x84a6c thru 0x909ec (0xbf81 bytes) 2024-09-22T01:35:01.727 INFO:teuthology.orchestra.run.smithi018.stdout:768 read 0x65df759 thru 0x65e6c22 (0x74ca bytes) 2024-09-22T01:35:01.728 INFO:teuthology.orchestra.run.smithi018.stdout:769 read 0x4432b0f thru 0x443b756 (0x8c48 bytes) 2024-09-22T01:35:01.742 INFO:teuthology.orchestra.run.smithi018.stdout:770 trunc from 0x8a712a0 to 0xe508e39 2024-09-22T01:35:01.774 INFO:teuthology.orchestra.run.smithi018.stdout:771 trunc from 0xe508e39 to 0x4780421 2024-09-22T01:35:01.793 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:01.793 INFO:teuthology.orchestra.run.smithi018.stdout:774 clone 5 order 20 su 16384 sc 11 2024-09-22T01:35:01.802 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:01.798+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:01.883 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:01.883 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:01.897 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:01.941 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:01.942+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:02.003 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:02.002+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:02.065 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:02.065 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:02.079 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:02.104 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:02.103+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:02.204 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:02.202+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:02.243 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:02.243 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:02.257 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:02.345 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:02.346+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:02.406 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:02.403+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:02.425 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:02.425 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:02.439 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:02.507 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:02.507+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:02.601 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:35:02.605 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:02.605 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:02.607 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:02.606+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:02.620 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:02.709 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:02.710+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:02.709 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone4 from 0x4780421 (overlap 0xb277d4) to 0x6b14b2 2024-09-22T01:35:02.797 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:02.797 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:02.809 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:02.810+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:02.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:02.854 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-22T01:35:02.910 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:02.906+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:02.977 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:02.977 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:02.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:02.993 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:03.037 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:03.038+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:03.111 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:03.110+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:03.116 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:03.116 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:03.131 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:03.139 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:03.139 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:03.156 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:03.157 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:03.176 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:03.194 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:03.194 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:03.212 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:03.212 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:03.217 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:03.218+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:03.230 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:03.231 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:03.251 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:03.251 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:03.272 INFO:teuthology.orchestra.run.smithi018.stdout:775 write 0x6e349a5 thru 0x6e37e1b (0x3477 bytes) 2024-09-22T01:35:03.274 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:03.274 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:03.277 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:03.277 INFO:teuthology.orchestra.run.smithi018.stdout:779 writesame 0x40c5d91 thru 0x40d5b6b data_size 0x1(0xfddb bytes) 2024-09-22T01:35:03.310 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:03.310 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:03.310 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:03.311 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:03.311 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:03.319 INFO:teuthology.orchestra.run.smithi018.stdout:781 writesame 0x50e520e thru 0x50eba76 data_size 0x1(0x6869 bytes) 2024-09-22T01:35:03.319 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:03.318+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:03.325 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:03.341 INFO:teuthology.orchestra.run.smithi018.stdout:783 write 0x78567b4 thru 0x78632ba (0xcb07 bytes) 2024-09-22T01:35:03.351 INFO:teuthology.orchestra.run.smithi018.stdout:784 read 0x73b9238 thru 0x73c7163 (0xdf2c bytes) 2024-09-22T01:35:03.352 INFO:teuthology.orchestra.run.smithi018.stdout:785 punch from 0x220736a to 0x22131d2, (0xbe68 bytes) 2024-09-22T01:35:03.352 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:03.363 INFO:teuthology.orchestra.run.smithi018.stdout:787 writesame 0x84bddd2 thru 0x84c5f28 data_size 0x27(0x8157 bytes) 2024-09-22T01:35:03.363 INFO:teuthology.orchestra.run.smithi018.stdout:788 write 0x2f155d2 thru 0x2f1f05b (0x9a8a bytes) 2024-09-22T01:35:03.395 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:03.395 INFO:teuthology.orchestra.run.smithi018.stdout:791 read 0x1074fb8 thru 0x1079f6f (0x4fb8 bytes) 2024-09-22T01:35:03.395 INFO:teuthology.orchestra.run.smithi018.stdout:792 clone 6 order 19 su 2048 sc 5 2024-09-22T01:35:03.414 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:03.410+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:03.499 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:03.499 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:03.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.187817228, 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:35:03.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:35:03.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 29.00735164, 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014449178, 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.506 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489504+0000", 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489506+0000", 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6700000000000001e-06 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489518+0000", 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2323e-05 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489537+0000", 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8960000000000001e-05 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489551+0000", 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3243e-05 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497558+0000", 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0080073049999999993 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497686+0000", 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012775899999999999 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.497883+0000", 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000197622 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500679+0000", 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002795708 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503694+0000", 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030148739999999999 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503838+0000", 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014412499999999999 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.503954+0000", 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011558899999999999 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.511 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 29.007243331000002, 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014775508999999999, 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.512 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489613+0000", 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489614+0000", 2024-09-22T01:35:03.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6360000000000001e-06 2024-09-22T01:35:03.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489627+0000", 2024-09-22T01:35:03.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2493999999999999e-05 2024-09-22T01:35:03.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489656+0000", 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8770000000000001e-05 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489671+0000", 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4866e-05 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499567+0000", 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0098963839999999994 2024-09-22T01:35:03.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499697+0000", 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000130106 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.499889+0000", 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019192499999999999 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504109+0000", 2024-09-22T01:35:03.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0042195770000000004 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504146+0000", 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7639999999999999e-05 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504270+0000", 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123409 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504388+0000", 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000118702 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 29.007157625000001, 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.019730597999999998, 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.518 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 112 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489698+0000", 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489700+0000", 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.26e-06 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489899+0000", 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000199672 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489924+0000", 2024-09-22T01:35:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4136000000000001e-05 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489939+0000", 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5457000000000001e-05 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500788+0000", 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010848806000000001 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.500909+0000", 2024-09-22T01:35:03.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000121322 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.501195+0000", 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028595500000000001 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504533+0000", 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0033380369999999999 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509171+0000", 2024-09-22T01:35:03.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0046382649999999999 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509312+0000", 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014064200000000001 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509429+0000", 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117046 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 29.006887410000001, 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.021089374000000001, 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 113 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489969+0000", 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489970+0000", 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.426e-06 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.489982+0000", 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1547e-05 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490011+0000", 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9119e-05 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490024+0000", 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3667e-05 2024-09-22T01:35:03.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502168+0000", 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012143693000000001 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502411+0000", 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024248499999999999 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.502788+0000", 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00037754100000000001 2024-09-22T01:35:03.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504678+0000", 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0018899450000000001 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510804+0000", 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.006125836 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510947+0000", 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142712 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511058+0000", 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111403 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:35:03.529 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 29.006802221000001, 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.021258902999999999, 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 114 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:35:03.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490054+0000", 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490055+0000", 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490066+0000", 2024-09-22T01:35:03.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.097e-05 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490097+0000", 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0470000000000001e-05 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490112+0000", 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5213e-05 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504774+0000", 2024-09-22T01:35:03.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014662669999999999 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.504905+0000", 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013048500000000001 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.505109+0000", 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000204539 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509133+0000", 2024-09-22T01:35:03.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.004023403 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511078+0000", 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0019454749999999999 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511196+0000", 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011812200000000001 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511313+0000", 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000116286 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 29.006708612000001, 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.022115017000000001, 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.535 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 115 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490147+0000", 2024-09-22T01:35:03.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490149+0000", 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3769999999999999e-06 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490346+0000", 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00019744200000000001 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490363+0000", 2024-09-22T01:35:03.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6973000000000002e-05 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490374+0000", 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.06e-05 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.505802+0000", 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015427946999999999 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.506040+0000", 2024-09-22T01:35:03.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023778199999999999 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.506469+0000", 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042951300000000002 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509495+0000", 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030255199999999999 2024-09-22T01:35:03.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512030+0000", 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025350049999999999 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512162+0000", 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013271800000000001 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512262+0000", 2024-09-22T01:35:03.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010014 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 29.006460847, 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.02212739, 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.541 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 116 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490395+0000", 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490396+0000", 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0160000000000001e-06 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490404+0000", 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7039999999999994e-06 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490417+0000", 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.341e-05 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490425+0000", 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0160000000000008e-06 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.507941+0000", 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.017515414999999999 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.508122+0000", 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000181452 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.508335+0000", 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021324199999999999 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511427+0000", 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030917090000000002 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512288+0000", 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00086098100000000003 2024-09-22T01:35:03.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512420+0000", 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013192499999999999 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512523+0000", 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010252 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 29.006417296999999, 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.022626255000000001, 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 117 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490439+0000", 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490440+0000", 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.1600000000000001e-07 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490448+0000", 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0339999999999997e-06 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490486+0000", 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8065999999999998e-05 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.490500+0000", 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4583000000000001e-05 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509568+0000", 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.019067589999999999 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.509809+0000", 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000240738 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.510189+0000", 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000380281 2024-09-22T01:35:03.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.511540+0000", 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013514759999999999 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512847+0000", 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013063860000000001 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.512970+0000", 2024-09-22T01:35:03.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123106 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.513065+0000", 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5278999999999994e-05 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.491217793000001, 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014654660999999999, 2024-09-22T01:35:03.552 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 139 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:35:03.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005638+0000", 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005639+0000", 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8200000000000001e-07 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005642+0000", 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3330000000000001e-06 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005649+0000", 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7279999999999998e-06 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005654+0000", 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5790000000000003e-06 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017113+0000", 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011458822 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017220+0000", 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000107354 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.017393+0000", 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017226700000000001 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019736+0000", 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0023427639999999998 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020234+0000", 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000498856 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020267+0000", 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2160999999999999e-05 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020293+0000", 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6415e-05 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.491105934, 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015246857000000001, 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.558 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 140 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005750+0000", 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005751+0000", 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.34e-07 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005811+0000", 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9935999999999997e-05 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005821+0000", 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0617e-05 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005825+0000", 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0090000000000001e-06 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018312+0000", 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012486919000000001 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018371+0000", 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8548000000000003e-05 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.018462+0000", 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1254000000000004e-05 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019978+0000", 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0015163010000000001 2024-09-22T01:35:03.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020947+0000", 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00096895599999999998 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020976+0000", 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8731999999999999e-05 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020997+0000", 2024-09-22T01:35:03.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1151000000000001e-05 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.491008943000001, 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015779920999999999, 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:03.564 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 141 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005847+0000", 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005848+0000", 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1800000000000001e-07 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005851+0000", 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.878e-06 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005874+0000", 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3014e-05 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.005882+0000", 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019064+0000", 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.013182268 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019124+0000", 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9358000000000003e-05 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.019202+0000", 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7906999999999998e-05 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.020379+0000", 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0011774940000000001 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021577+0000", 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0011975759999999999 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021605+0000", 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7968000000000001e-05 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:35.021627+0000", 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2480000000000002e-05 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.569 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:5716 3.15 3:ad712b5b:::rbd_data.110f880def8d.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:00.851549+0000", 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 2.64530742, 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055485877000000003, 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 5716 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.851549+0000", 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.851549+0000", 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.851551+0000", 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3429999999999998e-06 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.851563+0000", 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1799e-05 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.851594+0000", 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1241000000000001e-05 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.851611+0000", 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6915999999999999e-05 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.851762+0000", 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000150841 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.851900+0000", 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013777900000000001 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 3", 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.860823+0000", 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0089231799999999993 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.906767+0000", 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.045944049000000001 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.906863+0000", 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5692000000000005e-05 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.906955+0000", 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2780000000000003e-05 2024-09-22T01:35:03.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.907035+0000", 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9257000000000004e-05 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop_reply(client.4367.0:5716 3.15 e31/22 ondisk, result = 0)", 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:00.888925+0000", 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 2.6079312319999999, 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.018126145, 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.575 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.888925+0000", 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.888925+0000", 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.888927+0000", 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.716e-06 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.888936+0000", 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4599999999999992e-06 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.888966+0000", 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9930999999999999e-05 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.888984+0000", 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7549000000000001e-05 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.906833+0000", 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.017849986000000002 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.906849+0000", 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5815e-05 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.907051+0000", 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000201688 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:6774 3.11 3:8bb1db3e:::rbd_data.110f880def8d.0000000000000007:7 [read 4489216~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:03.290209+0000", 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.206647149, 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014201597999999999, 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:03.579 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 6774 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290209+0000", 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290209+0000", 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290209+0000", 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4999999999999998e-07 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290211+0000", 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9649999999999998e-06 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290217+0000", 2024-09-22T01:35:03.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2049999999999999e-06 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290222+0000", 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.78e-06 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.304218+0000", 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.013995677999999999 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.304304+0000", 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6302000000000001e-05 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.304411+0000", 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010631799999999999 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:6775 3.11 3:8bb1db3e:::rbd_data.110f880def8d.0000000000000007:7 [read 4669440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:03.290229+0000", 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.20662751800000001, 2024-09-22T01:35:03.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014532155, 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 6775 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290229+0000", 2024-09-22T01:35:03.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290229+0000", 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290229+0000", 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8599999999999999e-07 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290236+0000", 2024-09-22T01:35:03.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0679999999999999e-06 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290242+0000", 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5270000000000004e-06 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290247+0000", 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7010000000000004e-06 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.304473+0000", 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014225977000000001 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.304594+0000", 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120905 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.304761+0000", 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016669100000000001 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:6776 3.11 3:8bb1db3e:::rbd_data.110f880def8d.0000000000000007:7 [read 4849664~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:03.290254+0000", 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.206602538, 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014727903000000001, 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 6776 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290254+0000", 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290254+0000", 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290254+0000", 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3799999999999998e-07 2024-09-22T01:35:03.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290259+0000", 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4219999999999999e-06 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290266+0000", 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4849999999999997e-06 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290271+0000", 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.028e-06 2024-09-22T01:35:03.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.304808+0000", 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014537289 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.304886+0000", 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8139000000000005e-05 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.304981+0000", 2024-09-22T01:35:03.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5202000000000001e-05 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:6777 3.11 3:8bb1db3e:::rbd_data.110f880def8d.0000000000000007:7 [read 5029888~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:03.290277+0000", 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.206579177, 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014913233, 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.592 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 6777 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290277+0000", 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290277+0000", 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290277+0000", 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290279+0000", 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290286+0000", 2024-09-22T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4339999999999997e-06 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290291+0000", 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0130000000000001e-06 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.305012+0000", 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014721843 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.305095+0000", 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2492999999999998e-05 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.305190+0000", 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5257e-05 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:6778 3.11 3:8bb1db3e:::rbd_data.110f880def8d.0000000000000007:7 [read 5210112~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32)", 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:03.290296+0000", 2024-09-22T01:35:03.596 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.206559669, 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.015493056, 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 6778 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290296+0000", 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290296+0000", 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290297+0000", 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6600000000000002e-07 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290299+0000", 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8050000000000001e-06 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290305+0000", 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4289999999999998e-06 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.290310+0000", 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9649999999999999e-06 2024-09-22T01:35:03.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.305266+0000", 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.014955601000000001 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.305500+0000", 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023449000000000001 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.305789+0000", 2024-09-22T01:35:03.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028939999999999999 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:6812 3.e 3:77d2973c:::rbd_data.110fdce50b12.0000000000000038:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:03.298915+0000", 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.197940914, 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.021673879, 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:03.601 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 6812 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.298915+0000", 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.298915+0000", 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.298918+0000", 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6299999999999998e-06 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.298931+0000", 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3162e-05 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.298967+0000", 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6217999999999998e-05 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.298987+0000", 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0288e-05 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.299145+0000", 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000157639 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.299614+0000", 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00046884699999999999 2024-09-22T01:35:03.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 4", 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.304110+0000", 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0044955799999999999 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.320148+0000", 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.016037976999999998 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.320291+0000", 2024-09-22T01:35:03.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014376999999999999 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.320464+0000", 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017257700000000001 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:03.320589+0000", 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125191 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:03.606 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:03.607 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:03.607 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:03.607 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:35:03.607 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-22T01:35:03.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-22T01:35:03.609 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:03.609 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:03.606+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:03.710 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:03.706+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:03.723 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone5 from 0x84c5f29 (overlap 0x4780421) to 0x23c0210 2024-09-22T01:35:03.763 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:7615 3.b e33/22 3:d606e1c6:::rbd_data.110fdce50b12.000000000000002e:head v 33'31, mlcod=30'29)", 2024-09-22T01:35:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:03.761248+0000", 2024-09-22T01:35:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0024206800000000001, 2024-09-22T01:35:03.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0024481260000000001, 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.761248+0000", 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.761248+0000", 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.761249+0000", 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.201e-06 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.761764+0000", 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00051525099999999999 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.761781+0000", 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6470999999999999e-05 2024-09-22T01:35:03.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.761790+0000", 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9190000000000005e-06 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.761858+0000", 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8672999999999998e-05 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.761885+0000", 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6282e-05 2024-09-22T01:35:03.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:7616 3.b e33/22 3:d606e1c6:::rbd_data.110fdce50b12.000000000000002e:head v 33'33, mlcod=30'29)", 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:03.763436+0000", 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.00023280999999999999, 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032431799999999998, 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.763436+0000", 2024-09-22T01:35:03.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.763436+0000", 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.763437+0000", 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7060000000000001e-06 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.763448+0000", 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0416e-05 2024-09-22T01:35:03.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.763464+0000", 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6551000000000001e-05 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.763473+0000", 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8689999999999993e-06 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.763549+0000", 2024-09-22T01:35:03.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5872999999999997e-05 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.763573+0000", 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3688000000000001e-05 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 2 2024-09-22T01:35:03.770 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:03.795 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:03.812 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:03.810+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:03.911 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:03.910+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:03.982 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-22T01:35:03.987 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:03.987 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:03.987 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:03.988 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:03.988 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:03.991 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:35:03.991 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 33, 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "2d4626ba-577e-46d9-ad53-8451e5733f43", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-22T01:34:18.722829+0000", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-22T01:35:03.602337+0000", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-22T01:34:31.284224+0000", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-22T01:34:21.023265+0000", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5806080, 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "noscrub", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-22T01:35:03.992 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 3, 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.993 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:31.452919+0000", 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:35:03.994 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "16", 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:35:03.995 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:35:03.996 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:35:03.997 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-22T01:35:03.998 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "rbd", 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:36.960578+0000", 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:35:03.999 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-22T01:35:04.000 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "20", 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:35:04.001 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 2, 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 20, 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:35:04.002 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:35:04.003 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.9900000095367432, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.9900000095367432, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.87999999523162842, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:35:04.004 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "pool_client.0", 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:46.686791+0000", 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:35:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:35:04.006 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "33", 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 8, 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 33, 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:35:04.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.008 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.009 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.010 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "8de621b1-0a3b-4b8b-b982-70e8db073085", 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-22T01:35:04.012 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/1213730345", 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/1213730345", 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/1213730345", 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/1213730345", 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "798cbd57-ebd4-461a-9bbf-68e683d1049e", 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.4805145263671875, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-22T01:35:04.018 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3361514324", 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3361514324", 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3361514324", 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3361514324", 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9294585f-3dc9-4b04-8cae-f8d78c92791e", 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-22T01:35:04.023 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-22T01:35:04.024 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/4002178714", 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/4002178714", 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/4002178714", 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/4002178714", 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:04.025 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "1ff1abf7-fdbb-4f8a-85e5-90f102abcec2", 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:04.026 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.028 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/2610959301", 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/2610959301", 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/2610959301", 2024-09-22T01:35:04.030 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/2610959301", 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9aa2579a-ada1-45f3-9341-f46697c28212", 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:04.031 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6824", 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6825", 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:04.032 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6826", 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6827", 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6830", 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6831", 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.034 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6828", 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6829", 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6825/482886379", 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6827/482886379", 2024-09-22T01:35:04.035 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6831/482886379", 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6829/482886379", 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4a6678eb-28ca-4b05-96ae-e9deeb60ca96", 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:04.036 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6816", 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6817", 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6818", 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6819", 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:04.038 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6822", 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6823", 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6820", 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6821", 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6817/2695689817", 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6819/2695689817", 2024-09-22T01:35:04.040 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6823/2695689817", 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6821/2695689817", 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "775b01e8-5705-4b98-a3ab-f15a78271355", 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:04.041 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6808", 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6809", 2024-09-22T01:35:04.042 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6810", 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6811", 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:04.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6814", 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6815", 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.044 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6812", 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6813", 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.045 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6809/1840779137", 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6811/1840779137", 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6815/1840779137", 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6813/1840779137", 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "15f6d6c1-8a16-42c6-9e43-f3a92e511735", 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6800", 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6801", 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6802", 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.048 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6803", 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6806", 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6807", 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:04.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6804", 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6805", 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:04.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6801/4222842386", 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6803/4222842386", 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6807/4222842386", 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6805/4222842386", 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:35:04.051 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.339566+0000", 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.065958+0000", 2024-09-22T01:35:04.052 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.261750+0000", 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:04.053 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.463117+0000", 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.557372+0000", 2024-09-22T01:35:04.054 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.195553+0000", 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:04.055 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.008891+0000", 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:27.839466+0000", 2024-09-22T01:35:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-22T01:35:04.057 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.058 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:04.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:04.061 INFO:tasks.thrashosds.thrasher:j is {'epoch': 33, 'fsid': '2d4626ba-577e-46d9-ad53-8451e5733f43', 'created': '2024-09-22T01:34:18.722829+0000', 'modified': '2024-09-22T01:35:03.602337+0000', 'last_up_change': '2024-09-22T01:34:31.284224+0000', 'last_in_change': '2024-09-22T01:34:21.023265+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-22T01:34:31.452919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-22T01:34:36.960578+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-22T01:34:46.686791+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 8, 'snap_epoch': 33, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}], 'osds': [{'osd': 0, 'uuid': '8de621b1-0a3b-4b8b-b982-70e8db073085', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6824', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6825', 'nonce': 1213730345}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6826', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6827', 'nonce': 1213730345}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6830', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6831', 'nonce': 1213730345}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6828', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6829', 'nonce': 1213730345}]}, 'public_addr': '172.21.15.18:6825/1213730345', 'cluster_addr': '172.21.15.18:6827/1213730345', 'heartbeat_back_addr': '172.21.15.18:6831/1213730345', 'heartbeat_front_addr': '172.21.15.18:6829/1213730345', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '798cbd57-ebd4-461a-9bbf-68e683d1049e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.4805145263671875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6800', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6801', 'nonce': 3361514324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6803', 'nonce': 3361514324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6807', 'nonce': 3361514324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6805', 'nonce': 3361514324}]}, 'public_addr': '172.21.15.18:6801/3361514324', 'cluster_addr': '172.21.15.18:6803/3361514324', 'heartbeat_back_addr': '172.21.15.18:6807/3361514324', 'heartbeat_front_addr': '172.21.15.18:6805/3361514324', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '9294585f-3dc9-4b04-8cae-f8d78c92791e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6817', 'nonce': 4002178714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6818', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6819', 'nonce': 4002178714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6822', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6823', 'nonce': 4002178714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6820', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6821', 'nonce': 4002178714}]}, 'public_addr': '172.21.15.18:6817/4002178714', 'cluster_addr': '172.21.15.18:6819/4002178714', 'heartbeat_back_addr': '172.21.15.18:6823/4002178714', 'heartbeat_front_addr': '172.21.15.18:6821/4002178714', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1ff1abf7-fdbb-4f8a-85e5-90f102abcec2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6809', 'nonce': 2610959301}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6811', 'nonce': 2610959301}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6815', 'nonce': 2610959301}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6813', 'nonce': 2610959301}]}, 'public_addr': '172.21.15.18:6809/2610959301', 'cluster_addr': '172.21.15.18:6811/2610959301', 'heartbeat_back_addr': '172.21.15.18:6815/2610959301', 'heartbeat_front_addr': '172.21.15.18:6813/2610959301', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '9aa2579a-ada1-45f3-9341-f46697c28212', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6824', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6825', 'nonce': 482886379}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6826', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6827', 'nonce': 482886379}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6830', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6831', 'nonce': 482886379}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6828', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6829', 'nonce': 482886379}]}, 'public_addr': '172.21.15.179:6825/482886379', 'cluster_addr': '172.21.15.179:6827/482886379', 'heartbeat_back_addr': '172.21.15.179:6831/482886379', 'heartbeat_front_addr': '172.21.15.179:6829/482886379', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4a6678eb-28ca-4b05-96ae-e9deeb60ca96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6816', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6817', 'nonce': 2695689817}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6818', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6819', 'nonce': 2695689817}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6822', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6823', 'nonce': 2695689817}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6820', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6821', 'nonce': 2695689817}]}, 'public_addr': '172.21.15.179:6817/2695689817', 'cluster_addr': '172.21.15.179:6819/2695689817', 'heartbeat_back_addr': '172.21.15.179:6823/2695689817', 'heartbeat_front_addr': '172.21.15.179:6821/2695689817', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '775b01e8-5705-4b98-a3ab-f15a78271355', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6808', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6809', 'nonce': 1840779137}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6810', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6811', 'nonce': 1840779137}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6814', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6815', 'nonce': 1840779137}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6812', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6813', 'nonce': 1840779137}]}, 'public_addr': '172.21.15.179:6809/1840779137', 'cluster_addr': '172.21.15.179:6811/1840779137', 'heartbeat_back_addr': '172.21.15.179:6815/1840779137', 'heartbeat_front_addr': '172.21.15.179:6813/1840779137', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '15f6d6c1-8a16-42c6-9e43-f3a92e511735', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6800', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6801', 'nonce': 4222842386}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6802', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6803', 'nonce': 4222842386}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6806', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6807', 'nonce': 4222842386}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6804', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6805', 'nonce': 4222842386}]}, 'public_addr': '172.21.15.179:6801/4222842386', 'cluster_addr': '172.21.15.179:6803/4222842386', 'heartbeat_back_addr': '172.21.15.179:6807/4222842386', 'heartbeat_front_addr': '172.21.15.179:6805/4222842386', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.339566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.065958+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.261750+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.463117+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.557372+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.195553+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.008891+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:27.839466+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-22T01:35:04.061 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:35:04.062 INFO:teuthology.orchestra.run.smithi018.stdout:793 write 0x86577e7 thru 0x865dcd2 (0x64ec bytes) 2024-09-22T01:35:04.062 INFO:teuthology.orchestra.run.smithi018.stdout:794 write 0xbdb0569 thru 0xbdb6554 (0x5fec bytes) 2024-09-22T01:35:04.062 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:04.058+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:04.063 INFO:teuthology.orchestra.run.smithi018.stdout:795 read 0x5bc77be thru 0x5bcd4be (0x5d01 bytes) 2024-09-22T01:35:04.063 INFO:teuthology.orchestra.run.smithi018.stdout:796 read 0xa060785 thru 0xa06e954 (0xe1d0 bytes) 2024-09-22T01:35:04.063 INFO:teuthology.orchestra.run.smithi018.stdout:798 clone 7 order 24 su 8388608 sc 3 2024-09-22T01:35:04.161 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:04.158+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:04.186 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:483 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.352981+0000", 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.8322121669999998, 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007806431, 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 483 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352981+0000", 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352981+0000", 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352983+0000", 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.497e-06 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.352997+0000", 2024-09-22T01:35:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3566e-05 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353034+0000", 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7799999999999997e-05 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353056+0000", 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1399999999999998e-05 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353192+0000", 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013588900000000001 2024-09-22T01:35:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.353336+0000", 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144196 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.354694+0000", 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013579690000000001 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360544+0000", 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058505720000000001 2024-09-22T01:35:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360586+0000", 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1465999999999999e-05 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360706+0000", 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119943 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.360787+0000", 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1132999999999997e-05 2024-09-22T01:35:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:556 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.569109+0000", 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.6160835379999998, 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072176740000000003, 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 556 2024-09-22T01:35:04.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569109+0000", 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569109+0000", 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569112+0000", 2024-09-22T01:35:04.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0170000000000001e-06 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569128+0000", 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6047000000000001e-05 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569162+0000", 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4199000000000002e-05 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569184+0000", 2024-09-22T01:35:04.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1206e-05 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569367+0000", 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000182969 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569967+0000", 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060015899999999996 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.571991+0000", 2024-09-22T01:35:04.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020240810000000001 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573950+0000", 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019593240000000001 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.576117+0000", 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021672200000000001 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.576256+0000", 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000138269 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.576327+0000", 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1182999999999999e-05 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:557 3.1 3:8188e96d:::rbd_object_map.110fc6985e86:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.569250+0000", 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.6159432089999992, 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096288420000000003, 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.197 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 557 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569250+0000", 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569250+0000", 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569251+0000", 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5e-06 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569261+0000", 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7929999999999992e-06 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569290+0000", 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8912999999999999e-05 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.569310+0000", 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0403000000000001e-05 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.572853+0000", 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035429369999999999 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.572942+0000", 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8760999999999999e-05 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:35:04.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.573389+0000", 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00044766100000000002 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.574748+0000", 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013586760000000001 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.578712+0000", 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0039640889999999996 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.578810+0000", 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8208999999999994e-05 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.578878+0000", 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7899999999999997e-05 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:638 3.1b 3:dba9c204:::rbd_data.110fc6985e86.0000000000000001:head [stat,truncate 3801088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.864722+0000", 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3204705909999994, 2024-09-22T01:35:04.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0085411020000000001, 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 638 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864722+0000", 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864722+0000", 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864725+0000", 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0309999999999999e-06 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864740+0000", 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.47e-05 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864788+0000", 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8457e-05 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.864913+0000", 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012486999999999999 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865070+0000", 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015637600000000001 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865284+0000", 2024-09-22T01:35:04.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021468400000000001 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.865628+0000", 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034399700000000002 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.867307+0000", 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016784059999999999 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.873152+0000", 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058457200000000004 2024-09-22T01:35:04.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.873212+0000", 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9775999999999998e-05 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.873263+0000", 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1085000000000003e-05 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:764 3.6 3:6277f7f1:::rbd_data.110fc6985e86.0000000000000013:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.124104+0000", 2024-09-22T01:35:04.207 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0610890650000009, 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0086580210000000001, 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 764 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124104+0000", 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124104+0000", 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124105+0000", 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.528e-06 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124113+0000", 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8050000000000007e-06 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124129+0000", 2024-09-22T01:35:04.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6364000000000001e-05 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124142+0000", 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2281e-05 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124227+0000", 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5395999999999994e-05 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.124339+0000", 2024-09-22T01:35:04.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011228199999999999 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.125728+0000", 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0013882810000000001 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132635+0000", 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006907219 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132654+0000", 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9347999999999998e-05 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132710+0000", 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5649000000000002e-05 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.132762+0000", 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1867999999999999e-05 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5099 3.17 3:eb693c2c:::rbd_data.110ff3dda363.0000000000000018:6 [sparse-read 196608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:04.212 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.009244+0000", 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1759490230000003, 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0068679650000000002, 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5099 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009244+0000", 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009244+0000", 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009244+0000", 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.01e-07 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009253+0000", 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8319999999999995e-06 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009260+0000", 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2779999999999996e-06 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009266+0000", 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5720000000000002e-06 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.015639+0000", 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006373007 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.015781+0000", 2024-09-22T01:35:04.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000141889 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.016112+0000", 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033098600000000002 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5100 3.17 3:eb693c2c:::rbd_data.110ff3dda363.0000000000000018:6 [sparse-read 1114112~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.009274+0000", 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1759191290000004, 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072243200000000002, 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5100 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009274+0000", 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009274+0000", 2024-09-22T01:35:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009274+0000", 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3799999999999997e-07 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009276+0000", 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2529999999999999e-06 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009283+0000", 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8580000000000002e-06 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009288+0000", 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000004e-06 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.016172+0000", 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0068832269999999996 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.016318+0000", 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014615 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.016498+0000", 2024-09-22T01:35:04.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000180104 2024-09-22T01:35:04.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.220 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.220 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5101 3.17 3:eb693c2c:::rbd_data.110ff3dda363.0000000000000018:6 [sparse-read 2031616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:04.220 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.009295+0000", 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.175897408, 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0075616499999999996, 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5101 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009295+0000", 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009295+0000", 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009296+0000", 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2799999999999996e-07 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009298+0000", 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9850000000000001e-06 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009304+0000", 2024-09-22T01:35:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.122e-06 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.009311+0000", 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9709999999999998e-06 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.016554+0000", 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0072434960000000003 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.016692+0000", 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013791300000000001 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.016857+0000", 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164635 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5360 3.12 3:4d6b96be:::rbd_data.110f880def8d.000000000000000a:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.077716+0000", 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.107476653, 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.033529694999999998, 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5360 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.077716+0000", 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.077716+0000", 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.077718+0000", 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7889999999999999e-06 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.077726+0000", 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6690000000000006e-06 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.077743+0000", 2024-09-22T01:35:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6985000000000001e-05 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.077753+0000", 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0427e-05 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.077829+0000", 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5945000000000006e-05 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.077891+0000", 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1964999999999994e-05 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 7", 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.082664+0000", 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047730430000000003 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.111131+0000", 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.028467337999999998 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.111149+0000", 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7822e-05 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.111198+0000", 2024-09-22T01:35:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9373000000000003e-05 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.111246+0000", 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7339000000000002e-05 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5392 3.12 3:4d6b96be:::rbd_data.110f880def8d.000000000000000a:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.250423+0000", 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 3.9347700530000003, 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006783547, 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5392 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.250423+0000", 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.250423+0000", 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.250425+0000", 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.835e-06 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.250431+0000", 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9879999999999998e-06 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.250459+0000", 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7912e-05 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.250472+0000", 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2344000000000001e-05 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.250628+0000", 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015586899999999999 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.250774+0000", 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014643300000000001 2024-09-22T01:35:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 7", 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.250993+0000", 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000218822 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.252891+0000", 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018985720000000001 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.257053+0000", 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0041611130000000001 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.257140+0000", 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7000000000000001e-05 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.257206+0000", 2024-09-22T01:35:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6659e-05 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5647 3.12 3:4d6b96be:::rbd_data.110f880def8d.000000000000000a:head [stat,zero 4194304~10485760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.740472+0000", 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 3.4447208229999999, 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011438680999999999, 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5647 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.740472+0000", 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.740472+0000", 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.740476+0000", 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0260000000000001e-06 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.740492+0000", 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6409000000000002e-05 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.740542+0000", 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0117999999999997e-05 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.740569+0000", 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6251999999999999e-05 2024-09-22T01:35:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.740684+0000", 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011534 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.740804+0000", 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011971799999999999 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.751911+0000", 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011106817999999999 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:5683 3.12 3:4d6b96be:::rbd_data.110f880def8d.000000000000000a:head [stat,zero 1459605~2734699] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:00.780663+0000", 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 3.404529879, 2024-09-22T01:35:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0077057560000000002, 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 5683 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.780663+0000", 2024-09-22T01:35:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.780663+0000", 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.780665+0000", 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1179999999999999e-06 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.780674+0000", 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9330000000000007e-06 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.780701+0000", 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7039999999999999e-05 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.780711+0000", 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6150000000000003e-06 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.780773+0000", 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2582999999999994e-05 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.780870+0000", 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7301999999999998e-05 2024-09-22T01:35:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:00.788369+0000", 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074981650000000002 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:7042 3.12 3:4c8ee37a:::rbd_data.110fdce50b12.000000000000002c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write 294912~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:03.379426+0000", 2024-09-22T01:35:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.80576677299999999, 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0089849170000000003, 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7042 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.379426+0000", 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.379426+0000", 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.379427+0000", 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5340000000000001e-06 2024-09-22T01:35:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.380168+0000", 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00074011900000000002 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.380188+0000", 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9898000000000002e-05 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.380199+0000", 2024-09-22T01:35:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1194e-05 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.380279+0000", 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9810999999999999e-05 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.380408+0000", 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000129004 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 7", 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.380656+0000", 2024-09-22T01:35:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024860699999999997 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.383566+0000", 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002909853 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.388281+0000", 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047145939999999999 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.388354+0000", 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3227999999999998e-05 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.388411+0000", 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7074999999999998e-05 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:7149 3.12 3:4c8ee37a:::rbd_data.110fdce50b12.000000000000002c:head [stat,delete] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:03.727333+0000", 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.45785969700000001, 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0096364959999999996, 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7149 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.727333+0000", 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.727333+0000", 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.727335+0000", 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0889999999999998e-06 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.727343+0000", 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9889999999999992e-06 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.727367+0000", 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3777e-05 2024-09-22T01:35:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.727379+0000", 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1686e-05 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.727478+0000", 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9124999999999997e-05 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.727567+0000", 2024-09-22T01:35:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9442000000000002e-05 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 7", 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.727761+0000", 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00019408500000000001 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.729540+0000", 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001778331 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.736881+0000", 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0073418090000000004 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.736919+0000", 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7258000000000001e-05 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.736970+0000", 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0905000000000001e-05 2024-09-22T01:35:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:7613 3.17 3:e9ec9022:::rbd_object_map.110fdce50b12.0000000000000008:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:03.752433+0000", 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.432759746, 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0074567239999999996, 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7613 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.752433+0000", 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.752433+0000", 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.752434+0000", 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5700000000000001e-07 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.752442+0000", 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3960000000000006e-06 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.752452+0000", 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0237e-05 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.752460+0000", 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8380000000000002e-06 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.753616+0000", 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011561550000000001 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.753703+0000", 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6193999999999995e-05 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5", 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.753937+0000", 2024-09-22T01:35:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000234448 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.754684+0000", 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00074735399999999999 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.759793+0000", 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051089489999999998 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.759835+0000", 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2045999999999997e-05 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.759890+0000", 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4249999999999997e-05 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:7819 3.17 3:e9ec9022:::rbd_object_map.110fdce50b12.0000000000000008:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-22T01:35:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:03.786003+0000", 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.39918956300000003, 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.016745023000000001, 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 7819 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.786003+0000", 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.786003+0000", 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.786005+0000", 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.779e-06 2024-09-22T01:35:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.786014+0000", 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0759999999999992e-06 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.786033+0000", 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9327999999999999e-05 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.786041+0000", 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8679999999999999e-06 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.786111+0000", 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9831000000000003e-05 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.786216+0000", 2024-09-22T01:35:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010458099999999999 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5", 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.786558+0000", 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034211199999999999 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.787460+0000", 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000902343 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.802648+0000", 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.015187511000000001 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.802706+0000", 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8835000000000002e-05 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.802748+0000", 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1758999999999998e-05 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:9182 3.1b 3:db76ed0b:::rbd_data.110fdce50b12.0000000000000021:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:03.874234+0000", 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.31095851899999999, 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007648424, 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 9182 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.874234+0000", 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.874234+0000", 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.874235+0000", 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1909999999999999e-06 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875203+0000", 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00096780800000000001 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875219+0000", 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5622999999999999e-05 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875229+0000", 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0327e-05 2024-09-22T01:35:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875319+0000", 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9374000000000002e-05 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875471+0000", 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015236899999999999 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:35:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875757+0000", 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00028624 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.881450+0000", 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0056931819999999998 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.881773+0000", 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032298800000000002 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.881830+0000", 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7024999999999997e-05 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.881883+0000", 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2296999999999998e-05 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:9183 3.1b 3:db76ed0b:::rbd_data.110fdce50b12.0000000000000021:head [truncate 262672] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:03.875267+0000", 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.30992605099999998, 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076715760000000003, 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 9183 2024-09-22T01:35:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875267+0000", 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875267+0000", 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875268+0000", 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3799999999999996e-07 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875271+0000", 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9049999999999999e-06 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875282+0000", 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0188e-05 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875288+0000", 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7349999999999999e-06 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.878008+0000", 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002719918 2024-09-22T01:35:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.878095+0000", 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6322999999999993e-05 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.878252+0000", 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000157307 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.881456+0000", 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003203769 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.882841+0000", 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001385715 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.882901+0000", 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9305000000000002e-05 2024-09-22T01:35:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.882938+0000", 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7573000000000001e-05 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:9188 3.1b 3:da46de0b:::rbd_data.110fdce50b12.0000000000000025:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,truncate 262144] snapc 8=[8] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:03.875957+0000", 2024-09-22T01:35:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.30923546099999999, 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.007786248, 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 9188 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875957+0000", 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875957+0000", 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875958+0000", 2024-09-22T01:35:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:35:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875972+0000", 2024-09-22T01:35:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4e-05 2024-09-22T01:35:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875984+0000", 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1626e-05 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.875992+0000", 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.909e-06 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.880815+0000", 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004823356 2024-09-22T01:35:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.880965+0000", 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014977100000000001 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.881155+0000", 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00019011500000000001 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.881894+0000", 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00073873299999999999 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.883670+0000", 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017760359999999999 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.883706+0000", 2024-09-22T01:35:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5936999999999998e-05 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:03.883744+0000", 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7877999999999999e-05 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:9342 3.1 3:81f3f99e:::rbd_data.110f42c29252.0000000000000177:head [set-alloc-hint object_size 524288 write_size 524288,write 460137~4759] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-22T01:35:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.055414+0000", 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.12977914600000001, 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0068269810000000002, 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 9342 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.055414+0000", 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.055414+0000", 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.055414+0000", 2024-09-22T01:35:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9100000000000002e-07 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.055422+0000", 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.841e-06 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.055435+0000", 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2666e-05 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.055441+0000", 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.195e-06 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.055516+0000", 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4737e-05 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.055629+0000", 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011283800000000001 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 4", 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.055761+0000", 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013202600000000001 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.056597+0000", 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00083592300000000003 2024-09-22T01:35:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.062167+0000", 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055705529999999998 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.062210+0000", 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3112000000000003e-05 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.062241+0000", 2024-09-22T01:35:04.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0199e-05 2024-09-22T01:35:04.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.302 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.302 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.302 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:04.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:04.304 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:04.302+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:04.375 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:35:04.375 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:35:04.394 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-22T01:35:03.611498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":221502491,"num_objects":93,"num_object_clones":15,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":13,"num_read":9481,"num_read_kb":7311,"num_write":1532,"num_write_kb":10786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1451,"ondisk_log_size":1451,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253144,"kb_used_data":7812,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721576,"statfs":{"total":773094113280,"available":772834893824,"internally_reserved":0,"allocated":7999488,"data_stored":5958778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":133976175,"num_objects":51,"num_object_clones":7,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":5,"num_read":6438,"num_read_kb":3889,"num_write":703,"num_write_kb":5213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.124527"},"pg_stats":[{"pgid":"3.1f","version":"30'10","reported_seq":50,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.590941+0000","last_change":"2024-09-22T01:34:50.545852+0000","last_active":"2024-09-22T01:34:59.590941+0000","last_peered":"2024-09-22T01:34:59.590941+0000","last_clean":"2024-09-22T01:34:59.590941+0000","last_became_active":"2024-09-22T01:34:48.538942+0000","last_became_peered":"2024-09-22T01:34:48.538942+0000","last_unstale":"2024-09-22T01:34:59.590941+0000","last_undegraded":"2024-09-22T01:34:59.590941+0000","last_fullsized":"2024-09-22T01:34:59.590941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:45:06.364718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001437504,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":16,"num_write":11,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"30'4","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.585653+0000","last_change":"2024-09-22T01:34:50.528432+0000","last_active":"2024-09-22T01:34:59.585653+0000","last_peered":"2024-09-22T01:34:59.585653+0000","last_clean":"2024-09-22T01:34:59.585653+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:34:59.585653+0000","last_undegraded":"2024-09-22T01:34:59.585653+0000","last_fullsized":"2024-09-22T01:34:59.585653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:54:13.094182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00178118,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.595983+0000","last_change":"2024-09-22T01:34:50.542416+0000","last_active":"2024-09-22T01:34:59.595983+0000","last_peered":"2024-09-22T01:34:59.595983+0000","last_clean":"2024-09-22T01:34:59.595983+0000","last_became_active":"2024-09-22T01:34:48.547909+0000","last_became_peered":"2024-09-22T01:34:48.547909+0000","last_unstale":"2024-09-22T01:34:59.595983+0000","last_undegraded":"2024-09-22T01:34:59.595983+0000","last_fullsized":"2024-09-22T01:34:59.595983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:08:39.741197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031538109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"31'14","reported_seq":325,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.884130+0000","last_change":"2024-09-22T01:34:50.541509+0000","last_active":"2024-09-22T01:34:59.884130+0000","last_peered":"2024-09-22T01:34:59.884130+0000","last_clean":"2024-09-22T01:34:59.884130+0000","last_became_active":"2024-09-22T01:34:48.546869+0000","last_became_peered":"2024-09-22T01:34:48.546869+0000","last_unstale":"2024-09-22T01:34:59.884130+0000","last_undegraded":"2024-09-22T01:34:59.884130+0000","last_fullsized":"2024-09-22T01:34:59.884130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:04:04.113583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025435940000000001,"stat_sum":{"num_bytes":7264094,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":287,"num_read_kb":46,"num_write":13,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"30'82","reported_seq":538,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:00.020352+0000","last_change":"2024-09-22T01:34:50.546172+0000","last_active":"2024-09-22T01:35:00.020352+0000","last_peered":"2024-09-22T01:35:00.020352+0000","last_clean":"2024-09-22T01:35:00.020352+0000","last_became_active":"2024-09-22T01:34:48.545744+0000","last_became_peered":"2024-09-22T01:34:48.545744+0000","last_unstale":"2024-09-22T01:35:00.020352+0000","last_undegraded":"2024-09-22T01:35:00.020352+0000","last_fullsized":"2024-09-22T01:35:00.020352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:56:37.155800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015758949999999999,"stat_sum":{"num_bytes":7201438,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1110,"num_read_kb":1068,"num_write":81,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"29'78","reported_seq":331,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.753396+0000","last_change":"2024-09-22T01:34:50.527581+0000","last_active":"2024-09-22T01:35:01.753396+0000","last_peered":"2024-09-22T01:35:01.753396+0000","last_clean":"2024-09-22T01:35:01.753396+0000","last_became_active":"2024-09-22T01:34:48.539769+0000","last_became_peered":"2024-09-22T01:34:48.539769+0000","last_unstale":"2024-09-22T01:35:01.753396+0000","last_undegraded":"2024-09-22T01:35:01.753396+0000","last_fullsized":"2024-09-22T01:35:01.753396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:45:19.546749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088464700000000002,"stat_sum":{"num_bytes":1098338,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":574,"num_read_kb":494,"num_write":123,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"31'91","reported_seq":226,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.780188+0000","last_change":"2024-09-22T01:34:50.534647+0000","last_active":"2024-09-22T01:35:01.780188+0000","last_peered":"2024-09-22T01:35:01.780188+0000","last_clean":"2024-09-22T01:35:01.780188+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:35:01.780188+0000","last_undegraded":"2024-09-22T01:35:01.780188+0000","last_fullsized":"2024-09-22T01:35:01.780188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:20:28.124730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039451500000000001,"stat_sum":{"num_bytes":21096958,"num_objects":7,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":178,"num_read_kb":294,"num_write":67,"num_write_kb":842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.585774+0000","last_change":"2024-09-22T01:34:50.529078+0000","last_active":"2024-09-22T01:34:59.585774+0000","last_peered":"2024-09-22T01:34:59.585774+0000","last_clean":"2024-09-22T01:34:59.585774+0000","last_became_active":"2024-09-22T01:34:48.532778+0000","last_became_peered":"2024-09-22T01:34:48.532778+0000","last_unstale":"2024-09-22T01:34:59.585774+0000","last_undegraded":"2024-09-22T01:34:59.585774+0000","last_fullsized":"2024-09-22T01:34:59.585774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:56:42.071823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"31'56","reported_seq":278,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.689686+0000","last_change":"2024-09-22T01:34:50.546601+0000","last_active":"2024-09-22T01:35:01.689686+0000","last_peered":"2024-09-22T01:35:01.689686+0000","last_clean":"2024-09-22T01:35:01.689686+0000","last_became_active":"2024-09-22T01:34:48.538549+0000","last_became_peered":"2024-09-22T01:34:48.538549+0000","last_unstale":"2024-09-22T01:35:01.689686+0000","last_undegraded":"2024-09-22T01:35:01.689686+0000","last_fullsized":"2024-09-22T01:35:01.689686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:33:34.782602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015742040000000001,"stat_sum":{"num_bytes":6815744,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":507,"num_read_kb":432,"num_write":41,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'64","reported_seq":105,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.781637+0000","last_change":"2024-09-22T01:34:50.539978+0000","last_active":"2024-09-22T01:35:01.781637+0000","last_peered":"2024-09-22T01:35:01.781637+0000","last_clean":"2024-09-22T01:35:01.781637+0000","last_became_active":"2024-09-22T01:34:48.540201+0000","last_became_peered":"2024-09-22T01:34:48.540201+0000","last_unstale":"2024-09-22T01:35:01.781637+0000","last_undegraded":"2024-09-22T01:35:01.781637+0000","last_fullsized":"2024-09-22T01:35:01.781637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:40.614184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000879137,"stat_sum":{"num_bytes":8770979,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":69,"num_write":39,"num_write_kb":648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"31'25","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.691365+0000","last_change":"2024-09-22T01:34:50.688367+0000","last_active":"2024-09-22T01:35:01.691365+0000","last_peered":"2024-09-22T01:35:01.691365+0000","last_clean":"2024-09-22T01:35:01.691365+0000","last_became_active":"2024-09-22T01:34:48.543053+0000","last_became_peered":"2024-09-22T01:34:48.543053+0000","last_unstale":"2024-09-22T01:35:01.691365+0000","last_undegraded":"2024-09-22T01:35:01.691365+0000","last_fullsized":"2024-09-22T01:35:01.691365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:58:16.134140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016832139999999999,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":12,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"31'69","reported_seq":345,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.689632+0000","last_change":"2024-09-22T01:34:50.527946+0000","last_active":"2024-09-22T01:35:01.689632+0000","last_peered":"2024-09-22T01:35:01.689632+0000","last_clean":"2024-09-22T01:35:01.689632+0000","last_became_active":"2024-09-22T01:34:48.546523+0000","last_became_peered":"2024-09-22T01:34:48.546523+0000","last_unstale":"2024-09-22T01:35:01.689632+0000","last_undegraded":"2024-09-22T01:35:01.689632+0000","last_fullsized":"2024-09-22T01:35:01.689632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:38:43.968428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092607900000000001,"stat_sum":{"num_bytes":5768262,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":715,"num_read_kb":628,"num_write":53,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.598853+0000","last_change":"2024-09-22T01:34:41.008254+0000","last_active":"2024-09-22T01:34:59.598853+0000","last_peered":"2024-09-22T01:34:59.598853+0000","last_clean":"2024-09-22T01:34:59.598853+0000","last_became_active":"2024-09-22T01:34:38.361626+0000","last_became_peered":"2024-09-22T01:34:38.361626+0000","last_unstale":"2024-09-22T01:34:59.598853+0000","last_undegraded":"2024-09-22T01:34:59.598853+0000","last_fullsized":"2024-09-22T01:34:59.598853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:26:46.322642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'11","reported_seq":76,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:00.017004+0000","last_change":"2024-09-22T01:34:50.546215+0000","last_active":"2024-09-22T01:35:00.017004+0000","last_peered":"2024-09-22T01:35:00.017004+0000","last_clean":"2024-09-22T01:35:00.017004+0000","last_became_active":"2024-09-22T01:34:48.524396+0000","last_became_peered":"2024-09-22T01:34:48.524396+0000","last_unstale":"2024-09-22T01:35:00.017004+0000","last_undegraded":"2024-09-22T01:35:00.017004+0000","last_fullsized":"2024-09-22T01:35:00.017004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:10.553964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014179189999999999,"stat_sum":{"num_bytes":1310720,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":31,"num_read_kb":11,"num_write":12,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.637753+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:34:59.637753+0000","last_peered":"2024-09-22T01:34:59.637753+0000","last_clean":"2024-09-22T01:34:59.637753+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:34:59.637753+0000","last_undegraded":"2024-09-22T01:34:59.637753+0000","last_fullsized":"2024-09-22T01:34:59.637753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"31'22","reported_seq":73,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.865945+0000","last_change":"2024-09-22T01:34:50.528938+0000","last_active":"2024-09-22T01:34:59.865945+0000","last_peered":"2024-09-22T01:34:59.865945+0000","last_clean":"2024-09-22T01:34:59.865945+0000","last_became_active":"2024-09-22T01:34:48.530271+0000","last_became_peered":"2024-09-22T01:34:48.530271+0000","last_unstale":"2024-09-22T01:34:59.865945+0000","last_undegraded":"2024-09-22T01:34:59.865945+0000","last_fullsized":"2024-09-22T01:34:59.865945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:00.078769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001738353,"stat_sum":{"num_bytes":5374056,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":41,"num_read_kb":94,"num_write":21,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.604439+0000","last_change":"2024-09-22T01:34:41.143159+0000","last_active":"2024-09-22T01:34:59.604439+0000","last_peered":"2024-09-22T01:34:59.604439+0000","last_clean":"2024-09-22T01:34:59.604439+0000","last_became_active":"2024-09-22T01:34:38.384953+0000","last_became_peered":"2024-09-22T01:34:38.384953+0000","last_unstale":"2024-09-22T01:34:59.604439+0000","last_undegraded":"2024-09-22T01:34:59.604439+0000","last_fullsized":"2024-09-22T01:34:59.604439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:57:56.085174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"31'86","reported_seq":969,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.795001+0000","last_change":"2024-09-22T01:34:50.525840+0000","last_active":"2024-09-22T01:35:01.795001+0000","last_peered":"2024-09-22T01:35:01.795001+0000","last_clean":"2024-09-22T01:35:01.795001+0000","last_became_active":"2024-09-22T01:34:48.532189+0000","last_became_peered":"2024-09-22T01:34:48.532189+0000","last_unstale":"2024-09-22T01:35:01.795001+0000","last_undegraded":"2024-09-22T01:35:01.795001+0000","last_fullsized":"2024-09-22T01:35:01.795001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:16.888707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078463999999999997,"stat_sum":{"num_bytes":13774792,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":1416,"num_read_kb":893,"num_write":85,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.590755+0000","last_change":"2024-09-22T01:34:48.536842+0000","last_active":"2024-09-22T01:34:59.590755+0000","last_peered":"2024-09-22T01:34:59.590755+0000","last_clean":"2024-09-22T01:34:59.590755+0000","last_became_active":"2024-09-22T01:34:48.535169+0000","last_became_peered":"2024-09-22T01:34:48.535169+0000","last_unstale":"2024-09-22T01:34:59.590755+0000","last_undegraded":"2024-09-22T01:34:59.590755+0000","last_fullsized":"2024-09-22T01:34:59.590755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:52:30.660607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"31'42","reported_seq":635,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.690080+0000","last_change":"2024-09-22T01:34:50.542664+0000","last_active":"2024-09-22T01:35:01.690080+0000","last_peered":"2024-09-22T01:35:01.690080+0000","last_clean":"2024-09-22T01:35:01.690080+0000","last_became_active":"2024-09-22T01:34:48.544812+0000","last_became_peered":"2024-09-22T01:34:48.544812+0000","last_unstale":"2024-09-22T01:35:01.690080+0000","last_undegraded":"2024-09-22T01:35:01.690080+0000","last_fullsized":"2024-09-22T01:35:01.690080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:20:52.043988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032535960000000001,"stat_sum":{"num_bytes":24101237,"num_objects":5,"num_object_clones":1,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":596,"num_read_kb":114,"num_write":23,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"27'27","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.587037+0000","last_change":"2024-09-22T01:34:50.527915+0000","last_active":"2024-09-22T01:34:59.587037+0000","last_peered":"2024-09-22T01:34:59.587037+0000","last_clean":"2024-09-22T01:34:59.587037+0000","last_became_active":"2024-09-22T01:34:48.537784+0000","last_became_peered":"2024-09-22T01:34:48.537784+0000","last_unstale":"2024-09-22T01:34:59.587037+0000","last_undegraded":"2024-09-22T01:34:59.587037+0000","last_fullsized":"2024-09-22T01:34:59.587037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:31:53.308656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010842180000000001,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":86,"num_read_kb":62,"num_write":36,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.595508+0000","last_change":"2024-09-22T01:34:40.376225+0000","last_active":"2024-09-22T01:34:59.595508+0000","last_peered":"2024-09-22T01:34:59.595508+0000","last_clean":"2024-09-22T01:34:59.595508+0000","last_became_active":"2024-09-22T01:34:38.360269+0000","last_became_peered":"2024-09-22T01:34:38.360269+0000","last_unstale":"2024-09-22T01:34:59.595508+0000","last_undegraded":"2024-09-22T01:34:59.595508+0000","last_fullsized":"2024-09-22T01:34:59.595508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:12:20.227363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023923949999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"27'10","reported_seq":51,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.869812+0000","last_change":"2024-09-22T01:34:50.525267+0000","last_active":"2024-09-22T01:34:59.869812+0000","last_peered":"2024-09-22T01:34:59.869812+0000","last_clean":"2024-09-22T01:34:59.869812+0000","last_became_active":"2024-09-22T01:34:48.530340+0000","last_became_peered":"2024-09-22T01:34:48.530340+0000","last_unstale":"2024-09-22T01:34:59.869812+0000","last_undegraded":"2024-09-22T01:34:59.869812+0000","last_fullsized":"2024-09-22T01:34:59.869812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:15:21.119797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050027299999999997,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":10,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.583895+0000","last_change":"2024-09-22T01:34:40.396661+0000","last_active":"2024-09-22T01:34:59.583895+0000","last_peered":"2024-09-22T01:34:59.583895+0000","last_clean":"2024-09-22T01:34:59.583895+0000","last_became_active":"2024-09-22T01:34:38.357518+0000","last_became_peered":"2024-09-22T01:34:38.357518+0000","last_unstale":"2024-09-22T01:34:59.583895+0000","last_undegraded":"2024-09-22T01:34:59.583895+0000","last_fullsized":"2024-09-22T01:34:59.583895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:53:15.154872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001088058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"29'133","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:00.019887+0000","last_change":"2024-09-22T01:34:50.545806+0000","last_active":"2024-09-22T01:35:00.019887+0000","last_peered":"2024-09-22T01:35:00.019887+0000","last_clean":"2024-09-22T01:35:00.019887+0000","last_became_active":"2024-09-22T01:34:48.546472+0000","last_became_peered":"2024-09-22T01:34:48.546472+0000","last_unstale":"2024-09-22T01:35:00.019887+0000","last_undegraded":"2024-09-22T01:35:00.019887+0000","last_fullsized":"2024-09-22T01:35:00.019887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:34.060183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00150643,"stat_sum":{"num_bytes":1273138,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":614,"num_read_kb":555,"num_write":208,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.603383+0000","last_change":"2024-09-22T01:34:41.142974+0000","last_active":"2024-09-22T01:34:59.603383+0000","last_peered":"2024-09-22T01:34:59.603383+0000","last_clean":"2024-09-22T01:34:59.603383+0000","last_became_active":"2024-09-22T01:34:38.359315+0000","last_became_peered":"2024-09-22T01:34:38.359315+0000","last_unstale":"2024-09-22T01:34:59.603383+0000","last_undegraded":"2024-09-22T01:34:59.603383+0000","last_fullsized":"2024-09-22T01:34:59.603383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:27:33.395450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094596600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'22","reported_seq":108,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.585559+0000","last_change":"2024-09-22T01:34:50.527359+0000","last_active":"2024-09-22T01:34:59.585559+0000","last_peered":"2024-09-22T01:34:59.585559+0000","last_clean":"2024-09-22T01:34:59.585559+0000","last_became_active":"2024-09-22T01:34:48.535726+0000","last_became_peered":"2024-09-22T01:34:48.535726+0000","last_unstale":"2024-09-22T01:34:59.585559+0000","last_undegraded":"2024-09-22T01:34:59.585559+0000","last_fullsized":"2024-09-22T01:34:59.585559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:14:43.242733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075466699999999999,"stat_sum":{"num_bytes":7839735,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":71,"num_read_kb":104,"num_write":20,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.595574+0000","last_change":"2024-09-22T01:34:40.375058+0000","last_active":"2024-09-22T01:34:59.595574+0000","last_peered":"2024-09-22T01:34:59.595574+0000","last_clean":"2024-09-22T01:34:59.595574+0000","last_became_active":"2024-09-22T01:34:38.358427+0000","last_became_peered":"2024-09-22T01:34:38.358427+0000","last_unstale":"2024-09-22T01:34:59.595574+0000","last_undegraded":"2024-09-22T01:34:59.595574+0000","last_fullsized":"2024-09-22T01:34:59.595574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:11.169948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.603411+0000","last_change":"2024-09-22T01:34:34.158566+0000","last_active":"2024-09-22T01:34:59.603411+0000","last_peered":"2024-09-22T01:34:59.603411+0000","last_clean":"2024-09-22T01:34:59.603411+0000","last_became_active":"2024-09-22T01:34:34.156391+0000","last_became_peered":"2024-09-22T01:34:34.156391+0000","last_unstale":"2024-09-22T01:34:59.603411+0000","last_undegraded":"2024-09-22T01:34:59.603411+0000","last_fullsized":"2024-09-22T01:34:59.603411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:24:19.482152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"31'32","reported_seq":82,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.690810+0000","last_change":"2024-09-22T01:34:50.528106+0000","last_active":"2024-09-22T01:35:01.690810+0000","last_peered":"2024-09-22T01:35:01.690810+0000","last_clean":"2024-09-22T01:35:01.690810+0000","last_became_active":"2024-09-22T01:34:48.543020+0000","last_became_peered":"2024-09-22T01:34:48.543020+0000","last_unstale":"2024-09-22T01:35:01.690810+0000","last_undegraded":"2024-09-22T01:35:01.690810+0000","last_fullsized":"2024-09-22T01:35:01.690810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:30:54.922370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001463764,"stat_sum":{"num_bytes":7449693,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":14,"num_write":24,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"31'94","reported_seq":140,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.746627+0000","last_change":"2024-09-22T01:34:50.527372+0000","last_active":"2024-09-22T01:35:01.746627+0000","last_peered":"2024-09-22T01:35:01.746627+0000","last_clean":"2024-09-22T01:35:01.746627+0000","last_became_active":"2024-09-22T01:34:48.547117+0000","last_became_peered":"2024-09-22T01:34:48.547117+0000","last_unstale":"2024-09-22T01:35:01.746627+0000","last_undegraded":"2024-09-22T01:35:01.746627+0000","last_fullsized":"2024-09-22T01:35:01.746627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:39:17.516415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093062799999999997,"stat_sum":{"num_bytes":9207197,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":273,"num_read_kb":281,"num_write":109,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"31'30","reported_seq":223,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.901672+0000","last_change":"2024-09-22T01:34:50.552879+0000","last_active":"2024-09-22T01:34:59.901672+0000","last_peered":"2024-09-22T01:34:59.901672+0000","last_clean":"2024-09-22T01:34:59.901672+0000","last_became_active":"2024-09-22T01:34:48.551682+0000","last_became_peered":"2024-09-22T01:34:48.551682+0000","last_unstale":"2024-09-22T01:34:59.901672+0000","last_undegraded":"2024-09-22T01:34:59.901672+0000","last_fullsized":"2024-09-22T01:34:59.901672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:47:59.834511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013073900000000001,"stat_sum":{"num_bytes":3181793,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":486,"num_read_kb":440,"num_write":27,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"30'29","reported_seq":96,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:00.015725+0000","last_change":"2024-09-22T01:34:50.527235+0000","last_active":"2024-09-22T01:35:00.015725+0000","last_peered":"2024-09-22T01:35:00.015725+0000","last_clean":"2024-09-22T01:35:00.015725+0000","last_became_active":"2024-09-22T01:34:48.534326+0000","last_became_peered":"2024-09-22T01:34:48.534326+0000","last_unstale":"2024-09-22T01:35:00.015725+0000","last_undegraded":"2024-09-22T01:35:00.015725+0000","last_fullsized":"2024-09-22T01:35:00.015725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:03.472344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000665578,"stat_sum":{"num_bytes":605192,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":35,"num_read_kb":40,"num_write":30,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"30'51","reported_seq":1399,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:34:59.596265+0000","last_change":"2024-09-22T01:34:50.541507+0000","last_active":"2024-09-22T01:34:59.596265+0000","last_peered":"2024-09-22T01:34:59.596265+0000","last_clean":"2024-09-22T01:34:59.596265+0000","last_became_active":"2024-09-22T01:34:48.544792+0000","last_became_peered":"2024-09-22T01:34:48.544792+0000","last_unstale":"2024-09-22T01:34:59.596265+0000","last_undegraded":"2024-09-22T01:34:59.596265+0000","last_fullsized":"2024-09-22T01:34:59.596265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:57:06.498683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002331039,"stat_sum":{"num_bytes":44630454,"num_objects":8,"num_object_clones":4,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":1353,"num_read_kb":657,"num_write":51,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"30'4","reported_seq":99,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:00.024477+0000","last_change":"2024-09-22T01:34:50.687808+0000","last_active":"2024-09-22T01:35:00.024477+0000","last_peered":"2024-09-22T01:35:00.024477+0000","last_clean":"2024-09-22T01:35:00.024477+0000","last_became_active":"2024-09-22T01:34:48.541470+0000","last_became_peered":"2024-09-22T01:34:48.541470+0000","last_unstale":"2024-09-22T01:35:00.024477+0000","last_undegraded":"2024-09-22T01:35:00.024477+0000","last_fullsized":"2024-09-22T01:35:00.024477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:39:56.603516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015841550000000001,"stat_sum":{"num_bytes":2106328,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":96,"num_write":5,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"30'21","reported_seq":92,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:00.022040+0000","last_change":"2024-09-22T01:34:50.687778+0000","last_active":"2024-09-22T01:35:00.022040+0000","last_peered":"2024-09-22T01:35:00.022040+0000","last_clean":"2024-09-22T01:35:00.022040+0000","last_became_active":"2024-09-22T01:34:48.547492+0000","last_became_peered":"2024-09-22T01:34:48.547492+0000","last_unstale":"2024-09-22T01:35:00.022040+0000","last_undegraded":"2024-09-22T01:35:00.022040+0000","last_fullsized":"2024-09-22T01:35:00.022040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:55:10.339874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016331309999999999,"stat_sum":{"num_bytes":7077888,"num_objects":3,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":50,"num_read_kb":140,"num_write":20,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"30'6","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:00.030470+0000","last_change":"2024-09-22T01:34:50.687161+0000","last_active":"2024-09-22T01:35:00.030470+0000","last_peered":"2024-09-22T01:35:00.030470+0000","last_clean":"2024-09-22T01:35:00.030470+0000","last_became_active":"2024-09-22T01:34:48.546610+0000","last_became_peered":"2024-09-22T01:34:48.546610+0000","last_unstale":"2024-09-22T01:35:00.030470+0000","last_undegraded":"2024-09-22T01:35:00.030470+0000","last_fullsized":"2024-09-22T01:35:00.030470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:50:25.837875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010627220000000001,"stat_sum":{"num_bytes":2083254,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":98,"num_write":7,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"31'87","reported_seq":154,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:00.021078+0000","last_change":"2024-09-22T01:34:50.552380+0000","last_active":"2024-09-22T01:35:00.021078+0000","last_peered":"2024-09-22T01:35:00.021078+0000","last_clean":"2024-09-22T01:35:00.021078+0000","last_became_active":"2024-09-22T01:34:48.543286+0000","last_became_peered":"2024-09-22T01:34:48.543286+0000","last_unstale":"2024-09-22T01:35:00.021078+0000","last_undegraded":"2024-09-22T01:35:00.021078+0000","last_fullsized":"2024-09-22T01:35:00.021078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:06:00.137575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000712264,"stat_sum":{"num_bytes":1572925,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":446,"num_read_kb":339,"num_write":150,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"31'31","reported_seq":97,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.690358+0000","last_change":"2024-09-22T01:34:50.688400+0000","last_active":"2024-09-22T01:35:01.690358+0000","last_peered":"2024-09-22T01:35:01.690358+0000","last_clean":"2024-09-22T01:35:01.690358+0000","last_became_active":"2024-09-22T01:34:48.553381+0000","last_became_peered":"2024-09-22T01:34:48.553381+0000","last_unstale":"2024-09-22T01:35:01.690358+0000","last_undegraded":"2024-09-22T01:35:01.690358+0000","last_fullsized":"2024-09-22T01:35:01.690358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:37:31.193999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002148418,"stat_sum":{"num_bytes":5684636,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":27,"num_write":20,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"31'42","reported_seq":94,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.729002+0000","last_change":"2024-09-22T01:34:50.545136+0000","last_active":"2024-09-22T01:35:01.729002+0000","last_peered":"2024-09-22T01:35:01.729002+0000","last_clean":"2024-09-22T01:35:01.729002+0000","last_became_active":"2024-09-22T01:34:48.527520+0000","last_became_peered":"2024-09-22T01:34:48.527520+0000","last_unstale":"2024-09-22T01:35:01.729002+0000","last_undegraded":"2024-09-22T01:35:01.729002+0000","last_fullsized":"2024-09-22T01:35:01.729002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:36:38.385020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086911499999999995,"stat_sum":{"num_bytes":5242926,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":33,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"31'58","reported_seq":131,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-22T01:35:01.781436+0000","last_change":"2024-09-22T01:34:50.687061+0000","last_active":"2024-09-22T01:35:01.781436+0000","last_peered":"2024-09-22T01:35:01.781436+0000","last_clean":"2024-09-22T01:35:01.781436+0000","last_became_active":"2024-09-22T01:34:48.546870+0000","last_became_peered":"2024-09-22T01:34:48.546870+0000","last_unstale":"2024-09-22T01:35:01.781436+0000","last_undegraded":"2024-09-22T01:35:01.781436+0000","last_fullsized":"2024-09-22T01:35:01.781436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:24:20.908285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095816200000000003,"stat_sum":{"num_bytes":14088793,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":92,"num_read_kb":145,"num_write":36,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":220912104,"num_objects":89,"num_object_clones":15,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":13,"num_read":9365,"num_read_kb":7211,"num_write":1371,"num_write_kb":8368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4169728,"data_stored":3775050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1331,"ondisk_log_size":1331,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1720320,"data_stored":1421971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":352256,"data_stored":141042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1040384,"data_stored":829090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1130496,"data_stored":828304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1097728,"data_stored":870717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":487424,"data_stored":259593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":749568,"data_stored":472651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":1421312,"data_stored":1135410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":281707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":384232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":124122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":819200,"data_stored":791865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":860160,"data_stored":754984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":708608,"data_stored":702475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":5571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":823296,"data_stored":730094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:35:04.397 INFO:tasks.thrashosds.thrasher:Setting 3.8 to [0, 2] 2024-09-22T01:35:04.397 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.8', '0', '2'] 2024-09-22T01:35:04.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.8 0 2 2024-09-22T01:35:04.439 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:04.438+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:04.468 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:04.468 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:04.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:04.531 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:04.530+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:04.606 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:04.602+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:04.627 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:35:04.664 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:04.664 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:04.665 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:04.665 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:04.665 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:04.683 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:04.727 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:04.726+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:04.748 INFO:teuthology.orchestra.run.smithi018.stdout:flattening image image_client.0-clone6 2024-09-22T01:35:04.808 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:04.806+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:04.887 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:602 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:04.887 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.186009520000001, 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055897943999999998, 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 602 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699628+0000", 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6330000000000002e-06 2024-09-22T01:35:04.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699650+0000", 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2056999999999999e-05 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699689+0000", 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9109000000000001e-05 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699707+0000", 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7207e-05 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699868+0000", 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016106200000000001 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.700040+0000", 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171865 2024-09-22T01:35:04.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.707678+0000", 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076380479999999997 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755348+0000", 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.047670037999999998 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755387+0000", 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9662000000000001e-05 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755455+0000", 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7995000000000002e-05 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755523+0000", 2024-09-22T01:35:04.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7267999999999994e-05 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10820 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 4096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841095+0000", 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044539328000000003, 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041024243000000002, 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10820 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841095+0000", 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841095+0000", 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841095+0000", 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3099999999999998e-07 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841098+0000", 2024-09-22T01:35:04.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3740000000000001e-06 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841104+0000", 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5939999999999999e-06 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841109+0000", 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.062e-06 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882027+0000", 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040918024999999997 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882069+0000", 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1807000000000001e-05 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882119+0000", 2024-09-22T01:35:04.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9849999999999999e-05 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10821 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 14336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841116+0000", 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044518043, 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041124475000000001, 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.899 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10821 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841116+0000", 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841116+0000", 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841116+0000", 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6199999999999999e-07 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841119+0000", 2024-09-22T01:35:04.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2409999999999998e-06 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841126+0000", 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1019999999999999e-06 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841131+0000", 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6960000000000002e-06 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882150+0000", 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041018805999999998 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882190+0000", 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0086000000000002e-05 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882241+0000", 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0182000000000002e-05 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10822 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 188416~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841139+0000", 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044495001999999999, 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041222694999999997, 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.904 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10822 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841139+0000", 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841139+0000", 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841140+0000", 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2199999999999999e-07 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841142+0000", 2024-09-22T01:35:04.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5459999999999998e-06 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841149+0000", 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0210000000000002e-06 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841155+0000", 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4099999999999999e-06 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882269+0000", 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041114884999999997 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882310+0000", 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0136999999999999e-05 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882362+0000", 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2274000000000001e-05 2024-09-22T01:35:04.908 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10823 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 362496~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841161+0000", 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044472623000000003, 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041319265000000001, 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.909 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10823 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841161+0000", 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841161+0000", 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841162+0000", 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841164+0000", 2024-09-22T01:35:04.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3549999999999999e-06 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841171+0000", 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9650000000000002e-06 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841177+0000", 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.682e-06 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882390+0000", 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041213148999999998 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882430+0000", 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0114000000000003e-05 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882481+0000", 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0671999999999999e-05 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.913 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10824 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 372736~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841183+0000", 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044450690000000001, 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041415675999999998, 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.914 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10824 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841183+0000", 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841183+0000", 2024-09-22T01:35:04.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841184+0000", 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841186+0000", 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1320000000000001e-06 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841192+0000", 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3770000000000001e-06 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841197+0000", 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5059999999999997e-06 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882509+0000", 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041312177999999998 2024-09-22T01:35:04.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882549+0000", 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0052000000000002e-05 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882599+0000", 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9907000000000002e-05 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.918 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10825 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 546816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841203+0000", 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044430782000000002, 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041512511000000002, 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.919 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10825 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841203+0000", 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841203+0000", 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841204+0000", 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3599999999999999e-07 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841206+0000", 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2409999999999998e-06 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841212+0000", 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.207e-06 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841217+0000", 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.685e-06 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882626+0000", 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041409279 2024-09-22T01:35:04.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882666+0000", 2024-09-22T01:35:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9897000000000001e-05 2024-09-22T01:35:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882716+0000", 2024-09-22T01:35:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9866e-05 2024-09-22T01:35:04.923 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10826 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 720896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841223+0000", 2024-09-22T01:35:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044411497000000001, 2024-09-22T01:35:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041611662000000001, 2024-09-22T01:35:04.924 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10826 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841223+0000", 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841223+0000", 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841223+0000", 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3300000000000003e-07 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841225+0000", 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.978e-06 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841231+0000", 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7729999999999996e-06 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841235+0000", 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5430000000000004e-06 2024-09-22T01:35:04.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882744+0000", 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041508805000000003 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882784+0000", 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9959000000000001e-05 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882834+0000", 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0170999999999998e-05 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10827 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 731136~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841243+0000", 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044391134999999998, 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041712883999999999, 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10827 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841243+0000", 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841243+0000", 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841243+0000", 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1199999999999999e-07 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841245+0000", 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8330000000000001e-06 2024-09-22T01:35:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841251+0000", 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0750000000000003e-06 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841256+0000", 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7480000000000001e-06 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882861+0000", 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041605182999999997 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882901+0000", 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9892999999999999e-05 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882956+0000", 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4839999999999997e-05 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.933 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10828 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 905216~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841264+0000", 2024-09-22T01:35:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044370408, 2024-09-22T01:35:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041832899999999999, 2024-09-22T01:35:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.934 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10828 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841264+0000", 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841264+0000", 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841264+0000", 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.32e-07 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841266+0000", 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2579999999999998e-06 2024-09-22T01:35:04.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841273+0000", 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5379999999999999e-06 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841278+0000", 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1240000000000004e-06 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.882987+0000", 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041708987000000003 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883041+0000", 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3554000000000003e-05 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883097+0000", 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6007000000000001e-05 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.938 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10829 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 915456~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841286+0000", 2024-09-22T01:35:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044348565999999999, 2024-09-22T01:35:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041934999000000001, 2024-09-22T01:35:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.939 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10829 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841286+0000", 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841286+0000", 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841286+0000", 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9499999999999998e-07 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841288+0000", 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2359999999999999e-06 2024-09-22T01:35:04.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841294+0000", 2024-09-22T01:35:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9390000000000002e-06 2024-09-22T01:35:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841299+0000", 2024-09-22T01:35:04.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5889999999999996e-06 2024-09-22T01:35:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883127+0000", 2024-09-22T01:35:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041828089999999998 2024-09-22T01:35:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883167+0000", 2024-09-22T01:35:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0697e-05 2024-09-22T01:35:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883221+0000", 2024-09-22T01:35:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3053000000000002e-05 2024-09-22T01:35:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.945 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10843 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 24576~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841305+0000", 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044329240999999998, 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042061082999999999, 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10843 2024-09-22T01:35:04.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841305+0000", 2024-09-22T01:35:04.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841305+0000", 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841305+0000", 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1199999999999999e-07 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841312+0000", 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7469999999999999e-06 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841320+0000", 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5620000000000004e-06 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841325+0000", 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9060000000000001e-06 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883257+0000", 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041931924000000002 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883310+0000", 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2845e-05 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883366+0000", 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5787e-05 2024-09-22T01:35:04.950 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10844 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 198656~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841332+0000", 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044302287000000003, 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042192157000000001, 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.951 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10844 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841332+0000", 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841332+0000", 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841332+0000", 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5499999999999999e-07 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841334+0000", 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2539999999999999e-06 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841341+0000", 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2809999999999997e-06 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841345+0000", 2024-09-22T01:35:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7670000000000003e-06 2024-09-22T01:35:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883401+0000", 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042055679999999998 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883448+0000", 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7228000000000003e-05 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883524+0000", 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5592000000000004e-05 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.955 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10845 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 208896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841352+0000", 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044282408000000002, 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.04229811, 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10845 2024-09-22T01:35:04.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841352+0000", 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841352+0000", 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841352+0000", 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6400000000000003e-07 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841354+0000", 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.052e-06 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841364+0000", 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5580000000000006e-06 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841369+0000", 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-06 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883556+0000", 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042187497999999997 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883600+0000", 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3389000000000001e-05 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883650+0000", 2024-09-22T01:35:04.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9959000000000001e-05 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10846 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 382976~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841398+0000", 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044235605999999997, 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042444082000000001, 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.960 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10846 2024-09-22T01:35:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841398+0000", 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841398+0000", 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841399+0000", 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4199999999999995e-07 2024-09-22T01:35:04.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841402+0000", 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8590000000000001e-06 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841411+0000", 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5180000000000004e-06 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841417+0000", 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0240000000000003e-06 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883682+0000", 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042265480000000001 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883755+0000", 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2602999999999996e-05 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883843+0000", 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7955999999999996e-05 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10847 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 557056~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841425+0000", 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044208781000000003, 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042567129000000002, 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10847 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841425+0000", 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841425+0000", 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841426+0000", 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0299999999999999e-07 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841428+0000", 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2859999999999998e-06 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841435+0000", 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9569999999999996e-06 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841440+0000", 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9359999999999998e-06 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883879+0000", 2024-09-22T01:35:04.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042439309000000001 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883929+0000", 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9811999999999997e-05 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.883992+0000", 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3325999999999996e-05 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10848 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 567296~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841447+0000", 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044186794000000001, 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042728527000000002, 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10848 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.969 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841447+0000", 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841447+0000", 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841448+0000", 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7599999999999998e-07 2024-09-22T01:35:04.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841450+0000", 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.396e-06 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841457+0000", 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0219999999999999e-06 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841462+0000", 2024-09-22T01:35:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2850000000000002e-06 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884035+0000", 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042572826000000001 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884089+0000", 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3353999999999998e-05 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884176+0000", 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7268000000000005e-05 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10849 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 741376~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841469+0000", 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044164966, 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042995846999999997, 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10849 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841469+0000", 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841469+0000", 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841470+0000", 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5699999999999998e-07 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841472+0000", 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3240000000000001e-06 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841479+0000", 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7769999999999997e-06 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841484+0000", 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2329999999999997e-06 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884252+0000", 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042768185 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884348+0000", 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5452999999999996e-05 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884465+0000", 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011741800000000001 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10850 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 751616~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841491+0000", 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044143265000000001, 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.043145168999999997, 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10850 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841491+0000", 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841491+0000", 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841491+0000", 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8500000000000002e-07 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841494+0000", 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3819999999999998e-06 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841500+0000", 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.28e-06 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841505+0000", 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1109999999999999e-06 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884503+0000", 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.042997857 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884573+0000", 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0406000000000003e-05 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884636+0000", 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2648000000000001e-05 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:10851 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 925696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.841522+0000", 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.044112158999999998, 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.043394294999999999, 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:04.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 10851 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841522+0000", 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841522+0000", 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841523+0000", 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9200000000000001e-07 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841526+0000", 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9660000000000001e-06 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841533+0000", 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.841539+0000", 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5949999999999998e-06 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884684+0000", 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.043145176 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884783+0000", 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8565000000000002e-05 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:04.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:04.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.884916+0000", 2024-09-22T01:35:04.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133657 2024-09-22T01:35:04.985 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.985 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.985 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.985 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:04.985 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:04.985 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:04.986 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:04.987 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:04.986+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:05.087 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:05.086+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:05.181 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:05.181 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:05.181 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:05.181 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:05.187 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:05.186+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:05.202 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:05.288 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:05.286+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:05.301 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:05.389 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:05.386+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:05.427 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:05.427 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:05.427 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:05.428 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:05.428 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:05.450 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:05.491 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:05.490+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:05.522 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:05.522 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:05.563 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:05.564 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:05.591 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:05.592 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:05.590+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:05.625 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:05.626 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:05.627 INFO:teuthology.orchestra.run.smithi018.stderr:set 3.8 pg_upmap mapping to [0,2] 2024-09-22T01:35:05.634 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:35:05.672 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:05.672 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:05.678 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:05.678 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:05.692 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:05.690+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:05.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:05.707 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:05.707 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:05.738 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:05.739 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:05.773 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:05.773 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:05.793 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:05.790+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:05.864 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:05.864 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:05.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:05.923 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:05.922+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:05.986 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:05.986 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:05.994 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:05.990+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:06.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:06.095 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:06.094+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:06.153 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:06.153 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:06.166 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:06.207 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:06.206+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:06.295 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:06.295 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:06.297 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:06.298+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:06.308 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:06.398 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:06.398+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:06.470 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:06.470 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:06.482 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:06.525 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:06.526+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:06.599 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:06.598+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:06.643 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:06.643 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:06.656 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:06.700 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:06.698+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:06.800 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:06.798+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:06.818 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:06.818 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:06.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:06.901 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:06.898+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:06.995 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:06.995 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:07.002 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:07.002+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:07.009 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:07.103 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:07.102+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:07.193 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:07.193 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:07.204 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:07.202+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:07.206 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:07.305 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:07.306+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:07.406 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:07.406+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:07.435 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:07.435 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:07.454 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:07.541 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:07.542+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:07.610 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:07.606+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:07.674 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:35:07.687 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:07.687 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:07.709 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:07.728 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:07.718+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:07.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:07.808 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:07.806+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:07.908 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:07.906+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:07.910 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:07.910 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:07.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:08.009 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:08.010+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:08.063 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:08.064 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:08.094 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:08.094 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:08.110 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:08.110 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:08.110 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:08.106+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:08.116 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:08.117 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:08.122 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:08.143 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:08.180 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:08.180 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:08.213 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:08.210+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:08.224 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:08.224 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:08.253 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:08.253 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:08.274 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:08.274 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:08.302 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:08.303 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:08.303 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:08.303 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:08.303 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:08.316 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:08.331 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:08.330+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:08.414 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:08.410+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:08.422 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:08.422 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:08.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 35.111679350999999, 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:35:08.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:35:08.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:35:08.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:35:08.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:35:08.428 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5809066550000002, 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.429 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.430 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:35:08.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.430 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:08.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:35:08.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.433 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5806793749999999, 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:35:08.437 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5775110909999999, 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.438 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:35:08.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:08.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:35:08.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:35:08.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:08.442 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.577426827, 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:35:08.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5773753309999998, 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.447 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:35:08.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:35:08.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5773300109999999, 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.451 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5738497540000003, 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5735449419999998, 2024-09-22T01:35:08.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:08.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:35:08.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:35:08.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:35:08.463 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5734954979999998, 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.464 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:08.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:08.468 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5734509440000002, 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:08.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:35:08.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:35:08.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5734072939999999, 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.473 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:35:08.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5733600729999999, 2024-09-22T01:35:08.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:35:08.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:35:08.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5731650670000001, 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:35:08.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:35:08.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.485 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5731155800000001, 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:35:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:35:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.489 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5699645210000002, 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.490 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:35:08.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:35:08.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5696188929999999, 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.494 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:35:08.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.497 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.56952347, 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.498 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:35:08.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.5694708909999999, 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:35:08.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:35:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.569429124, 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:08.506 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:08.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:08.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.509 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:08.510 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:08.510 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:08.511 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:08.514 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:08.510+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:08.614 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:08.610+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:08.653 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:35:08.659 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:08.659 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:08.677 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:08.724 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:08.722+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:08.775 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-22T01:35:08.815 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:08.814+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:08.873 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:08.874 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:08.874 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:08.874 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:08.874 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:08.891 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:08.916 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:08.913+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:08.973 INFO:teuthology.orchestra.run.smithi018.stdout:801 writesame 0xc19f0f0 thru 0xc1a641e data_size 0x1(0x732f bytes) 2024-09-22T01:35:08.973 INFO:teuthology.orchestra.run.smithi018.stdout:803 read 0x4122e44 thru 0x412ae9a (0x8057 bytes) 2024-09-22T01:35:08.974 INFO:teuthology.orchestra.run.smithi018.stdout:804 trunc from 0xc1a641f to 0xc244c84 2024-09-22T01:35:08.982 INFO:teuthology.orchestra.run.smithi018.stdout:805 punch from 0x794cf0c to 0x795b37f, (0xe473 bytes) 2024-09-22T01:35:08.985 INFO:teuthology.orchestra.run.smithi018.stdout:806 trunc from 0xc244c84 to 0xe00194b 2024-09-22T01:35:08.995 INFO:teuthology.orchestra.run.smithi018.stdout:808 punch from 0x94a01d0 to 0x94a2014, (0x1e44 bytes) 2024-09-22T01:35:08.995 INFO:teuthology.orchestra.run.smithi018.stdout:809 read 0xdaf6be0 thru 0xdb04496 (0xd8b7 bytes) 2024-09-22T01:35:08.995 INFO:teuthology.orchestra.run.smithi018.stdout:810 writesame 0x2a5e5aa thru 0x2a647ac data_size 0x1(0x6203 bytes) 2024-09-22T01:35:09.018 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:09.014+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:09.049 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:09.049 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:09.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:09.049 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48565 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 708608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.581196987, 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086712429999999993, 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48565 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.050 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466221+0000", 2024-09-22T01:35:09.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9299999999999998e-07 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466224+0000", 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.977e-06 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466233+0000", 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1419999999999999e-06 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466240+0000", 2024-09-22T01:35:09.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6800000000000004e-06 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552634+0000", 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086394356000000005 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552731+0000", 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6681000000000005e-05 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552933+0000", 2024-09-22T01:35:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020200099999999999 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48566 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 718848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.58116880800000004, 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086846866999999994, 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.054 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48566 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.06e-07 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466252+0000", 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.813e-06 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466261+0000", 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7260000000000008e-06 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466267+0000", 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5400000000000001e-06 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552974+0000", 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086707237000000006 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553025+0000", 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0380000000000002e-05 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553095+0000", 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0564999999999999e-05 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48654 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57692576799999995, 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086747482000000001, 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48654 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5700000000000001e-07 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470498+0000", 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470515+0000", 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7742000000000001e-05 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470546+0000", 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0586000000000002e-05 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557000+0000", 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086454002000000002 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557110+0000", 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010961 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557239+0000", 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48655 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 638976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:09.062 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57685019800000004, 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086840121000000006, 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48655 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470569+0000", 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5400000000000001e-06 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470575+0000", 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1399999999999997e-06 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470597+0000", 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1676e-05 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470614+0000", 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7336000000000001e-05 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557279+0000", 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086664832999999997 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557341+0000", 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2073e-05 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557407+0000", 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6523e-05 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57674701500000003, 2024-09-22T01:35:09.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:35:09.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:35:09.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:35:09.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:35:09.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57667260499999995, 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:35:09.071 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57661607400000003, 2024-09-22T01:35:09.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:09.079 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57655847999999998, 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:35:09.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:35:09.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57650114200000002, 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:09.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57644370099999998, 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:35:09.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.092 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57640779200000003, 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:35:09.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:35:09.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.096 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48750 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57150499099999996, 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086758792000000001, 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48750 2024-09-22T01:35:09.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475914+0000", 2024-09-22T01:35:09.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.263e-06 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475919+0000", 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.84e-06 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475937+0000", 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7689e-05 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475951+0000", 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3439e-05 2024-09-22T01:35:09.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562548+0000", 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086597376000000004 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562605+0000", 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7367999999999997e-05 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562671+0000", 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5816999999999997e-05 2024-09-22T01:35:09.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48751 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 641024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57143066099999995, 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086829097999999993, 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48751 2024-09-22T01:35:09.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475988+0000", 2024-09-22T01:35:09.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.47e-07 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475994+0000", 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1260000000000003e-06 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476019+0000", 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5471999999999999e-05 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476033+0000", 2024-09-22T01:35:09.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100000000000001e-05 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562691+0000", 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086657746999999993 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562750+0000", 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9188000000000003e-05 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562816+0000", 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5518000000000005e-05 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57136409399999999, 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.105 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57130065299999999, 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.109 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:35:09.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57124541600000001, 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:35:09.113 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:35:09.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57117210200000001, 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:35:09.117 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57111802099999998, 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:35:09.121 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57106358300000004, 2024-09-22T01:35:09.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:35:09.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.57100772200000005, 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:35:09.129 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.133 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:09.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:09.135 INFO:teuthology.orchestra.run.smithi018.stdout:811 trunc from 0xe00194b to 0x4d24ac0 2024-09-22T01:35:09.136 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:09.133+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:09.157 INFO:teuthology.orchestra.run.smithi018.stdout:812 write 0xb290e6c thru 0xb294a76 (0x3c0b bytes) 2024-09-22T01:35:09.174 INFO:teuthology.orchestra.run.smithi018.stdout:813 trunc from 0xb294a77 to 0x68d76cc 2024-09-22T01:35:09.219 INFO:teuthology.orchestra.run.smithi018.stdout:816 write 0xb5cea17 thru 0xb5d48c9 (0x5eb3 bytes) 2024-09-22T01:35:09.225 INFO:teuthology.orchestra.run.smithi018.stdout:817 read 0x2ae89ac thru 0x2aebe68 (0x34bd bytes) 2024-09-22T01:35:09.236 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:09.234+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:09.244 INFO:teuthology.orchestra.run.smithi018.stdout:818 writesame 0xd46d765 thru 0xd4773e7 data_size 0x1(0x9c83 bytes) 2024-09-22T01:35:09.259 INFO:teuthology.orchestra.run.smithi018.stdout:819 write 0xd50f2e6 thru 0xd512088 (0x2da3 bytes) 2024-09-22T01:35:09.280 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:09.280 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:09.280 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:09.280 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:09.280 INFO:teuthology.orchestra.run.smithi018.stdout:820 writesame 0xedf9eac thru 0xee09261 data_size 0x22(0xf3b6 bytes) 2024-09-22T01:35:09.282 INFO:teuthology.orchestra.run.smithi018.stdout:821 write 0x80b2c82 thru 0x80b753e (0x48bd bytes) 2024-09-22T01:35:09.287 INFO:teuthology.orchestra.run.smithi018.stdout:822 read 0x33805f8 thru 0x3385db0 (0x57b9 bytes) 2024-09-22T01:35:09.300 INFO:teuthology.orchestra.run.smithi018.stdout:823 trunc from 0xee09262 to 0x7b220ad 2024-09-22T01:35:09.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:09.324 INFO:teuthology.orchestra.run.smithi018.stdout:825 punch from 0x4e5997a to 0x4e5c130, (0x27b6 bytes) 2024-09-22T01:35:09.324 INFO:teuthology.orchestra.run.smithi018.stdout:826 trunc from 0x7b220ad to 0x7e3b3f9 2024-09-22T01:35:09.336 INFO:teuthology.orchestra.run.smithi018.stdout:832 punch from 0x22aa464 to 0x22b0a13, (0x65af bytes) 2024-09-22T01:35:09.336 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:09.334+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:09.350 INFO:teuthology.orchestra.run.smithi018.stdout:834 write 0x9dca5da thru 0x9dd2448 (0x7e6f bytes) 2024-09-22T01:35:09.357 INFO:teuthology.orchestra.run.smithi018.stdout:835 read 0x4c38e87 thru 0x4c44525 (0xb69f bytes) 2024-09-22T01:35:09.358 INFO:teuthology.orchestra.run.smithi018.stdout:836 read 0x7fae9db thru 0x7fbbc48 (0xd26e bytes) 2024-09-22T01:35:09.358 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:09.358 INFO:teuthology.orchestra.run.smithi018.stdout:838 punch from 0x41ec7d5 to 0x41f29b4, (0x61df bytes) 2024-09-22T01:35:09.359 INFO:teuthology.orchestra.run.smithi018.stdout:840 read 0x384e38f thru 0x38549b0 (0x6622 bytes) 2024-09-22T01:35:09.359 INFO:teuthology.orchestra.run.smithi018.stdout:841 write 0x62c9b9a thru 0x62cc39d (0x2804 bytes) 2024-09-22T01:35:09.365 INFO:teuthology.orchestra.run.smithi018.stdout:842 writesame 0x3312aff thru 0x331fd4c data_size 0x1b(0xd24e bytes) 2024-09-22T01:35:09.370 INFO:teuthology.orchestra.run.smithi018.stdout:843 punch from 0x15072b to 0x155ad0, (0x53a5 bytes) 2024-09-22T01:35:09.370 INFO:teuthology.orchestra.run.smithi018.stdout:844 punch from 0x91a42f6 to 0x91a9678, (0x5382 bytes) 2024-09-22T01:35:09.381 INFO:teuthology.orchestra.run.smithi018.stdout:846 trunc from 0x9dd2449 to 0x1232fbe 2024-09-22T01:35:09.438 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:09.437+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:09.446 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:09.446 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:09.446 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:09.447 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:09.447 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:09.459 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:09.538 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:09.537+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:09.539 INFO:teuthology.orchestra.run.smithi018.stdout:847 read 0x94ef82 thru 0x952e61 (0x3ee0 bytes) 2024-09-22T01:35:09.549 INFO:teuthology.orchestra.run.smithi018.stdout:851 trunc from 0x1232fbe to 0x5355b6d 2024-09-22T01:35:09.562 INFO:teuthology.orchestra.run.smithi018.stdout:853 read 0x800c2c thru 0x80a224 (0x95f9 bytes) 2024-09-22T01:35:09.564 INFO:teuthology.orchestra.run.smithi018.stdout:854 punch from 0x13311e9 to 0x133eec9, (0xdce0 bytes) 2024-09-22T01:35:09.564 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:09.564 INFO:teuthology.orchestra.run.smithi018.stdout:858 write 0x2a9d561 thru 0x2aa9471 (0xbf11 bytes) 2024-09-22T01:35:09.568 INFO:teuthology.orchestra.run.smithi018.stdout:859 punch from 0x3a1d34a to 0x3a22cf4, (0x59aa bytes) 2024-09-22T01:35:09.568 INFO:teuthology.orchestra.run.smithi018.stdout:860 writesame 0x27cf124 thru 0x27dd707 data_size 0x2(0xe5e4 bytes) 2024-09-22T01:35:09.600 INFO:teuthology.orchestra.run.smithi018.stdout:863 write 0x30ebf0d thru 0x30faaa8 (0xeb9c bytes) 2024-09-22T01:35:09.625 INFO:teuthology.orchestra.run.smithi018.stdout:866 write 0x8f33e7e thru 0x8f3b535 (0x76b8 bytes) 2024-09-22T01:35:09.627 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:602 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.924845142000001, 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055897943999999998, 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:09.628 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 602 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699628+0000", 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6330000000000002e-06 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699650+0000", 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2056999999999999e-05 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699689+0000", 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9109000000000001e-05 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699707+0000", 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7207e-05 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699868+0000", 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016106200000000001 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.700040+0000", 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171865 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.707678+0000", 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076380479999999997 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755348+0000", 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.047670037999999998 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755387+0000", 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9662000000000001e-05 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755455+0000", 2024-09-22T01:35:09.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7995000000000002e-05 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755523+0000", 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7267999999999994e-05 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11290 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7542198730000003, 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048997573000000003, 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11290 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870253+0000", 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5019999999999999e-06 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870274+0000", 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1064999999999999e-05 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870280+0000", 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3230000000000003e-06 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919056+0000", 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048776031999999997 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919138+0000", 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1846000000000002e-05 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919247+0000", 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000109329 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11291 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7541780659999997, 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049210375000000001, 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11291 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870461+0000", 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169476 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870465+0000", 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870477+0000", 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1207e-05 2024-09-22T01:35:09.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870484+0000", 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.481e-06 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919295+0000", 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048810529999999998 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919380+0000", 2024-09-22T01:35:09.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5773999999999996e-05 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919502+0000", 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121662 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11292 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.641 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7539721359999998, 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049215074999999997, 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11292 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:09.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870610+0000", 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112569 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870615+0000", 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3630000000000004e-06 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870626+0000", 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1460999999999999e-05 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870633+0000", 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8170000000000001e-06 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919546+0000", 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048912723999999998 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919651+0000", 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105437 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919713+0000", 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1704000000000004e-05 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11293 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7538256040000002, 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049300425000000002, 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11293 2024-09-22T01:35:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870769+0000", 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125289 2024-09-22T01:35:09.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870774+0000", 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1099999999999996e-06 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870784+0000", 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0664e-05 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870791+0000", 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:35:09.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919753+0000", 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048961849000000002 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919840+0000", 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6917999999999997e-05 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919945+0000", 2024-09-22T01:35:09.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010444499999999999 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11294 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 694272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7536667609999999, 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049352066999999999, 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11294 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870909+0000", 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105821 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870913+0000", 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3329999999999998e-06 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870929+0000", 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6146000000000001e-05 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870938+0000", 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8470000000000002e-06 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919988+0000", 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049050170999999997 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920051+0000", 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2337999999999998e-05 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920155+0000", 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104411 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11295 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 868352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.654 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7535194299999999, 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049438600999999999, 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11295 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:09.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872025+0000", 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001075037 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872031+0000", 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3619999999999997e-06 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872043+0000", 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2075999999999999e-05 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872052+0000", 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-06 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920196+0000", 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048143803999999998 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920284+0000", 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7454999999999995e-05 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920389+0000", 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105167 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11313 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 346112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7523548499999997, 2024-09-22T01:35:09.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048873528999999999, 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11313 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6300000000000001e-07 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872117+0000", 2024-09-22T01:35:09.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2450000000000001e-06 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872125+0000", 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872130+0000", 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9280000000000001e-06 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920837+0000", 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048706948999999999 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920921+0000", 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3459000000000002e-05 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920988+0000", 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7644000000000005e-05 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11314 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7523323360000003, 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049091919999999997, 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11314 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872138+0000", 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3799999999999998e-07 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872140+0000", 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5500000000000001e-06 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872147+0000", 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6680000000000004e-06 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872152+0000", 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4269999999999999e-06 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921028+0000", 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048875778000000002 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921118+0000", 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0148000000000005e-05 2024-09-22T01:35:09.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921229+0000", 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110911 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11315 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7523106820000001, 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049217209999999997, 2024-09-22T01:35:09.667 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11315 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872362+0000", 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203131 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872368+0000", 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6210000000000001e-06 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872379+0000", 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872388+0000", 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000002e-06 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921263+0000", 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048874828000000002 2024-09-22T01:35:09.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921309+0000", 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5843000000000001e-05 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921376+0000", 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7429999999999996e-05 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11316 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7520679430000001, 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049209332000000001, 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11316 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872627+0000", 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022554899999999999 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872638+0000", 2024-09-22T01:35:09.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0964e-05 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872652+0000", 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100999999999999e-05 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872661+0000", 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8340000000000005e-06 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921415+0000", 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048753713999999997 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921505+0000", 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9554000000000004e-05 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921611+0000", 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106616 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11317 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 714752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7517956420000003, 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049068392000000002, 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11317 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872821+0000", 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014710999999999999 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872826+0000", 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5399999999999997e-06 2024-09-22T01:35:09.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872839+0000", 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3441999999999999e-05 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872854+0000", 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4364e-05 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921646+0000", 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048791961000000002 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921688+0000", 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.286e-05 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921742+0000", 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4114999999999999e-05 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11318 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 888832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.751604006, 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049108288, 2024-09-22T01:35:09.679 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11318 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873096+0000", 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023050300000000001 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873102+0000", 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5269999999999998e-06 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873114+0000", 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1802e-05 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873121+0000", 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4209999999999998e-06 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921782+0000", 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048660582000000001 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921869+0000", 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7798000000000002e-05 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921974+0000", 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010465499999999999 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11319 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 899072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:09.683 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7513363819999999, 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048963590000000001, 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11319 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873305+0000", 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017154 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873310+0000", 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873326+0000", 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.558e-05 2024-09-22T01:35:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873343+0000", 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6894000000000001e-05 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922006+0000", 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.04866293 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922047+0000", 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0952999999999999e-05 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922097+0000", 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0413e-05 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11333 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 8192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7511137009999995, 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048982295000000002, 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11333 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875169+0000", 2024-09-22T01:35:09.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018133089999999999 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875175+0000", 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875189+0000", 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3886999999999999e-05 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875197+0000", 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5369999999999997e-06 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922139+0000", 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.046941573 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922231+0000", 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2565000000000006e-05 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922338+0000", 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107124 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11384 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 755712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7466907020000004, 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048901420000000001, 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11384 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.691 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877943+0000", 2024-09-22T01:35:09.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164411 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877948+0000", 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3340000000000003e-06 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877959+0000", 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1027e-05 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877966+0000", 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1099999999999997e-06 2024-09-22T01:35:09.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926570+0000", 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048603810999999997 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926616+0000", 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6335999999999998e-05 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926680+0000", 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4391000000000001e-05 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.694 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11386 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 940032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7463507229999999, 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048882052000000002, 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.695 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11386 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878210+0000", 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1310999999999994e-05 2024-09-22T01:35:09.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878215+0000", 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4259999999999996e-06 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878229+0000", 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.448e-05 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878244+0000", 2024-09-22T01:35:09.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718e-05 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926854+0000", 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048610318999999999 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926939+0000", 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4919999999999993e-05 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927001+0000", 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1878000000000006e-05 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11401 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7462122400000002, 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048953133000000003, 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11401 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:09.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878258+0000", 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878261+0000", 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7590000000000002e-06 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878269+0000", 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878276+0000", 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2420000000000003e-06 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927095+0000", 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048819573999999998 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927153+0000", 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7120000000000002e-05 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927211+0000", 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8062000000000001e-05 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.703 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11402 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 59392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7461864440000001, 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049110529, 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11402 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:09.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879206+0000", 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092231699999999997 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879211+0000", 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1830000000000002e-06 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879223+0000", 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2388000000000001e-05 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879229+0000", 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3800000000000002e-06 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927251+0000", 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048022479999999999 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927321+0000", 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9760999999999998e-05 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927394+0000", 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3020000000000002e-05 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.707 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11408 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 776192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.879316+0000", 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7451534139999998, 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048856469, 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11408 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.708 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879316+0000", 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879316+0000", 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879553+0000", 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023645200000000001 2024-09-22T01:35:09.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879558+0000", 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3140000000000003e-06 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879568+0000", 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0271999999999999e-05 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879576+0000", 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5320000000000001e-06 2024-09-22T01:35:09.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.928065+0000", 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048489281000000002 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.928120+0000", 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5265e-05 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.928173+0000", 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2352999999999998e-05 2024-09-22T01:35:09.711 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:09.712 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:09.712 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:09.713 INFO:teuthology.orchestra.run.smithi018.stdout:868 punch from 0x74f7c0c to 0x74fcda8, (0x519c bytes) 2024-09-22T01:35:09.713 INFO:teuthology.orchestra.run.smithi018.stdout:869 read 0x5d4664b thru 0x5d483b8 (0x1d6e bytes) 2024-09-22T01:35:09.713 INFO:teuthology.orchestra.run.smithi018.stdout:871 writesame 0x56416dc thru 0x564890b data_size 0x57(0x7230 bytes) 2024-09-22T01:35:09.713 INFO:teuthology.orchestra.run.smithi018.stdout:872 read 0x40d9740 thru 0x40db61e (0x1edf bytes) 2024-09-22T01:35:09.713 INFO:teuthology.orchestra.run.smithi018.stdout:877 read 0x8e12c6 thru 0x8ec102 (0xae3d bytes) 2024-09-22T01:35:09.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:09.715 INFO:teuthology.orchestra.run.smithi018.stdout:878 trunc from 0x8f3b536 to 0xf68269 2024-09-22T01:35:09.715 INFO:teuthology.orchestra.run.smithi018.stdout:879 trunc from 0xf68269 to 0xe099f9b 2024-09-22T01:35:09.715 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:09.710+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:09.736 INFO:teuthology.orchestra.run.smithi018.stdout:880 trunc from 0xe099f9b to 0x12dc4a2 2024-09-22T01:35:09.759 INFO:teuthology.orchestra.run.smithi018.stdout:881 trunc from 0x12dc4a2 to 0x52a8d5b 2024-09-22T01:35:09.772 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:09.772 INFO:teuthology.orchestra.run.smithi018.stdout:883 read 0x3b5817 thru 0x3b63a3 (0xb8d bytes) 2024-09-22T01:35:09.773 INFO:teuthology.orchestra.run.smithi018.stdout:884 write 0x1ec3ee6 thru 0x1ecc3cf (0x84ea bytes) 2024-09-22T01:35:09.775 INFO:teuthology.orchestra.run.smithi018.stdout:887 write 0x3a1c029 thru 0x3a26128 (0xa100 bytes) 2024-09-22T01:35:09.783 INFO:teuthology.orchestra.run.smithi018.stdout:889 read 0x1c69f04 thru 0x1c6edda (0x4ed7 bytes) 2024-09-22T01:35:09.784 INFO:teuthology.orchestra.run.smithi018.stdout:890 writesame 0x4ffb052 thru 0x4fff53f data_size 0x11(0x44ee bytes) 2024-09-22T01:35:09.792 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:09.792 INFO:teuthology.orchestra.run.smithi018.stdout:895 read 0x304c22c thru 0x3058d3d (0xcb12 bytes) 2024-09-22T01:35:09.801 INFO:teuthology.orchestra.run.smithi018.stdout:896 trunc from 0x52a8d5b to 0x9dfb5c 2024-09-22T01:35:09.815 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:09.813+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:09.831 INFO:teuthology.orchestra.run.smithi018.stdout:897 read 0x9788d5 thru 0x9862c3 (0xd9ef bytes) 2024-09-22T01:35:09.832 INFO:teuthology.orchestra.run.smithi018.stdout:898 punch from 0x120ee5 to 0x12bdfb, (0xaf16 bytes) 2024-09-22T01:35:09.832 INFO:teuthology.orchestra.run.smithi018.stdout:900 read 0x8dc95b thru 0x8e8080 (0xb726 bytes) 2024-09-22T01:35:09.864 INFO:teuthology.orchestra.run.smithi018.stdout:901 write 0xce06998 thru 0xce0a604 (0x3c6d bytes) 2024-09-22T01:35:09.871 INFO:teuthology.orchestra.run.smithi018.stdout:902 read 0xc0fae9c thru 0xc10473c (0x98a1 bytes) 2024-09-22T01:35:09.872 INFO:teuthology.orchestra.run.smithi018.stdout:903 punch from 0xc099134 to 0xc0a57cf, (0xc69b bytes) 2024-09-22T01:35:09.872 INFO:teuthology.orchestra.run.smithi018.stdout:904 writesame 0x19c584e thru 0x19ce067 data_size 0x3(0x881a bytes) 2024-09-22T01:35:09.876 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:09.877 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:09.877 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:09.877 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:09.887 INFO:teuthology.orchestra.run.smithi018.stdout:905 writesame 0x502cb66 thru 0x503ae75 data_size 0x38(0xe310 bytes) 2024-09-22T01:35:09.893 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:09.897 INFO:teuthology.orchestra.run.smithi018.stdout:907 trunc from 0xce0a605 to 0xb90c3d2 2024-09-22T01:35:09.917 INFO:teuthology.orchestra.run.smithi018.stdout:908 read 0x5bf58c0 thru 0x5bfa1e3 (0x4924 bytes) 2024-09-22T01:35:09.917 INFO:teuthology.orchestra.run.smithi018.stdout:909 punch from 0xa0889a to 0xa0f63c, (0x6da2 bytes) 2024-09-22T01:35:09.917 INFO:teuthology.orchestra.run.smithi018.stdout:910 punch from 0x6057c97 to 0x6064c15, (0xcf7e bytes) 2024-09-22T01:35:09.918 INFO:teuthology.orchestra.run.smithi018.stdout:911 clone 8 order 19 su 131072 sc 4 2024-09-22T01:35:09.918 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:09.914+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:10.016 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:10.013+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:10.020 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:10.021 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:10.021 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:10.021 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:10.021 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:10.035 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:10.123 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:10.122+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:10.208 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:10.208 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.208265313999998, 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:10.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:35:10.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:35:10.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:401 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 2722870~26550] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.183502+0000", 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 16.023384496999999, 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003583546, 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.213 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 401 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183502+0000", 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183502+0000", 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183505+0000", 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183537+0000", 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2387e-05 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183574+0000", 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6792000000000003e-05 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183592+0000", 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7594000000000001e-05 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183765+0000", 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017329199999999999 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.184174+0000", 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040908699999999998 2024-09-22T01:35:10.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.184570+0000", 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00039599699999999998 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.186552+0000", 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019815039999999998 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.186919+0000", 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036720999999999998 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.187005+0000", 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6377000000000003e-05 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.187086+0000", 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0436e-05 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:441 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 1698514~5422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.259092+0000", 2024-09-22T01:35:10.218 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.947794864, 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035962960000000001, 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 441 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259092+0000", 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259092+0000", 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259095+0000", 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.033e-06 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259116+0000", 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0964000000000001e-05 2024-09-22T01:35:10.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259153+0000", 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7539000000000001e-05 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259171+0000", 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8122999999999999e-05 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259335+0000", 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016369900000000001 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259476+0000", 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014099199999999999 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259744+0000", 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026825200000000002 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.261485+0000", 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017411099999999999 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.262375+0000", 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088960000000000005 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.262560+0000", 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018467200000000001 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.262688+0000", 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128312 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:455 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.294520+0000", 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.912366707, 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038360400000000002, 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 455 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294520+0000", 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294520+0000", 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294523+0000", 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1930000000000002e-06 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294538+0000", 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4824000000000001e-05 2024-09-22T01:35:10.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294572+0000", 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4452999999999997e-05 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294589+0000", 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6342999999999999e-05 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294735+0000", 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014678200000000001 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.295131+0000", 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000395423 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.295756+0000", 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062471599999999999 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298058+0000", 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002302662 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298164+0000", 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106156 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298265+0000", 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100416 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298356+0000", 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1071999999999998e-05 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.878615661, 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.235 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.878472156000001, 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:10.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:35:10.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:35:10.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:35:10.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:35:10.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:460 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328544+0000", 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.87834234, 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037580539999999998, 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 460 2024-09-22T01:35:10.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328544+0000", 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328544+0000", 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328545+0000", 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3030000000000001e-06 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328553+0000", 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2799999999999998e-06 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328576+0000", 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3390000000000001e-05 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328594+0000", 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7537000000000002e-05 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328743+0000", 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014983499999999999 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328943+0000", 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00019979899999999999 2024-09-22T01:35:10.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329312+0000", 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036868699999999998 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331648+0000", 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023359679999999999 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332048+0000", 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000399971 2024-09-22T01:35:10.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332206+0000", 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000157725 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332302+0000", 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6558999999999995e-05 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.246 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:501 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 747835~19156] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.419429+0000", 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.787457230999999, 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029796340000000001, 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 501 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419429+0000", 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419429+0000", 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419433+0000", 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.343e-06 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419462+0000", 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.915e-05 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419500+0000", 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8742999999999998e-05 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419520+0000", 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9996e-05 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419649+0000", 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128293 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419795+0000", 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014619200000000001 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.420087+0000", 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000292145 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.421930+0000", 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018432279999999999 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.422229+0000", 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029903500000000001 2024-09-22T01:35:10.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.422328+0000", 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8951999999999997e-05 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.422409+0000", 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0556999999999995e-05 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.252 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:514 3.0 3:023caaec:::rbd_data.110fc6985e86.0000000000000011:head [set-alloc-hint object_size 8388608 write_size 8388608,write 524288~47387] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.454885+0000", 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.752001362, 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0031286930000000001, 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 514 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454885+0000", 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454885+0000", 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454888+0000", 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454934+0000", 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5745999999999999e-05 2024-09-22T01:35:10.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454970+0000", 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6566000000000002e-05 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454988+0000", 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7204e-05 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.455119+0000", 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013154200000000001 2024-09-22T01:35:10.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.455362+0000", 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024244800000000001 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.455602+0000", 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024033799999999999 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.457426+0000", 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018243230000000001 2024-09-22T01:35:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.457838+0000", 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00041149699999999998 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.457938+0000", 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100282 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.458014+0000", 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5840000000000006e-05 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:519 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.489143+0000", 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.717743196000001, 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003715168, 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 519 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.258 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489143+0000", 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489143+0000", 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489147+0000", 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0500000000000002e-06 2024-09-22T01:35:10.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489164+0000", 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6629999999999998e-05 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489209+0000", 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4563e-05 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489234+0000", 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5636e-05 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489408+0000", 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017384900000000001 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489660+0000", 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025238799999999998 2024-09-22T01:35:10.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489951+0000", 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029059499999999999 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.491583+0000", 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016318839999999999 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492558+0000", 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097499800000000003 2024-09-22T01:35:10.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492727+0000", 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016943899999999999 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492858+0000", 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013113600000000001 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:522 3.0 3:023caaec:::rbd_data.110fc6985e86.0000000000000011:head [truncate 2883584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.497897+0000", 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.70898989, 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002816359, 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 522 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497897+0000", 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497897+0000", 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497899+0000", 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3029999999999998e-06 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497911+0000", 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2527000000000001e-05 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497941+0000", 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9635999999999999e-05 2024-09-22T01:35:10.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497956+0000", 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.517e-05 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.498075+0000", 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119103 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.498224+0000", 2024-09-22T01:35:10.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014880500000000001 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.498430+0000", 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020570199999999999 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.499625+0000", 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001195261 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.500385+0000", 2024-09-22T01:35:10.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076031000000000004 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.500553+0000", 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167376 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.500713+0000", 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160166 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:547 3.0 3:023caaec:::rbd_data.110fc6985e86.0000000000000011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.560754+0000", 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.646132042, 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027911469999999999, 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 547 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560754+0000", 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560754+0000", 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560779+0000", 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4147000000000001e-05 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560792+0000", 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3036e-05 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560829+0000", 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560847+0000", 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7286e-05 2024-09-22T01:35:10.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560971+0000", 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012449100000000001 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.561153+0000", 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000181533 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.561379+0000", 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022662600000000001 2024-09-22T01:35:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.562490+0000", 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011111039999999999 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.563345+0000", 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00085425099999999999 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.563454+0000", 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010930299999999999 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.563546+0000", 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1557000000000004e-05 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:689 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 505455~18833] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.970312+0000", 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.236574716, 2024-09-22T01:35:10.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00277991, 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 689 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970312+0000", 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970312+0000", 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970315+0000", 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8499999999999998e-06 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970343+0000", 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7963e-05 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970380+0000", 2024-09-22T01:35:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.773e-05 2024-09-22T01:35:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970398+0000", 2024-09-22T01:35:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7240000000000001e-05 2024-09-22T01:35:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970509+0000", 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111172 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970612+0000", 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103523 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970783+0000", 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017049900000000001 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.972334+0000", 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001550877 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.972968+0000", 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063434500000000003 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.973039+0000", 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1475000000000003e-05 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.973092+0000", 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2235999999999999e-05 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:926 3.0 3:04479396:::rbd_id.image_client.0-clone2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.624791+0000", 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.582095813, 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038771449999999998, 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 926 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624791+0000", 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624791+0000", 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624793+0000", 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5069999999999999e-06 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624803+0000", 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7159999999999998e-06 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624827+0000", 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3685000000000001e-05 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624840+0000", 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3472000000000001e-05 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624912+0000", 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1464999999999994e-05 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:35:10.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624918+0000", 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3239999999999999e-06 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.627061+0000", 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021427379999999999 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.627157+0000", 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6825999999999998e-05 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.627290+0000", 2024-09-22T01:35:10.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013283500000000001 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628069+0000", 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000779216 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628548+0000", 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00047880699999999998 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628616+0000", 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7842000000000005e-05 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628668+0000", 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1712000000000002e-05 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:4527 3.4 3:277b6bc9:::rbd_data.110ff3dda363.0000000000000025:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:58.625681+0000", 2024-09-22T01:35:10.287 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 11.581205893, 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025441489999999999, 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 4527 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625681+0000", 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625681+0000", 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625683+0000", 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2639999999999998e-06 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625691+0000", 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4950000000000008e-06 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625711+0000", 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.986e-05 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625722+0000", 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625795+0000", 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3517999999999996e-05 2024-09-22T01:35:10.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625879+0000", 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3183999999999995e-05 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.626012+0000", 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013331899999999999 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.627754+0000", 2024-09-22T01:35:10.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017424140000000001 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.628111+0000", 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035656300000000001 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.628173+0000", 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2651999999999996e-05 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.628225+0000", 2024-09-22T01:35:10.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1292000000000003e-05 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.103152884, 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.293 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:10.298 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.1020871889999997, 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:35:10.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:35:10.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:35:10.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:35:10.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7940546990000001, 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.304 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.7936804049999999, 2024-09-22T01:35:10.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:35:10.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.314 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:51881 3.0 3:00bdea9d:::rbd_data.110ffcdf9ae8.0000000000000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:09.386809+0000", 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.82007727900000005, 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030937849999999999, 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51881 2024-09-22T01:35:10.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386809+0000", 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386809+0000", 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386811+0000", 2024-09-22T01:35:10.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.821e-06 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386819+0000", 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8499999999999994e-06 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386845+0000", 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5653e-05 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386858+0000", 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3757000000000001e-05 2024-09-22T01:35:10.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386953+0000", 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4246000000000005e-05 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.387067+0000", 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114788 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.387206+0000", 2024-09-22T01:35:10.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013866900000000001 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.388363+0000", 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011565410000000001 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.389825+0000", 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014623360000000001 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.389864+0000", 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9555000000000003e-05 2024-09-22T01:35:10.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:10.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:10.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:10.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.389903+0000", 2024-09-22T01:35:10.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8569000000000003e-05 2024-09-22T01:35:10.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:10.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:10.320 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:10.321 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:10.322 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:10.323 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:10.321+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:10.423 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:10.418+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:10.494 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:10.495 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:10.495 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:10.495 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:10.511 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:10.521 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:10.521 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:10.523 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:10.518+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:10.538 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:10.538 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:10.555 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:10.555 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:10.572 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:10.572 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:10.593 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:10.614 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:10.614 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:10.624 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:10.622+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:10.635 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:10.635 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:10.637 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:10.637 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:10.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:10.655 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:10.655 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:10.669 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:10.669 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:35:10.669 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-22T01:35:10.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-22T01:35:10.682 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:35:10.725 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:10.722+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:10.779 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone7 from 0xb90c3d2 (overlap 0x9dfb5c) to 0x3f3158 2024-09-22T01:35:10.784 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:10.784 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:10.805 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:10.853 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:10.853+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:10.869 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-22T01:35:10.927 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:10.926+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:10.939 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:10.939 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:10.953 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:11.041 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:11.041+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 38, 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "2d4626ba-577e-46d9-ad53-8451e5733f43", 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-22T01:34:18.722829+0000", 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-22T01:35:10.655283+0000", 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-22T01:34:31.284224+0000", 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-22T01:34:21.023265+0000", 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-22T01:35:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 3, 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-22T01:35:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:31.452919+0000", 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:35:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:35:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "16", 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:35:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:35:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "rbd", 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:36.960578+0000", 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:35:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "20", 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 2, 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 20, 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:35:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:35:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.9900000095367432, 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.9900000095367432, 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.87999999523162842, 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-22T01:35:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "pool_client.0", 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:46.686791+0000", 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:35:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "38", 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:35:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 10, 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 38, 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:35:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:35:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:35:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "8de621b1-0a3b-4b8b-b982-70e8db073085", 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 35, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/1213730345", 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/1213730345", 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/1213730345", 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/1213730345", 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "798cbd57-ebd4-461a-9bbf-68e683d1049e", 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.4805145263671875, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3361514324", 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3361514324", 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3361514324", 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3361514324", 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9294585f-3dc9-4b04-8cae-f8d78c92791e", 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/4002178714", 2024-09-22T01:35:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/4002178714", 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/4002178714", 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/4002178714", 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "1ff1abf7-fdbb-4f8a-85e5-90f102abcec2", 2024-09-22T01:35:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-22T01:35:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/2610959301", 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/2610959301", 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/2610959301", 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/2610959301", 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9aa2579a-ada1-45f3-9341-f46697c28212", 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6824", 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6825", 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6826", 2024-09-22T01:35:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6827", 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6830", 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6831", 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6828", 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6829", 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6825/482886379", 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6827/482886379", 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6831/482886379", 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6829/482886379", 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4a6678eb-28ca-4b05-96ae-e9deeb60ca96", 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6816", 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6817", 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6818", 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6819", 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6822", 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6823", 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6820", 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6821", 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6817/2695689817", 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6819/2695689817", 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6823/2695689817", 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6821/2695689817", 2024-09-22T01:35:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "775b01e8-5705-4b98-a3ab-f15a78271355", 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6808", 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6809", 2024-09-22T01:35:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6810", 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6811", 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6814", 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6815", 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6812", 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6813", 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6809/1840779137", 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6811/1840779137", 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6815/1840779137", 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6813/1840779137", 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "15f6d6c1-8a16-42c6-9e43-f3a92e511735", 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 22, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:35:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6800", 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6801", 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6802", 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6803", 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6806", 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6807", 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6804", 2024-09-22T01:35:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:35:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6805", 2024-09-22T01:35:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:35:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6801/4222842386", 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6803/4222842386", 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6807/4222842386", 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6805/4222842386", 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-22T01:35:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.339566+0000", 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.065958+0000", 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.261750+0000", 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.463117+0000", 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.557372+0000", 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.195553+0000", 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.008891+0000", 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:27.839466+0000", 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [ 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "3.8", 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: 0, 2024-09-22T01:35:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: 2 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-22T01:35:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-22T01:35:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-22T01:35:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:11.143 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:11.144 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:11.144 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:11.145 INFO:tasks.thrashosds.thrasher:j is {'epoch': 38, 'fsid': '2d4626ba-577e-46d9-ad53-8451e5733f43', 'created': '2024-09-22T01:34:18.722829+0000', 'modified': '2024-09-22T01:35:10.655283+0000', 'last_up_change': '2024-09-22T01:34:31.284224+0000', 'last_in_change': '2024-09-22T01:34:21.023265+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-22T01:34:31.452919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-22T01:34:36.960578+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-22T01:34:46.686791+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 10, 'snap_epoch': 38, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}], 'osds': [{'osd': 0, 'uuid': '8de621b1-0a3b-4b8b-b982-70e8db073085', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6824', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6825', 'nonce': 1213730345}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6826', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6827', 'nonce': 1213730345}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6830', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6831', 'nonce': 1213730345}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6828', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6829', 'nonce': 1213730345}]}, 'public_addr': '172.21.15.18:6825/1213730345', 'cluster_addr': '172.21.15.18:6827/1213730345', 'heartbeat_back_addr': '172.21.15.18:6831/1213730345', 'heartbeat_front_addr': '172.21.15.18:6829/1213730345', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '798cbd57-ebd4-461a-9bbf-68e683d1049e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.4805145263671875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6800', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6801', 'nonce': 3361514324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6803', 'nonce': 3361514324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6807', 'nonce': 3361514324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6805', 'nonce': 3361514324}]}, 'public_addr': '172.21.15.18:6801/3361514324', 'cluster_addr': '172.21.15.18:6803/3361514324', 'heartbeat_back_addr': '172.21.15.18:6807/3361514324', 'heartbeat_front_addr': '172.21.15.18:6805/3361514324', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '9294585f-3dc9-4b04-8cae-f8d78c92791e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6817', 'nonce': 4002178714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6818', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6819', 'nonce': 4002178714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6822', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6823', 'nonce': 4002178714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6820', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6821', 'nonce': 4002178714}]}, 'public_addr': '172.21.15.18:6817/4002178714', 'cluster_addr': '172.21.15.18:6819/4002178714', 'heartbeat_back_addr': '172.21.15.18:6823/4002178714', 'heartbeat_front_addr': '172.21.15.18:6821/4002178714', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1ff1abf7-fdbb-4f8a-85e5-90f102abcec2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6809', 'nonce': 2610959301}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6811', 'nonce': 2610959301}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6815', 'nonce': 2610959301}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6813', 'nonce': 2610959301}]}, 'public_addr': '172.21.15.18:6809/2610959301', 'cluster_addr': '172.21.15.18:6811/2610959301', 'heartbeat_back_addr': '172.21.15.18:6815/2610959301', 'heartbeat_front_addr': '172.21.15.18:6813/2610959301', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '9aa2579a-ada1-45f3-9341-f46697c28212', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6824', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6825', 'nonce': 482886379}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6826', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6827', 'nonce': 482886379}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6830', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6831', 'nonce': 482886379}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6828', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6829', 'nonce': 482886379}]}, 'public_addr': '172.21.15.179:6825/482886379', 'cluster_addr': '172.21.15.179:6827/482886379', 'heartbeat_back_addr': '172.21.15.179:6831/482886379', 'heartbeat_front_addr': '172.21.15.179:6829/482886379', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4a6678eb-28ca-4b05-96ae-e9deeb60ca96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6816', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6817', 'nonce': 2695689817}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6818', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6819', 'nonce': 2695689817}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6822', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6823', 'nonce': 2695689817}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6820', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6821', 'nonce': 2695689817}]}, 'public_addr': '172.21.15.179:6817/2695689817', 'cluster_addr': '172.21.15.179:6819/2695689817', 'heartbeat_back_addr': '172.21.15.179:6823/2695689817', 'heartbeat_front_addr': '172.21.15.179:6821/2695689817', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '775b01e8-5705-4b98-a3ab-f15a78271355', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6808', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6809', 'nonce': 1840779137}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6810', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6811', 'nonce': 1840779137}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6814', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6815', 'nonce': 1840779137}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6812', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6813', 'nonce': 1840779137}]}, 'public_addr': '172.21.15.179:6809/1840779137', 'cluster_addr': '172.21.15.179:6811/1840779137', 'heartbeat_back_addr': '172.21.15.179:6815/1840779137', 'heartbeat_front_addr': '172.21.15.179:6813/1840779137', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '15f6d6c1-8a16-42c6-9e43-f3a92e511735', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6800', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6801', 'nonce': 4222842386}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6802', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6803', 'nonce': 4222842386}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6806', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6807', 'nonce': 4222842386}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6804', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6805', 'nonce': 4222842386}]}, 'public_addr': '172.21.15.179:6801/4222842386', 'cluster_addr': '172.21.15.179:6803/4222842386', 'heartbeat_back_addr': '172.21.15.179:6807/4222842386', 'heartbeat_front_addr': '172.21.15.179:6805/4222842386', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.339566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.065958+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.261750+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.463117+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.557372+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.195553+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.008891+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:27.839466+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.8', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-22T01:35:11.145 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-22T01:35:11.146 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:11.146 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:11.141+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:11.245 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:11.245+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:11.256 INFO:teuthology.orchestra.run.smithi018.stdout:912 punch from 0xb2f9904 to 0xb2fa897, (0xf93 bytes) 2024-09-22T01:35:11.277 INFO:teuthology.orchestra.run.smithi018.stdout:913 writesame 0xce00527 thru 0xce0fe24 data_size 0x3a(0xf8fe bytes) 2024-09-22T01:35:11.277 INFO:teuthology.orchestra.run.smithi018.stdout:916 write 0x79d0014 thru 0x79d6aed (0x6ada bytes) 2024-09-22T01:35:11.284 INFO:teuthology.orchestra.run.smithi018.stdout:917 write 0x727f414 thru 0x728a467 (0xb054 bytes) 2024-09-22T01:35:11.294 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:11.310 INFO:teuthology.orchestra.run.smithi018.stdout:919 write 0xead0547 thru 0xeadf798 (0xf252 bytes) 2024-09-22T01:35:11.316 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:11.316 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:11.316 INFO:teuthology.orchestra.run.smithi018.stdout:920 read 0x6824870 thru 0x6826b50 (0x22e1 bytes) 2024-09-22T01:35:11.316 INFO:teuthology.orchestra.run.smithi018.stdout:921 read 0xaf8a75a thru 0xaf94c0c (0xa4b3 bytes) 2024-09-22T01:35:11.330 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:11.338 INFO:teuthology.orchestra.run.smithi018.stdout:922 trunc from 0xeadf799 to 0x3097ff6 2024-09-22T01:35:11.372 INFO:teuthology.orchestra.run.smithi018.stdout:923 read 0x1784a2f thru 0x178b695 (0x6c67 bytes) 2024-09-22T01:35:11.373 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:11.373+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:11.402 INFO:teuthology.orchestra.run.smithi018.stdout:924 write 0xb5169e3 thru 0xb51c8e6 (0x5f04 bytes) 2024-09-22T01:35:11.406 INFO:teuthology.orchestra.run.smithi018.stdout:925 read 0x2a28917 thru 0x2a2c220 (0x390a bytes) 2024-09-22T01:35:11.407 INFO:teuthology.orchestra.run.smithi018.stdout:926 write 0xb110cbb thru 0xb11609a (0x53e0 bytes) 2024-09-22T01:35:11.413 INFO:teuthology.orchestra.run.smithi018.stdout:927 read 0x4a5e765 thru 0x4a62999 (0x4235 bytes) 2024-09-22T01:35:11.413 INFO:teuthology.orchestra.run.smithi018.stdout:928 write 0x6ad7fbd thru 0x6ae10ff (0x9143 bytes) 2024-09-22T01:35:11.419 INFO:teuthology.orchestra.run.smithi018.stdout:930 writesame 0x5e73e0c thru 0x5e77d12 data_size 0x7(0x3f07 bytes) 2024-09-22T01:35:11.425 INFO:teuthology.orchestra.run.smithi018.stdout:931 writesame 0x6263d1d thru 0x62647f9 data_size 0x9(0xadd bytes) 2024-09-22T01:35:11.432 INFO:teuthology.orchestra.run.smithi018.stdout:933 trunc from 0xb51c8e7 to 0xac2a39f 2024-09-22T01:35:11.446 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:11.445+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:11.455 INFO:teuthology.orchestra.run.smithi018.stdout:934 punch from 0x5c25bcb to 0x5c33185, (0xd5ba bytes) 2024-09-22T01:35:11.455 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:11.455 INFO:teuthology.orchestra.run.smithi018.stdout:937 write 0x1232c99 thru 0x123e4bb (0xb823 bytes) 2024-09-22T01:35:11.462 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:11.483 INFO:teuthology.orchestra.run.smithi018.stdout:939 writesame 0xdbb575a thru 0xdbbee3f data_size 0x5(0x96e6 bytes) 2024-09-22T01:35:11.483 INFO:teuthology.orchestra.run.smithi018.stdout:941 clone 9 order 24 su 65536 sc 15 2024-09-22T01:35:11.503 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:11.503 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:11.518 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:11.547 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:11.546+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:11.648 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:11.645+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:35:11.689 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:11.689 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:11.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:11.749 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:11.749+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:11.798 INFO:teuthology.orchestra.run.smithi018.stdout:flattening image image_client.0-clone8 2024-09-22T01:35:11.850 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:11.849+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:11.883 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:11.883 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:11.897 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:11.985 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:11.985+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:12.051 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:12.049+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:12.063 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:12.064 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:12.078 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:12.120 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-22T01:35:12.138 INFO:teuthology.orchestra.run.smithi018.stdout:942 write 0x6d7f8b3 thru 0x6d8752e (0x7c7c bytes) 2024-09-22T01:35:12.156 INFO:teuthology.orchestra.run.smithi018.stdout:943 write 0x966d73f thru 0x9679b50 (0xc412 bytes) 2024-09-22T01:35:12.165 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:12.165+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:12.168 INFO:teuthology.orchestra.run.smithi018.stdout:945 write 0x152d583 thru 0x153a414 (0xce92 bytes) 2024-09-22T01:35:12.179 INFO:teuthology.orchestra.run.smithi018.stdout:946 write 0xd0af19c thru 0xd0bd9cb (0xe830 bytes) 2024-09-22T01:35:12.182 INFO:teuthology.orchestra.run.smithi018.stdout:947 writesame 0x95856c9 thru 0x9594f89 data_size 0x1(0xf8c1 bytes) 2024-09-22T01:35:12.233 INFO:teuthology.orchestra.run.smithi018.stdout:948 trunc from 0xdbbee40 to 0x5e0b292 2024-09-22T01:35:12.252 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:12.249+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:12.260 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:12.260 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:12.276 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:12.307 INFO:teuthology.orchestra.run.smithi018.stdout:949 write 0xb7fa1a6 thru 0xb80509d (0xaef8 bytes) 2024-09-22T01:35:12.333 INFO:teuthology.orchestra.run.smithi018.stdout:950 trunc from 0xb80509e to 0x26821b5 2024-09-22T01:35:12.361 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:12.361+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:12.383 INFO:teuthology.orchestra.run.smithi018.stdout:953 writesame 0x9f83683 thru 0x9f8feca data_size 0x88(0xc848 bytes) 2024-09-22T01:35:12.392 INFO:teuthology.orchestra.run.smithi018.stdout:955 trunc from 0x9f8fecb to 0x78f0ccf 2024-09-22T01:35:12.412 INFO:teuthology.orchestra.run.smithi018.stdout:956 writesame 0x76a6fb thru 0x77795f data_size 0x1(0xd265 bytes) 2024-09-22T01:35:12.439 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:12.439 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:12.453 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:12.456 INFO:teuthology.orchestra.run.smithi018.stdout:957 read 0x22c355b thru 0x22c6c05 (0x36ab bytes) 2024-09-22T01:35:12.457 INFO:teuthology.orchestra.run.smithi018.stdout:958 read 0x566d6b1 thru 0x567665b (0x8fab bytes) 2024-09-22T01:35:12.458 INFO:teuthology.orchestra.run.smithi018.stdout:961 read 0x3ac7523 thru 0x3acce7d (0x595b bytes) 2024-09-22T01:35:12.459 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:12.459 INFO:teuthology.orchestra.run.smithi018.stdout:965 read 0x4852aac thru 0x485a0d3 (0x7628 bytes) 2024-09-22T01:35:12.484 INFO:teuthology.orchestra.run.smithi018.stdout:966 write 0xad0cb37 thru 0xad170e3 (0xa5ad bytes) 2024-09-22T01:35:12.488 INFO:teuthology.orchestra.run.smithi018.stdout:967 read 0x25a2f83 thru 0x25a5fb0 (0x302e bytes) 2024-09-22T01:35:12.489 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:12.497 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:12.497+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:12.512 INFO:teuthology.orchestra.run.smithi018.stdout:969 trunc from 0xad170e4 to 0x2742c6a 2024-09-22T01:35:12.532 INFO:teuthology.orchestra.run.smithi018.stdout:970 read 0x15dac01 thru 0x15e4fc3 (0xa3c3 bytes) 2024-09-22T01:35:12.546 INFO:teuthology.orchestra.run.smithi018.stdout:971 trunc from 0x2742c6a to 0x6f49dad 2024-09-22T01:35:12.555 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:12.554+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:12.559 INFO:teuthology.orchestra.run.smithi018.stdout:972 writesame 0x78cc8b thru 0x7943bf data_size 0x1(0x7735 bytes) 2024-09-22T01:35:12.572 INFO:teuthology.orchestra.run.smithi018.stdout:973 read 0x67107d thru 0x673038 (0x1fbc bytes) 2024-09-22T01:35:12.579 INFO:teuthology.orchestra.run.smithi018.stdout:974 trunc from 0x6f49dad to 0x4b8d2df 2024-09-22T01:35:12.599 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:12.621 INFO:teuthology.orchestra.run.smithi018.stdout:976 write 0x6fdf70d thru 0x6fed7d5 (0xe0c9 bytes) 2024-09-22T01:35:12.624 INFO:teuthology.orchestra.run.smithi018.stdout:978 read 0x1d40b2a thru 0x1d4bc31 (0xb108 bytes) 2024-09-22T01:35:12.625 INFO:teuthology.orchestra.run.smithi018.stdout:980 read 0x45349ad thru 0x45374e6 (0x2b3a bytes) 2024-09-22T01:35:12.629 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:12.629 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:12.643 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:12.644 INFO:teuthology.orchestra.run.smithi018.stdout:981 trunc from 0x6fed7d6 to 0x11dc70 2024-09-22T01:35:12.657 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:12.654+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:12.664 INFO:teuthology.orchestra.run.smithi018.stdout:982 read 0x4b62f thru 0x55f3f (0xa911 bytes) 2024-09-22T01:35:12.671 INFO:teuthology.orchestra.run.smithi018.stdout:983 trunc from 0x11dc70 to 0x238415a 2024-09-22T01:35:12.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:12.683 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:12.718 INFO:teuthology.orchestra.run.smithi018.stdout:986 write 0xb2b55ba thru 0xb2c04a9 (0xaef0 bytes) 2024-09-22T01:35:12.720 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:12.720 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:12.734 INFO:teuthology.orchestra.run.smithi018.stdout:989 write 0xde1aef4 thru 0xde1c869 (0x1976 bytes) 2024-09-22T01:35:12.736 INFO:teuthology.orchestra.run.smithi018.stdout:990 flatten 2024-09-22T01:35:12.747 INFO:teuthology.orchestra.run.smithi018.stdout:991 write 0x11fdddf thru 0x1205287 (0x74a9 bytes) 2024-09-22T01:35:12.750 INFO:teuthology.orchestra.run.smithi018.stdout:992 read 0xbcbfcfd thru 0xbcc1287 (0x158b bytes) 2024-09-22T01:35:12.750 INFO:teuthology.orchestra.run.smithi018.stdout:993 punch from 0x6b54460 to 0x6b563f4, (0x1f94 bytes) 2024-09-22T01:35:12.751 INFO:teuthology.orchestra.run.smithi018.stdout:994 trunc from 0xde1c86a to 0xe101d94 2024-09-22T01:35:12.757 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:12.757+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:12.760 INFO:teuthology.orchestra.run.smithi018.stdout:996 read 0x8d8432 thru 0x8e3a27 (0xb5f6 bytes) 2024-09-22T01:35:12.762 INFO:teuthology.orchestra.run.smithi018.stdout:997 write 0x2b1e3be thru 0x2b25ab9 (0x76fc bytes) 2024-09-22T01:35:12.765 INFO:teuthology.orchestra.run.smithi018.stdout:1000 punch from 0x15bd26f to 0x15cab4f, (0xd8e0 bytes) 2024-09-22T01:35:12.765 INFO:teuthology.orchestra.run.smithi018.stdout:1001 read 0x9da5eb7 thru 0x9da9b58 (0x3ca2 bytes) 2024-09-22T01:35:12.772 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:12.772 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:12.775 INFO:teuthology.orchestra.run.smithi018.stdout:1002 trunc from 0xe101d94 to 0x9ce76c0 2024-09-22T01:35:12.789 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:12.792 INFO:teuthology.orchestra.run.smithi018.stdout:1004 read 0x754e9ee thru 0x7553d5a (0x536d bytes) 2024-09-22T01:35:12.793 INFO:teuthology.orchestra.run.smithi018.stdout:1006 punch from 0x5f8de13 to 0x5f94c18, (0x6e05 bytes) 2024-09-22T01:35:12.793 INFO:teuthology.orchestra.run.smithi018.stdout:1007 write 0x6ef5ea9 thru 0x6efceff (0x7057 bytes) 2024-09-22T01:35:12.796 INFO:teuthology.orchestra.run.smithi018.stdout:1008 write 0x962ee9d thru 0x962f766 (0x8ca bytes) 2024-09-22T01:35:12.798 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:12.798 INFO:teuthology.orchestra.run.smithi018.stdout:1011 trunc from 0x9ce76c0 to 0xa0dabd3 2024-09-22T01:35:12.808 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:12.808 INFO:teuthology.orchestra.run.smithi018.stdout:1013 punch from 0x776c1c6 to 0x77714ca, (0x5304 bytes) 2024-09-22T01:35:12.808 INFO:teuthology.orchestra.run.smithi018.stdout:1014 punch from 0x1561dc7 to 0x156528e, (0x34c7 bytes) 2024-09-22T01:35:12.808 INFO:teuthology.orchestra.run.smithi018.stdout:1016 read 0x69d4ad3 thru 0x69d508a (0x5b8 bytes) 2024-09-22T01:35:12.825 INFO:teuthology.orchestra.run.smithi018.stdout:1018 write 0xe0622b8 thru 0xe06bb01 (0x984a bytes) 2024-09-22T01:35:12.827 INFO:teuthology.orchestra.run.smithi018.stdout:1019 write 0x90bb806 thru 0x90c51df (0x99da bytes) 2024-09-22T01:35:12.835 INFO:teuthology.orchestra.run.smithi018.stdout:1020 trunc from 0xe06bb02 to 0xa9ec782 2024-09-22T01:35:12.845 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:12.846 INFO:teuthology.orchestra.run.smithi018.stdout:1023 punch from 0x8ec5ec to 0x8fb83a, (0xf24e bytes) 2024-09-22T01:35:12.854 INFO:teuthology.orchestra.run.smithi018.stdout:1024 trunc from 0xa9ec782 to 0x44a1363 2024-09-22T01:35:12.858 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:12.854+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:12.858 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:12.858 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:12.866 INFO:teuthology.orchestra.run.smithi018.stdout:1025 clone 10 order 24 su 4194304 sc 6 2024-09-22T01:35:12.877 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:12.877 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:12.893 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:12.893 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:12.910 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:12.910 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:12.928 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:12.928 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:12.950 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:12.958 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:12.954+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:12.959 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:12.960 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:12.971 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:12.971 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:12.974 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:12.993 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:12.993 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:13.060 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:13.057+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:13.092 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:13.093 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:13.093 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:13.093 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:13.107 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:13.160 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:13.157+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:13.235 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:13.236 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:13.236 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:13.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:13.295 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:13.294+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:13.362 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:13.358+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:13.379 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48565 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 708608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9123142150000003, 2024-09-22T01:35:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086712429999999993, 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48565 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466221+0000", 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9299999999999998e-07 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466224+0000", 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.977e-06 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466233+0000", 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1419999999999999e-06 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466240+0000", 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6800000000000004e-06 2024-09-22T01:35:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552634+0000", 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086394356000000005 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552731+0000", 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6681000000000005e-05 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552933+0000", 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020200099999999999 2024-09-22T01:35:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48566 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 718848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9122860360000002, 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086846866999999994, 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48566 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.06e-07 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466252+0000", 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.813e-06 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466261+0000", 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7260000000000008e-06 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466267+0000", 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5400000000000001e-06 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552974+0000", 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086707237000000006 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553025+0000", 2024-09-22T01:35:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0380000000000002e-05 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553095+0000", 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0564999999999999e-05 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48654 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9080429959999998, 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086747482000000001, 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48654 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5700000000000001e-07 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470498+0000", 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470515+0000", 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7742000000000001e-05 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470546+0000", 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0586000000000002e-05 2024-09-22T01:35:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557000+0000", 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086454002000000002 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557110+0000", 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010961 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557239+0000", 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48655 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 638976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9079674259999999, 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086840121000000006, 2024-09-22T01:35:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48655 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470569+0000", 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5400000000000001e-06 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470575+0000", 2024-09-22T01:35:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1399999999999997e-06 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470597+0000", 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1676e-05 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470614+0000", 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7336000000000001e-05 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557279+0000", 2024-09-22T01:35:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086664832999999997 2024-09-22T01:35:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557341+0000", 2024-09-22T01:35:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2073e-05 2024-09-22T01:35:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557407+0000", 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6523e-05 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9078642429999997, 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:35:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:35:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9077898329999998, 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:35:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:35:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9077333020000005, 2024-09-22T01:35:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:35:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:35:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:35:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9076757080000002, 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:35:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9076183699999998, 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9075609289999997, 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:35:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9075250199999996, 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48750 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9026222189999995, 2024-09-22T01:35:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086758792000000001, 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48750 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475914+0000", 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.263e-06 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475919+0000", 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.84e-06 2024-09-22T01:35:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475937+0000", 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7689e-05 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475951+0000", 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3439e-05 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562548+0000", 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086597376000000004 2024-09-22T01:35:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562605+0000", 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7367999999999997e-05 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562671+0000", 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5816999999999997e-05 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48751 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 641024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.902547889, 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086829097999999993, 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48751 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475988+0000", 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.47e-07 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475994+0000", 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1260000000000003e-06 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476019+0000", 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5471999999999999e-05 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476033+0000", 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100000000000001e-05 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562691+0000", 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086657746999999993 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562750+0000", 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9188000000000003e-05 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562816+0000", 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5518000000000005e-05 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9024813219999999, 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.440 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:35:13.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:35:13.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:35:13.443 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9024178809999999, 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.444 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9023626440000001, 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.448 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:35:13.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9022893300000003, 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:35:13.452 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:13.456 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9022352490000003, 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:35:13.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:35:13.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.902180811, 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.464 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.9021249500000001, 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:35:13.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:35:13.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:35:13.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.469 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.469 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.469 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:13.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:13.471 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:13.469+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:13.571 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:13.569+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:13.644 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:13.644 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:13.644 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:13.644 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:13.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:13.672 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:13.669+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:13.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:35:13.774 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:13.773+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:13.788 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:13.788 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:13.805 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:13.875 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:13.870+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:13.880 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-22T01:35:13.935 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:602 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.234945080999999, 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055897943999999998, 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 602 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699628+0000", 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6330000000000002e-06 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699650+0000", 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2056999999999999e-05 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699689+0000", 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9109000000000001e-05 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699707+0000", 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7207e-05 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699868+0000", 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016106200000000001 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.700040+0000", 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171865 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.707678+0000", 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076380479999999997 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755348+0000", 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.047670037999999998 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755387+0000", 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9662000000000001e-05 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755455+0000", 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7995000000000002e-05 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755523+0000", 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7267999999999994e-05 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.941 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11290 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0643198120000008, 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048997573000000003, 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11290 2024-09-22T01:35:13.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870253+0000", 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5019999999999999e-06 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870274+0000", 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1064999999999999e-05 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870280+0000", 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3230000000000003e-06 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919056+0000", 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048776031999999997 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919138+0000", 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1846000000000002e-05 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919247+0000", 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000109329 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11291 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0642780050000002, 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049210375000000001, 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.946 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11291 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870461+0000", 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169476 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870465+0000", 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870477+0000", 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1207e-05 2024-09-22T01:35:13.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870484+0000", 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.481e-06 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919295+0000", 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048810529999999998 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919380+0000", 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5773999999999996e-05 2024-09-22T01:35:13.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919502+0000", 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121662 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11292 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0640720750000003, 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049215074999999997, 2024-09-22T01:35:13.950 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11292 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870610+0000", 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112569 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870615+0000", 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3630000000000004e-06 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870626+0000", 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1460999999999999e-05 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870633+0000", 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8170000000000001e-06 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919546+0000", 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048912723999999998 2024-09-22T01:35:13.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919651+0000", 2024-09-22T01:35:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105437 2024-09-22T01:35:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919713+0000", 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1704000000000004e-05 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11293 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0639255429999999, 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049300425000000002, 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11293 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870769+0000", 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125289 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870774+0000", 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1099999999999996e-06 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870784+0000", 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0664e-05 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870791+0000", 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919753+0000", 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048961849000000002 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919840+0000", 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6917999999999997e-05 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919945+0000", 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010444499999999999 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11294 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 694272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0637667000000004, 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049352066999999999, 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11294 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870909+0000", 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105821 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870913+0000", 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3329999999999998e-06 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870929+0000", 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6146000000000001e-05 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870938+0000", 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8470000000000002e-06 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919988+0000", 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049050170999999997 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920051+0000", 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2337999999999998e-05 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920155+0000", 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104411 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.971 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11295 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 868352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0636193689999995, 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049438600999999999, 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11295 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872025+0000", 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001075037 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872031+0000", 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3619999999999997e-06 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872043+0000", 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2075999999999999e-05 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872052+0000", 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-06 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920196+0000", 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048143803999999998 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920284+0000", 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7454999999999995e-05 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920389+0000", 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105167 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11313 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 346112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0624547890000002, 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048873528999999999, 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11313 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6300000000000001e-07 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872117+0000", 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2450000000000001e-06 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872125+0000", 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872130+0000", 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9280000000000001e-06 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920837+0000", 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048706948999999999 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920921+0000", 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3459000000000002e-05 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920988+0000", 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7644000000000005e-05 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11314 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.980 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0624322750000008, 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049091919999999997, 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11314 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:13.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872138+0000", 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3799999999999998e-07 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872140+0000", 2024-09-22T01:35:13.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5500000000000001e-06 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872147+0000", 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6680000000000004e-06 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872152+0000", 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4269999999999999e-06 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921028+0000", 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048875778000000002 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921118+0000", 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0148000000000005e-05 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921229+0000", 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110911 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11315 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0624106209999997, 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049217209999999997, 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11315 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.985 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872362+0000", 2024-09-22T01:35:13.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203131 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872368+0000", 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6210000000000001e-06 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872379+0000", 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872388+0000", 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000002e-06 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921263+0000", 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048874828000000002 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921309+0000", 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5843000000000001e-05 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921376+0000", 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7429999999999996e-05 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11316 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0621678820000007, 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049209332000000001, 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11316 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872627+0000", 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022554899999999999 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872638+0000", 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0964e-05 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872652+0000", 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100999999999999e-05 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872661+0000", 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8340000000000005e-06 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921415+0000", 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048753713999999997 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921505+0000", 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9554000000000004e-05 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921611+0000", 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106616 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11317 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 714752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0618955809999999, 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049068392000000002, 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.993 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11317 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872821+0000", 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014710999999999999 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872826+0000", 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5399999999999997e-06 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:13.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872839+0000", 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3441999999999999e-05 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872854+0000", 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4364e-05 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921646+0000", 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048791961000000002 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921688+0000", 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.286e-05 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921742+0000", 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4114999999999999e-05 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11318 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 888832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:13.997 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0617039449999996, 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049108288, 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11318 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:13.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873096+0000", 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023050300000000001 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:13.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873102+0000", 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5269999999999998e-06 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873114+0000", 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1802e-05 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873121+0000", 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4209999999999998e-06 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921782+0000", 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048660582000000001 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921869+0000", 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7798000000000002e-05 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921974+0000", 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010465499999999999 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11319 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 899072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0614363210000004, 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048963590000000001, 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11319 2024-09-22T01:35:14.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873305+0000", 2024-09-22T01:35:14.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017154 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873310+0000", 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873326+0000", 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.558e-05 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873343+0000", 2024-09-22T01:35:14.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6894000000000001e-05 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922006+0000", 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.04866293 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922047+0000", 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0952999999999999e-05 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922097+0000", 2024-09-22T01:35:14.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0413e-05 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11333 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 8192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0612136400000001, 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048982295000000002, 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11333 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875169+0000", 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018133089999999999 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875175+0000", 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875189+0000", 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3886999999999999e-05 2024-09-22T01:35:14.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875197+0000", 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5369999999999997e-06 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922139+0000", 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.046941573 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922231+0000", 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2565000000000006e-05 2024-09-22T01:35:14.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922338+0000", 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107124 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11384 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 755712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0567906409999992, 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048901420000000001, 2024-09-22T01:35:14.010 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11384 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877943+0000", 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164411 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877948+0000", 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3340000000000003e-06 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877959+0000", 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1027e-05 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877966+0000", 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1099999999999997e-06 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926570+0000", 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048603810999999997 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926616+0000", 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6335999999999998e-05 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926680+0000", 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4391000000000001e-05 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.014 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11386 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 940032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0564506619999996, 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048882052000000002, 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11386 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878210+0000", 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1310999999999994e-05 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878215+0000", 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4259999999999996e-06 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878229+0000", 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.448e-05 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878244+0000", 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718e-05 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926854+0000", 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048610318999999999 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926939+0000", 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4919999999999993e-05 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927001+0000", 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1878000000000006e-05 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11401 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0563121790000007, 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048953133000000003, 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11401 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.019 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878258+0000", 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:35:14.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878261+0000", 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7590000000000002e-06 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878269+0000", 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878276+0000", 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2420000000000003e-06 2024-09-22T01:35:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927095+0000", 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048819573999999998 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927153+0000", 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7120000000000002e-05 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927211+0000", 2024-09-22T01:35:14.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8062000000000001e-05 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11402 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 59392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0562863829999998, 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049110529, 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.023 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11402 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879206+0000", 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092231699999999997 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879211+0000", 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1830000000000002e-06 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879223+0000", 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2388000000000001e-05 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879229+0000", 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3800000000000002e-06 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927251+0000", 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048022479999999999 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927321+0000", 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9760999999999998e-05 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927394+0000", 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3020000000000002e-05 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11408 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 776192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.879316+0000", 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.0552533529999994, 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048856469, 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11408 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879316+0000", 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879316+0000", 2024-09-22T01:35:14.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879553+0000", 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023645200000000001 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879558+0000", 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3140000000000003e-06 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879568+0000", 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0271999999999999e-05 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879576+0000", 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5320000000000001e-06 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.928065+0000", 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048489281000000002 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.928120+0000", 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5265e-05 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.928173+0000", 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2352999999999998e-05 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.031 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:14.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:14.033 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:14.033+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:14.133 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:14.133+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:14.200 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:14.200 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:14.200 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:14.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:14.267 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:14.266+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:14.308 INFO:teuthology.orchestra.run.smithi018.stdout:1029 write 0x8215e6e thru 0x821f54d (0x96e0 bytes) 2024-09-22T01:35:14.315 INFO:teuthology.orchestra.run.smithi018.stdout:1030 read 0x3f66df8 thru 0x3f6b5ea (0x47f3 bytes) 2024-09-22T01:35:14.316 INFO:teuthology.orchestra.run.smithi018.stdout:1031 trunc from 0x821f54e to 0x8849e2e 2024-09-22T01:35:14.329 INFO:teuthology.orchestra.run.smithi018.stdout:1033 trunc from 0x8849e2e to 0x8643ef8 2024-09-22T01:35:14.335 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:14.333+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:14.340 INFO:teuthology.orchestra.run.smithi018.stdout:1034 clone 11 order 20 su 131072 sc 10 2024-09-22T01:35:14.352 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:14.352 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:14.352 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:14.353 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:14.353 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:14.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:14.436 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:14.433+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:14.537 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:14.534+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:14.543 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:14.543 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:14.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:14.543 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:14.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.5409538, 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:35:14.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:35:14.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:401 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 2722870~26550] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.183502+0000", 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.356072983000001, 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003583546, 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.548 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 401 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183502+0000", 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183502+0000", 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183505+0000", 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183537+0000", 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2387e-05 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183574+0000", 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6792000000000003e-05 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183592+0000", 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7594000000000001e-05 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.183765+0000", 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017329199999999999 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.184174+0000", 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040908699999999998 2024-09-22T01:35:14.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.184570+0000", 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00039599699999999998 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.186552+0000", 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019815039999999998 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.186919+0000", 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036720999999999998 2024-09-22T01:35:14.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.187005+0000", 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6377000000000003e-05 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.187086+0000", 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0436e-05 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.553 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:441 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 1698514~5422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.259092+0000", 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.280483350000001, 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0035962960000000001, 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 441 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259092+0000", 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259092+0000", 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259095+0000", 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.033e-06 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259116+0000", 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0964000000000001e-05 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259153+0000", 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7539000000000001e-05 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259171+0000", 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8122999999999999e-05 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259335+0000", 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016369900000000001 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259476+0000", 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014099199999999999 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.259744+0000", 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026825200000000002 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.261485+0000", 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017411099999999999 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.262375+0000", 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00088960000000000005 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.262560+0000", 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018467200000000001 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.262688+0000", 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128312 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.559 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:455 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.294520+0000", 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.245055192999999, 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038360400000000002, 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 455 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294520+0000", 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294520+0000", 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294523+0000", 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1930000000000002e-06 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294538+0000", 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4824000000000001e-05 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294572+0000", 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4452999999999997e-05 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294589+0000", 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6342999999999999e-05 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.294735+0000", 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014678200000000001 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.295131+0000", 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000395423 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.295756+0000", 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00062471599999999999 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298058+0000", 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002302662 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298164+0000", 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106156 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298265+0000", 2024-09-22T01:35:14.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100416 2024-09-22T01:35:14.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.298356+0000", 2024-09-22T01:35:14.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1071999999999998e-05 2024-09-22T01:35:14.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.565 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.566 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.566 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:14.566 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.211304147, 2024-09-22T01:35:14.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:35:14.566 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.566 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.566 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:35:14.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:35:14.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:35:14.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.211160641999999, 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:35:14.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:35:14.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.577 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:460 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328544+0000", 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.211030825999998, 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037580539999999998, 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 460 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328544+0000", 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328544+0000", 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328545+0000", 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3030000000000001e-06 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328553+0000", 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2799999999999998e-06 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328576+0000", 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3390000000000001e-05 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328594+0000", 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7537000000000002e-05 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328743+0000", 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014983499999999999 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328943+0000", 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00019979899999999999 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329312+0000", 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00036868699999999998 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331648+0000", 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0023359679999999999 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332048+0000", 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000399971 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332206+0000", 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000157725 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332302+0000", 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6558999999999995e-05 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:501 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 747835~19156] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.419429+0000", 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.120145717, 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0029796340000000001, 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 501 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419429+0000", 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419429+0000", 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419433+0000", 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.343e-06 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419462+0000", 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.915e-05 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419500+0000", 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8742999999999998e-05 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419520+0000", 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9996e-05 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419649+0000", 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000128293 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.419795+0000", 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014619200000000001 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.420087+0000", 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000292145 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.421930+0000", 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018432279999999999 2024-09-22T01:35:14.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.422229+0000", 2024-09-22T01:35:14.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029903500000000001 2024-09-22T01:35:14.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.422328+0000", 2024-09-22T01:35:14.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8951999999999997e-05 2024-09-22T01:35:14.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.422409+0000", 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0556999999999995e-05 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:514 3.0 3:023caaec:::rbd_data.110fc6985e86.0000000000000011:head [set-alloc-hint object_size 8388608 write_size 8388608,write 524288~47387] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.589 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.454885+0000", 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.084689848, 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0031286930000000001, 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 514 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454885+0000", 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454885+0000", 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454888+0000", 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454934+0000", 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5745999999999999e-05 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454970+0000", 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6566000000000002e-05 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.454988+0000", 2024-09-22T01:35:14.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7204e-05 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.455119+0000", 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013154200000000001 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.455362+0000", 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024244800000000001 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.455602+0000", 2024-09-22T01:35:14.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024033799999999999 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.457426+0000", 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018243230000000001 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.457838+0000", 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00041149699999999998 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.457938+0000", 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100282 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.458014+0000", 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5840000000000006e-05 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:519 3.4 3:20c2f858:::rbd_data.110fc6985e86.0000000000000014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.489143+0000", 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.050431681999999, 2024-09-22T01:35:14.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.003715168, 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 519 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489143+0000", 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489143+0000", 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489147+0000", 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0500000000000002e-06 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489164+0000", 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6629999999999998e-05 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489209+0000", 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4563e-05 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489234+0000", 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5636e-05 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489408+0000", 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017384900000000001 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489660+0000", 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025238799999999998 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.489951+0000", 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029059499999999999 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.491583+0000", 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016318839999999999 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492558+0000", 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00097499800000000003 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492727+0000", 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016943899999999999 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.492858+0000", 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013113600000000001 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.600 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:522 3.0 3:023caaec:::rbd_data.110fc6985e86.0000000000000011:head [truncate 2883584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.497897+0000", 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.041678376, 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002816359, 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.601 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 522 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497897+0000", 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497897+0000", 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497899+0000", 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3029999999999998e-06 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497911+0000", 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2527000000000001e-05 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497941+0000", 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9635999999999999e-05 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.497956+0000", 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.517e-05 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.498075+0000", 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119103 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.498224+0000", 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014880500000000001 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.498430+0000", 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020570199999999999 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.499625+0000", 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001195261 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.500385+0000", 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00076031000000000004 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.500553+0000", 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167376 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.500713+0000", 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160166 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:547 3.0 3:023caaec:::rbd_data.110fc6985e86.0000000000000011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.606 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.560754+0000", 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.978820528, 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027911469999999999, 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 547 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560754+0000", 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560754+0000", 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560779+0000", 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4147000000000001e-05 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560792+0000", 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3036e-05 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560829+0000", 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7812999999999999e-05 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560847+0000", 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7286e-05 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.560971+0000", 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012449100000000001 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.561153+0000", 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000181533 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.561379+0000", 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022662600000000001 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.562490+0000", 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011111039999999999 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.563345+0000", 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00085425099999999999 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.563454+0000", 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010930299999999999 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.563546+0000", 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1557000000000004e-05 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:689 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 505455~18833] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.970312+0000", 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 19.569263201999998, 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00277991, 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.612 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 689 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970312+0000", 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970312+0000", 2024-09-22T01:35:14.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970315+0000", 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8499999999999998e-06 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970343+0000", 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7963e-05 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970380+0000", 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.773e-05 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970398+0000", 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7240000000000001e-05 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970509+0000", 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111172 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970612+0000", 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103523 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.970783+0000", 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017049900000000001 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.972334+0000", 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001550877 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.972968+0000", 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063434500000000003 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.973039+0000", 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1475000000000003e-05 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.973092+0000", 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2235999999999999e-05 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.617 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:926 3.0 3:04479396:::rbd_id.image_client.0-clone2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:55.624791+0000", 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.914784299000001, 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0038771449999999998, 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 926 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.618 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624791+0000", 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624791+0000", 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624793+0000", 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5069999999999999e-06 2024-09-22T01:35:14.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624803+0000", 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7159999999999998e-06 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624827+0000", 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3685000000000001e-05 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624840+0000", 2024-09-22T01:35:14.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3472000000000001e-05 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624912+0000", 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1464999999999994e-05 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.624918+0000", 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3239999999999999e-06 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.627061+0000", 2024-09-22T01:35:14.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021427379999999999 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.627157+0000", 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6825999999999998e-05 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.627290+0000", 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013283500000000001 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628069+0000", 2024-09-22T01:35:14.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000779216 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628548+0000", 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00047880699999999998 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628616+0000", 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7842000000000005e-05 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:55.628668+0000", 2024-09-22T01:35:14.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1712000000000002e-05 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:4527 3.4 3:277b6bc9:::rbd_data.110ff3dda363.0000000000000025:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:58.625681+0000", 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.913894379, 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0025441489999999999, 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 4527 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625681+0000", 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625681+0000", 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625683+0000", 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2639999999999998e-06 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625691+0000", 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4950000000000008e-06 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625711+0000", 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.986e-05 2024-09-22T01:35:14.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625722+0000", 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625795+0000", 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3517999999999996e-05 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.625879+0000", 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3183999999999995e-05 2024-09-22T01:35:14.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.626012+0000", 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013331899999999999 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.627754+0000", 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017424140000000001 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.628111+0000", 2024-09-22T01:35:14.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035656300000000001 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.628173+0000", 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2651999999999996e-05 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:58.628225+0000", 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1292000000000003e-05 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.629 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.4358413700000003, 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:35:14.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:35:14.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.4347756749999991, 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:35:14.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:35:14.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:35:14.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.640 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1267431850000005, 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:14.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:35:14.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:35:14.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:35:14.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:35:14.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.1263688910000003, 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:35:14.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:35:14.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:51881 3.0 3:00bdea9d:::rbd_data.110ffcdf9ae8.0000000000000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:09.386809+0000", 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 5.1527657649999998, 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0030937849999999999, 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 51881 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.652 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386809+0000", 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386809+0000", 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386811+0000", 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.821e-06 2024-09-22T01:35:14.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386819+0000", 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8499999999999994e-06 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386845+0000", 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5653e-05 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386858+0000", 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3757000000000001e-05 2024-09-22T01:35:14.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.386953+0000", 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4246000000000005e-05 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.387067+0000", 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000114788 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.387206+0000", 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013866900000000001 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.388363+0000", 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011565410000000001 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.389825+0000", 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0014623360000000001 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.389864+0000", 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9555000000000003e-05 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:14.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:09.389903+0000", 2024-09-22T01:35:14.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8569000000000003e-05 2024-09-22T01:35:14.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.657 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.657 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.657 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:14.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:14.659 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:14.657+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:14.687 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:35:14.759 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:14.757+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:14.807 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone10 from 0x8643ef8 (overlap 0x44a1363) to 0x1b73af4 2024-09-22T01:35:14.826 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:14.827 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:14.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.827 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54590 3.2 3.360d3f62 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:14.827 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.824003+0000", 2024-09-22T01:35:14.827 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.0021874400000000001, 2024-09-22T01:35:14.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0022308139999999998, 2024-09-22T01:35:14.827 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:14.828 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:14.828 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:14.828 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:14.828 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:14.828 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:14.828 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54590 2024-09-22T01:35:14.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.828 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:14.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:14.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.824003+0000", 2024-09-22T01:35:14.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:14.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.824003+0000", 2024-09-22T01:35:14.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:14.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:14.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.824003+0000", 2024-09-22T01:35:14.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1399999999999997e-07 2024-09-22T01:35:14.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:14.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.824012+0000", 2024-09-22T01:35:14.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9439999999999994e-06 2024-09-22T01:35:14.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:14.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.824022+0000", 2024-09-22T01:35:14.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3239999999999992e-06 2024-09-22T01:35:14.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:14.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.824029+0000", 2024-09-22T01:35:14.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2679999999999997e-06 2024-09-22T01:35:14.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:14.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:14.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:14.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826195+0000", 2024-09-22T01:35:14.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0021661919999999999 2024-09-22T01:35:14.833 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.833 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:14.833 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.833 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:14.833 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:14.834 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 1 2024-09-22T01:35:14.834 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:14.845 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:14.891 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:14.890+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:14.955 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-22T01:35:14.961 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:14.958+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:14.971 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:14.971 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:14.971 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:14.971 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:14.971 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:14.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:15.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:15.080 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:15.078+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:15.122 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:15.122 INFO:teuthology.orchestra.run.smithi018.stdout:1037 read 0x1f7773f thru 0x1f7b02f (0x38f1 bytes) 2024-09-22T01:35:15.124 INFO:teuthology.orchestra.run.smithi018.stdout:1038 trunc from 0x8643ef8 to 0x891fade 2024-09-22T01:35:15.137 INFO:teuthology.orchestra.run.smithi018.stdout:1039 write 0x37a2a6 thru 0x37d780 (0x34db bytes) 2024-09-22T01:35:15.145 INFO:teuthology.orchestra.run.smithi018.stdout:1041 read 0x80a9b0d thru 0x80add7f (0x4273 bytes) 2024-09-22T01:35:15.157 INFO:teuthology.orchestra.run.smithi018.stdout:1042 write 0xaf80455 thru 0xaf82209 (0x1db5 bytes) 2024-09-22T01:35:15.162 INFO:teuthology.orchestra.run.smithi018.stdout:1043 write 0x2f1913c thru 0x2f2279c (0x9661 bytes) 2024-09-22T01:35:15.163 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:15.161+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:15.171 INFO:teuthology.orchestra.run.smithi018.stdout:1044 write 0x1d88d33 thru 0x1d982c6 (0xf594 bytes) 2024-09-22T01:35:15.177 INFO:teuthology.orchestra.run.smithi018.stdout:1045 write 0x70df026 thru 0x70e4909 (0x58e4 bytes) 2024-09-22T01:35:15.182 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:15.182 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:15.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.0558418, 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:35:15.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:35:15.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:35:15.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:35:15.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:35:15.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.187 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.055816064, 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.188 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:35:15.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:35:15.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.192 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.192 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.192 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:15.192 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.055790282, 2024-09-22T01:35:15.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:35:15.192 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:35:15.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.196 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.055745363, 2024-09-22T01:35:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:35:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:15.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.055713207, 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:15.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:15.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:35:15.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.055685475000001, 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.055649651, 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.055613507, 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:15.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:35:15.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.055577302, 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.222 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.05554995, 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.223 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.226 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.055512872, 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:15.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.055489335000001, 2024-09-22T01:35:15.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:35:15.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:35:15.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12683 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.054999336, 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058771337, 2024-09-22T01:35:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12683 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126558+0000", 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6399999999999998e-07 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126559+0000", 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8360000000000001e-06 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126567+0000", 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4189999999999996e-06 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126578+0000", 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1439e-05 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185320+0000", 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058741987000000002 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185329+0000", 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2919999999999996e-06 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.054942134999999, 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.238 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:35:15.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:35:15.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.054914377999999, 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.054892312, 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.246 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:35:15.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.054862152, 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:35:15.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:35:15.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.054441662, 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.257 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.054415881000001, 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:35:15.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:35:15.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 10.054394612999999, 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:35:15.261 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:15.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:35:15.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:35:15.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.265 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:15.265 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:15.265 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:15.266 INFO:teuthology.orchestra.run.smithi018.stdout:1047 trunc from 0xaf8220a to 0xeae4372 2024-09-22T01:35:15.266 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:15.266 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:15.267 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:15.268 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:15.268 INFO:teuthology.orchestra.run.smithi018.stdout:1049 trunc from 0xeae4372 to 0x64e3b4d 2024-09-22T01:35:15.268 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:15.268 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:15.269 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:15.269 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:15.269 INFO:teuthology.orchestra.run.smithi018.stdout:1050 clone 12 order 23 su 32768 sc 5 2024-09-22T01:35:15.269 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:15.270 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:15.270 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:15.265+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:15.272 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:15.272 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:15.291 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:15.311 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:15.311 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:15.329 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:15.329 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:15.391 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:15.390+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:15.399 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:15.399 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:15.413 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:15.468 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:15.465+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:15.534 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:15.534 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:15.548 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:15.589 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:15.589+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:15.669 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:15.669+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:15.711 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:15.711 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:15.727 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:15.770 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:15.769+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:15.861 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone11 from 0x64e3b4d (overlap 0x64e3b4d) to 0x142d8a9 2024-09-22T01:35:15.871 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:15.866+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:15.908 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:15.908 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:15.928 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:15.972 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:15.970+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:16.056 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:16.056 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:16.071 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:16.072 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:16.069+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:16.120 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-22T01:35:16.146 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:16.146 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:35:16.146 INFO:tasks.thrashosds.thrasher:Removing osd 2, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:16.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 2 2024-09-22T01:35:16.173 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:16.169+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:16.197 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:16.197 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:16.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:16.240 INFO:teuthology.orchestra.run.smithi018.stdout:1051 writesame 0x79a24cc thru 0x79ae6f0 data_size 0x1(0xc225 bytes) 2024-09-22T01:35:16.240 INFO:teuthology.orchestra.run.smithi018.stdout:1052 write 0xd80d4b thru 0xd877be (0x6a74 bytes) 2024-09-22T01:35:16.297 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:16.297+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:16.302 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:16.302 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:16.316 INFO:teuthology.orchestra.run.smithi018.stdout:1056 write 0xcd8a6db thru 0xcd8ee5f (0x4785 bytes) 2024-09-22T01:35:16.319 INFO:teuthology.orchestra.run.smithi018.stdout:1057 write 0x92cf938 thru 0x92d16d6 (0x1d9f bytes) 2024-09-22T01:35:16.324 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:16.324 INFO:teuthology.orchestra.run.smithi018.stdout:1061 read 0x5ab3fd5 thru 0x5ab8e66 (0x4e92 bytes) 2024-09-22T01:35:16.324 INFO:teuthology.orchestra.run.smithi018.stdout:1062 read 0x835daf1 thru 0x8365142 (0x7652 bytes) 2024-09-22T01:35:16.326 INFO:teuthology.orchestra.run.smithi018.stdout:1063 trunc from 0xcd8ee60 to 0xdcf69ca 2024-09-22T01:35:16.333 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:16.333 INFO:teuthology.orchestra.run.smithi018.stdout:1066 trunc from 0xdcf69ca to 0xd8e6592 2024-09-22T01:35:16.343 INFO:teuthology.orchestra.run.smithi018.stdout:1067 writesame 0xcd35bda thru 0xcd36c21 data_size 0x4(0x1048 bytes) 2024-09-22T01:35:16.349 INFO:teuthology.orchestra.run.smithi018.stdout:1070 read 0x3497def thru 0x349f435 (0x7647 bytes) 2024-09-22T01:35:16.351 INFO:teuthology.orchestra.run.smithi018.stdout:1072 write 0x7fdfae5 thru 0x7fea53f (0xaa5b bytes) 2024-09-22T01:35:16.356 INFO:teuthology.orchestra.run.smithi018.stdout:1074 write 0xa807884 thru 0xa81008f (0x880c bytes) 2024-09-22T01:35:16.366 INFO:teuthology.orchestra.run.smithi018.stdout:1075 punch from 0xb6674b to 0xb6d280, (0x6b35 bytes) 2024-09-22T01:35:16.366 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:16.366 INFO:teuthology.orchestra.run.smithi018.stdout:1078 writesame 0xd0bd9c6 thru 0xd0c7426 data_size 0x1(0x9a61 bytes) 2024-09-22T01:35:16.374 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:16.370+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:16.381 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:16.381 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:16.394 INFO:teuthology.orchestra.run.smithi018.stdout:1080 trunc from 0xd8e6592 to 0xe2907e4 2024-09-22T01:35:16.396 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:16.402 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:16.402 INFO:teuthology.orchestra.run.smithi018.stdout:1083 read 0xa1ef81d thru 0xa1f6230 (0x6a14 bytes) 2024-09-22T01:35:16.404 INFO:teuthology.orchestra.run.smithi018.stdout:1084 writesame 0x81053f5 thru 0x8113dad data_size 0x1(0xe9b9 bytes) 2024-09-22T01:35:16.435 INFO:teuthology.orchestra.run.smithi018.stdout:1085 trunc from 0xe2907e4 to 0xe4b2342 2024-09-22T01:35:16.452 INFO:teuthology.orchestra.run.smithi018.stdout:1086 trunc from 0xe4b2342 to 0xa73e765 2024-09-22T01:35:16.473 INFO:teuthology.orchestra.run.smithi018.stdout:1089 punch from 0x398820e to 0x398c566, (0x4358 bytes) 2024-09-22T01:35:16.481 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:16.481+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:16.490 INFO:teuthology.orchestra.run.smithi018.stdout:1090 trunc from 0xa73e765 to 0x325e19 2024-09-22T01:35:16.518 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-22T01:35:16.514+0000 7fb667fae640 -1 mon.a@0(leader).osd e42 definitely_dead 0 2024-09-22T01:35:16.575 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:16.575 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:16.575 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:16.574+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:16.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:16.608 INFO:teuthology.orchestra.run.smithi018.stdout:1091 punch from 0x2d2ca0 to 0x2df355, (0xc6b5 bytes) 2024-09-22T01:35:16.608 INFO:teuthology.orchestra.run.smithi018.stdout:1092 read 0xad6a6 thru 0xba0b4 (0xca0f bytes) 2024-09-22T01:35:16.609 INFO:teuthology.orchestra.run.smithi018.stdout:1094 read 0x113efe thru 0x1232c3 (0xf3c6 bytes) 2024-09-22T01:35:16.611 INFO:teuthology.orchestra.run.smithi018.stdout:1097 trunc from 0x325e19 to 0x985f55 2024-09-22T01:35:16.619 INFO:teuthology.orchestra.run.smithi018.stdout:1098 punch from 0x498467 to 0x49fe12, (0x79ab bytes) 2024-09-22T01:35:16.619 INFO:teuthology.orchestra.run.smithi018.stdout:1100 read 0x28334e thru 0x284eb8 (0x1b6b bytes) 2024-09-22T01:35:16.620 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:16.653 INFO:teuthology.orchestra.run.smithi018.stdout:1104 write 0xa33f312 thru 0xa34ef7c (0xfc6b bytes) 2024-09-22T01:35:16.672 INFO:teuthology.orchestra.run.smithi018.stdout:1105 trunc from 0xa34ef7d to 0xece6746 2024-09-22T01:35:16.677 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:16.677+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:16.682 INFO:teuthology.orchestra.run.smithi018.stdout:1106 write 0x3a6054a thru 0x3a6f840 (0xf2f7 bytes) 2024-09-22T01:35:16.690 INFO:teuthology.orchestra.run.smithi018.stdout:1108 write 0x21af5fb thru 0x21b8d7c (0x9782 bytes) 2024-09-22T01:35:16.693 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:16.693 INFO:teuthology.orchestra.run.smithi018.stdout:1110 read 0xd74c561 thru 0xd753c16 (0x76b6 bytes) 2024-09-22T01:35:16.694 INFO:teuthology.orchestra.run.smithi018.stdout:1111 read 0x6d40ceb thru 0x6d50c91 (0xffa7 bytes) 2024-09-22T01:35:16.694 INFO:teuthology.orchestra.run.smithi018.stdout:1112 write 0x1a395b7 thru 0x1a46c7d (0xd6c7 bytes) 2024-09-22T01:35:16.699 INFO:teuthology.orchestra.run.smithi018.stderr:marked out osd.2. 2024-09-22T01:35:16.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:35:16.716 INFO:teuthology.orchestra.run.smithi018.stdout:1114 trunc from 0xece6746 to 0x6c23fc6 2024-09-22T01:35:16.732 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:16.732 INFO:teuthology.orchestra.run.smithi018.stdout:1116 read 0x2009c9c thru 0x20183b5 (0xe71a bytes) 2024-09-22T01:35:16.733 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:16.733 INFO:teuthology.orchestra.run.smithi018.stdout:1118 read 0x66e93da thru 0x66ecc36 (0x385d bytes) 2024-09-22T01:35:16.733 INFO:teuthology.orchestra.run.smithi018.stdout:1119 read 0x1543f97 thru 0x15519d4 (0xda3e bytes) 2024-09-22T01:35:16.741 INFO:teuthology.orchestra.run.smithi018.stdout:1122 trunc from 0x6c23fc6 to 0x21b1eac 2024-09-22T01:35:16.769 INFO:teuthology.orchestra.run.smithi018.stdout:1123 trunc from 0x21b1eac to 0x90d2a73 2024-09-22T01:35:16.772 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:16.773 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:16.777 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:16.773+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:16.787 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:16.793 INFO:teuthology.orchestra.run.smithi018.stdout:1124 write 0xeb35fb3 thru 0xeb3cd67 (0x6db5 bytes) 2024-09-22T01:35:16.881 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:16.881+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:16.956 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:16.956 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:16.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:17.013 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:17.013+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:17.079 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:17.077+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:17.138 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:17.139 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:17.154 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:17.181 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:17.178+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:17.281 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:17.281+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:17.321 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:17.321 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:17.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:17.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:17.381 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:17.378+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:17.472 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:17.472 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:17.483 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:17.481+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:17.488 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:17.530 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:17.530 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:17.546 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:17.547 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:17.564 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:17.564 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:17.580 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:17.583 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:17.581+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:17.600 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:17.601 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:17.609 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:17.609 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:17.609 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:17.609 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:17.609 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:17.622 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:17.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:17.645 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:17.645 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:17.666 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:17.666 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:17.685 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:17.681+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:35:17.781 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:17.781 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48565 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 708608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3132209590000006, 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086712429999999993, 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.782 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48565 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466221+0000", 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9299999999999998e-07 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466224+0000", 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.977e-06 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466233+0000", 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1419999999999999e-06 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466240+0000", 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6800000000000004e-06 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552634+0000", 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086394356000000005 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552731+0000", 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6681000000000005e-05 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552933+0000", 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020200099999999999 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48566 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 718848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3131927799999996, 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086846866999999994, 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.786 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48566 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.06e-07 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466252+0000", 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.813e-06 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466261+0000", 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7260000000000008e-06 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466267+0000", 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5400000000000001e-06 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552974+0000", 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086707237000000006 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553025+0000", 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0380000000000002e-05 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553095+0000", 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0564999999999999e-05 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48654 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:17.790 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3089497399999992, 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086747482000000001, 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48654 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5700000000000001e-07 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470498+0000", 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470515+0000", 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7742000000000001e-05 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470546+0000", 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0586000000000002e-05 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557000+0000", 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086454002000000002 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557110+0000", 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010961 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557239+0000", 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48655 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 638976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3088741699999993, 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086840121000000006, 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48655 2024-09-22T01:35:17.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470569+0000", 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5400000000000001e-06 2024-09-22T01:35:17.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470575+0000", 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1399999999999997e-06 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470597+0000", 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1676e-05 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470614+0000", 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7336000000000001e-05 2024-09-22T01:35:17.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557279+0000", 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086664832999999997 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557341+0000", 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2073e-05 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557407+0000", 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6523e-05 2024-09-22T01:35:17.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3087709870000008, 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.799 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:35:17.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:35:17.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:35:17.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:35:17.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3086965769999992, 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:35:17.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:35:17.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:35:17.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3086400460000007, 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.808 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:35:17.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.809 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:35:17.812 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3085824519999996, 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.813 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:35:17.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.308525114, 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:35:17.817 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3084676729999991, 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:35:17.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.823 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:17.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.826 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3084317639999998, 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:17.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:17.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:17.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:35:17.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:35:17.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:35:17.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:35:17.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:35:17.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:35:17.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:35:17.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:35:17.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:35:17.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:35:17.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:35:17.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:35:17.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:35:17.833 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.834 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.834 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48750 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.834 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:17.835 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3035289629999998, 2024-09-22T01:35:17.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086758792000000001, 2024-09-22T01:35:17.835 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.835 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.835 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48750 2024-09-22T01:35:17.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.836 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:17.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:17.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475914+0000", 2024-09-22T01:35:17.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.263e-06 2024-09-22T01:35:17.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475919+0000", 2024-09-22T01:35:17.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.84e-06 2024-09-22T01:35:17.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475937+0000", 2024-09-22T01:35:17.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7689e-05 2024-09-22T01:35:17.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475951+0000", 2024-09-22T01:35:17.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3439e-05 2024-09-22T01:35:17.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562548+0000", 2024-09-22T01:35:17.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086597376000000004 2024-09-22T01:35:17.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562605+0000", 2024-09-22T01:35:17.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7367999999999997e-05 2024-09-22T01:35:17.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562671+0000", 2024-09-22T01:35:17.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5816999999999997e-05 2024-09-22T01:35:17.843 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.843 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.843 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.844 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48751 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 641024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.844 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:17.844 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3034546329999994, 2024-09-22T01:35:17.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086829097999999993, 2024-09-22T01:35:17.844 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48751 2024-09-22T01:35:17.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.845 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:17.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:17.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475988+0000", 2024-09-22T01:35:17.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.47e-07 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475994+0000", 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1260000000000003e-06 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476019+0000", 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5471999999999999e-05 2024-09-22T01:35:17.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476033+0000", 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100000000000001e-05 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562691+0000", 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086657746999999993 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562750+0000", 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9188000000000003e-05 2024-09-22T01:35:17.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562816+0000", 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5518000000000005e-05 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3033880660000001, 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:35:17.850 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3033246250000001, 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.855 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:35:17.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:35:17.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:35:17.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:35:17.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:35:17.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:35:17.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:35:17.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3032693880000004, 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.860 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:35:17.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:35:17.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3031960740000006, 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.864 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:35:17.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.868 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3031419930000006, 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:35:17.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:35:17.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3030875549999994, 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:35:17.873 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:17.877 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.3030316939999995, 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:17.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:35:17.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:35:17.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:17.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:35:17.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:35:17.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:17.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:35:17.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:17.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:35:17.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:35:17.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.882 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:17.882 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:17.882 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:17.883 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:17.884 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:17.882+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:17.984 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:17.982+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:57526 3.4 3.c9255604 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e44)", 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:17.724909+0000", 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.336022443, 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.33606864199999997, 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for peered", 2024-09-22T01:35:18.061 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 57526 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724909+0000", 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724909+0000", 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724911+0000", 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8309999999999999e-06 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724927+0000", 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6178e-05 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724943+0000", 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6288000000000001e-05 2024-09-22T01:35:18.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724956+0000", 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3061000000000001e-05 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.725164+0000", 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020745400000000001 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.725175+0000", 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1342000000000001e-05 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.064 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.065 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:18.065 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 1 2024-09-22T01:35:18.065 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:18.075 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:18.085 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:18.085+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:18.186 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:18.185+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:18.248 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:18.248 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:18.248 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:18.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:18.287 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:18.285+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:18.386 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:18.386 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:18.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:18.386 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:18.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.386 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:602 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.683697248000001, 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055897943999999998, 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 602 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:18.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699628+0000", 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6330000000000002e-06 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699650+0000", 2024-09-22T01:35:18.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2056999999999999e-05 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699689+0000", 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9109000000000001e-05 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699707+0000", 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7207e-05 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699868+0000", 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016106200000000001 2024-09-22T01:35:18.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.700040+0000", 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171865 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.707678+0000", 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076380479999999997 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755348+0000", 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.047670037999999998 2024-09-22T01:35:18.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755387+0000", 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9662000000000001e-05 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755455+0000", 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7995000000000002e-05 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755523+0000", 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7267999999999994e-05 2024-09-22T01:35:18.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11290 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.513071978999999, 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048997573000000003, 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11290 2024-09-22T01:35:18.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:18.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870253+0000", 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5019999999999999e-06 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870274+0000", 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1064999999999999e-05 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870280+0000", 2024-09-22T01:35:18.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3230000000000003e-06 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919056+0000", 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048776031999999997 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919138+0000", 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1846000000000002e-05 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919247+0000", 2024-09-22T01:35:18.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000109329 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11291 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.513030172000001, 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049210375000000001, 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11291 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870461+0000", 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169476 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870465+0000", 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870477+0000", 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1207e-05 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870484+0000", 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.481e-06 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919295+0000", 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048810529999999998 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919380+0000", 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5773999999999996e-05 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919502+0000", 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121662 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11292 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.512824242000001, 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049215074999999997, 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.400 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11292 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870610+0000", 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112569 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870615+0000", 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3630000000000004e-06 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870626+0000", 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1460999999999999e-05 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870633+0000", 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8170000000000001e-06 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919546+0000", 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048912723999999998 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919651+0000", 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105437 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919713+0000", 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1704000000000004e-05 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11293 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.51267771, 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049300425000000002, 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11293 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870769+0000", 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125289 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870774+0000", 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1099999999999996e-06 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870784+0000", 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0664e-05 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870791+0000", 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919753+0000", 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048961849000000002 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919840+0000", 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6917999999999997e-05 2024-09-22T01:35:18.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919945+0000", 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010444499999999999 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11294 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 694272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.512518867000001, 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049352066999999999, 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.408 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11294 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870909+0000", 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105821 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870913+0000", 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3329999999999998e-06 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870929+0000", 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6146000000000001e-05 2024-09-22T01:35:18.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870938+0000", 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8470000000000002e-06 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919988+0000", 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049050170999999997 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920051+0000", 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2337999999999998e-05 2024-09-22T01:35:18.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920155+0000", 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104411 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11295 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 868352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.512371536, 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049438600999999999, 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11295 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:18.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872025+0000", 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001075037 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872031+0000", 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3619999999999997e-06 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872043+0000", 2024-09-22T01:35:18.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2075999999999999e-05 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872052+0000", 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-06 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920196+0000", 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048143803999999998 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920284+0000", 2024-09-22T01:35:18.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7454999999999995e-05 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920389+0000", 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105167 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11313 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 346112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.511206956000001, 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048873528999999999, 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11313 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6300000000000001e-07 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872117+0000", 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2450000000000001e-06 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872125+0000", 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872130+0000", 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9280000000000001e-06 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920837+0000", 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048706948999999999 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920921+0000", 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3459000000000002e-05 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920988+0000", 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7644000000000005e-05 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11314 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.511184441999999, 2024-09-22T01:35:18.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049091919999999997, 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11314 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872138+0000", 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3799999999999998e-07 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872140+0000", 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5500000000000001e-06 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872147+0000", 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6680000000000004e-06 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872152+0000", 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4269999999999999e-06 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921028+0000", 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048875778000000002 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921118+0000", 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0148000000000005e-05 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921229+0000", 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110911 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11315 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:18.424 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.511162788, 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049217209999999997, 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11315 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872362+0000", 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203131 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872368+0000", 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6210000000000001e-06 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872379+0000", 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872388+0000", 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000002e-06 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921263+0000", 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048874828000000002 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921309+0000", 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5843000000000001e-05 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921376+0000", 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7429999999999996e-05 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11316 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.510920048999999, 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049209332000000001, 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11316 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872627+0000", 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022554899999999999 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872638+0000", 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0964e-05 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872652+0000", 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100999999999999e-05 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872661+0000", 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8340000000000005e-06 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921415+0000", 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048753713999999997 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921505+0000", 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9554000000000004e-05 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921611+0000", 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106616 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11317 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 714752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.510647748, 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049068392000000002, 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11317 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872821+0000", 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014710999999999999 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872826+0000", 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5399999999999997e-06 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872839+0000", 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3441999999999999e-05 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872854+0000", 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4364e-05 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921646+0000", 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048791961000000002 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921688+0000", 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.286e-05 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921742+0000", 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4114999999999999e-05 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11318 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 888832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.510456112, 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049108288, 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.437 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11318 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873096+0000", 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023050300000000001 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873102+0000", 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5269999999999998e-06 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873114+0000", 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1802e-05 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873121+0000", 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4209999999999998e-06 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921782+0000", 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048660582000000001 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921869+0000", 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7798000000000002e-05 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921974+0000", 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010465499999999999 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11319 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 899072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.510188488000001, 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048963590000000001, 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11319 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873305+0000", 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017154 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873310+0000", 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873326+0000", 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.558e-05 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873343+0000", 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6894000000000001e-05 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922006+0000", 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.04866293 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922047+0000", 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0952999999999999e-05 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922097+0000", 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0413e-05 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11333 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 8192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.509965807, 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048982295000000002, 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.445 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11333 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875169+0000", 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018133089999999999 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875175+0000", 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875189+0000", 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3886999999999999e-05 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875197+0000", 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5369999999999997e-06 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922139+0000", 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.046941573 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922231+0000", 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2565000000000006e-05 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922338+0000", 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107124 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11384 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 755712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.505542808, 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048901420000000001, 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.449 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11384 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877943+0000", 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164411 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877948+0000", 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3340000000000003e-06 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877959+0000", 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1027e-05 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877966+0000", 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1099999999999997e-06 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926570+0000", 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048603810999999997 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926616+0000", 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6335999999999998e-05 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926680+0000", 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4391000000000001e-05 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11386 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 940032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.505202829, 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048882052000000002, 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.453 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11386 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878210+0000", 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1310999999999994e-05 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878215+0000", 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4259999999999996e-06 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878229+0000", 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.448e-05 2024-09-22T01:35:18.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878244+0000", 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718e-05 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926854+0000", 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048610318999999999 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926939+0000", 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4919999999999993e-05 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927001+0000", 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1878000000000006e-05 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11401 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.505064345999999, 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048953133000000003, 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.457 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11401 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:18.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878258+0000", 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878261+0000", 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7590000000000002e-06 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878269+0000", 2024-09-22T01:35:18.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878276+0000", 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2420000000000003e-06 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927095+0000", 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048819573999999998 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927153+0000", 2024-09-22T01:35:18.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7120000000000002e-05 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927211+0000", 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8062000000000001e-05 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11402 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 59392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.50503855, 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049110529, 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.461 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11402 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879206+0000", 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092231699999999997 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879211+0000", 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1830000000000002e-06 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879223+0000", 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2388000000000001e-05 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879229+0000", 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3800000000000002e-06 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927251+0000", 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048022479999999999 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927321+0000", 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9760999999999998e-05 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927394+0000", 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3020000000000002e-05 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11408 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 776192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.879316+0000", 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.50400552, 2024-09-22T01:35:18.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048856469, 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11408 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879316+0000", 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879316+0000", 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879553+0000", 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023645200000000001 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879558+0000", 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3140000000000003e-06 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879568+0000", 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0271999999999999e-05 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879576+0000", 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5320000000000001e-06 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.928065+0000", 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048489281000000002 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.928120+0000", 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5265e-05 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.928173+0000", 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2352999999999998e-05 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.469 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:18.471 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:18.471 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:18.466+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:18.571 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:18.570+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:18.649 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:18.649 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:18.649 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:18.649 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:18.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:18.672 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:18.669+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:18.773 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:18.773+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:18.838 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:18.839 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:18.839 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:18.853 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:18.874 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:18.873+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:18.975 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:18.970+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:18.981 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:18.981 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:18.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:18.981 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.979296005999998, 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:35:18.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.649646353000001, 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:18.986 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:35:18.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:35:18.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:35:18.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.991 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.649502848000001, 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.874183576, 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:18.997 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:18.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:35:18.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:35:19.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:35:19.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.873117881000001, 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:19.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.565085391, 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:19.008 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.010 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.010 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:35:19.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:35:19.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:19.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:35:19.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:35:19.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:19.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:35:19.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:35:19.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:19.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:35:19.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:35:19.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:19.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:35:19.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:35:19.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 13.564711097, 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.018 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:19.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:35:19.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:35:19.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:19.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54465 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1568512489999998, 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050651180000000004, 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54465 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821068+0000", 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:35:19.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821078+0000", 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0164e-05 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821107+0000", 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8985000000000001e-05 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821121+0000", 2024-09-22T01:35:19.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.307e-05 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821387+0000", 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026639200000000001 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821395+0000", 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3040000000000005e-06 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825493+0000", 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040977399999999999 2024-09-22T01:35:19.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825630+0000", 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136971 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826131+0000", 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050110499999999995 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.028 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54466 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.15676472, 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052214690000000003, 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54466 2024-09-22T01:35:19.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821153+0000", 2024-09-22T01:35:19.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7499999999999999e-07 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821158+0000", 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3800000000000004e-06 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821169+0000", 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1124000000000001e-05 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821177+0000", 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1040000000000007e-06 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821467+0000", 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029025299999999997 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821474+0000", 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826170+0000", 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046964709999999998 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826261+0000", 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0708e-05 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826374+0000", 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113182 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.033 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54467 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1567283890000004, 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054437169999999998, 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54467 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.034 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1900000000000002e-07 2024-09-22T01:35:19.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821193+0000", 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4130000000000002e-06 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821202+0000", 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821209+0000", 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8800000000000002e-06 2024-09-22T01:35:19.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821504+0000", 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029444600000000002 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821509+0000", 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5500000000000002e-06 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826415+0000", 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004905492 2024-09-22T01:35:19.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826527+0000", 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112144 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826633+0000", 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105795 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.039 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54510 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.039 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:19.039 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1566984570000001, 2024-09-22T01:35:19.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057311339999999997, 2024-09-22T01:35:19.039 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54510 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821245+0000", 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5774000000000001e-05 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821257+0000", 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2045000000000001e-05 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821265+0000", 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821538+0000", 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027359599999999997 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821544+0000", 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7450000000000001e-06 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826699+0000", 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051546229999999997 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826815+0000", 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011646600000000001 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826950+0000", 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013463700000000001 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54511 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.156639985, 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058910409999999996, 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54511 2024-09-22T01:35:19.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821278+0000", 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821282+0000", 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821291+0000", 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3039999999999994e-06 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821298+0000", 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.041e-06 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821573+0000", 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000274283 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821578+0000", 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0679999999999996e-06 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827015+0000", 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054370670000000003 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827070+0000", 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5773999999999998e-05 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827168+0000", 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7814999999999998e-05 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54512 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1566090830000002, 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061320309999999996, 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54512 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821309+0000", 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.51e-07 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821312+0000", 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0419999999999998e-06 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821320+0000", 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.422e-06 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821332+0000", 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1951e-05 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821937+0000", 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060522400000000002 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821944+0000", 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.404e-06 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827219+0000", 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052754389999999998 2024-09-22T01:35:19.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827317+0000", 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7536999999999998e-05 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827440+0000", 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123461 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.053 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54555 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1561400529999997, 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059477050000000002, 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54555 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821778+0000", 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0500000000000002e-07 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821783+0000", 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.135e-06 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821798+0000", 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4688000000000001e-05 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821808+0000", 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6690000000000001e-06 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821977+0000", 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169541 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821982+0000", 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-06 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827481+0000", 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054988470000000003 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827582+0000", 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100554 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827725+0000", 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014320199999999999 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.058 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54556 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.156093233, 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00620654, 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54556 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821825+0000", 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821828+0000", 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8809999999999998e-06 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821839+0000", 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.027e-05 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821846+0000", 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822011+0000", 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822017+0000", 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6099999999999997e-06 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827802+0000", 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057848509999999997 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827892+0000", 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0880999999999999e-05 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828030+0000", 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013803200000000001 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54557 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1560589400000003, 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064190469999999998, 2024-09-22T01:35:19.063 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54557 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821859+0000", 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.99e-07 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821863+0000", 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6569999999999999e-06 2024-09-22T01:35:19.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821871+0000", 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9719999999999998e-06 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821878+0000", 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.917e-06 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822045+0000", 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016703000000000001 2024-09-22T01:35:19.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822051+0000", 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.626e-06 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828069+0000", 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060179919999999998 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828161+0000", 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1731999999999995e-05 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828277+0000", 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011652199999999999 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54600 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1556233670000005, 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062310530000000003, 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54600 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822295+0000", 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.19e-06 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822301+0000", 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5010000000000004e-06 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822320+0000", 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9724e-05 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822330+0000", 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3899999999999999e-06 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822464+0000", 2024-09-22T01:35:19.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013444100000000001 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822470+0000", 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3690000000000003e-06 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828314+0000", 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058434719999999997 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828405+0000", 2024-09-22T01:35:19.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1166000000000001e-05 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828525+0000", 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001198 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54601 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.155565749, 2024-09-22T01:35:19.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064068470000000002, 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54601 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822352+0000", 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822356+0000", 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6519999999999999e-06 2024-09-22T01:35:19.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822366+0000", 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0686000000000001e-05 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822374+0000", 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4200000000000001e-06 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822500+0000", 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012665800000000001 2024-09-22T01:35:19.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822505+0000", 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.938e-06 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828560+0000", 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060544969999999998 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828651+0000", 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0758000000000001e-05 2024-09-22T01:35:19.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828758+0000", 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010760900000000001 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54602 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1555313570000001, 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066069279999999998, 2024-09-22T01:35:19.078 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54602 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6599999999999996e-07 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822390+0000", 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.377e-06 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822399+0000", 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822406+0000", 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822534+0000", 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012761900000000001 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822539+0000", 2024-09-22T01:35:19.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3639999999999998e-06 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828797+0000", 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006257365 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828885+0000", 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8818000000000002e-05 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828993+0000", 2024-09-22T01:35:19.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107336 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54688 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.151650472, 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044478340000000003, 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54688 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826268+0000", 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-06 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826274+0000", 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826294+0000", 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0211999999999999e-05 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826310+0000", 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6039999999999999e-05 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830569+0000", 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004258632 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830641+0000", 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2064000000000007e-05 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830715+0000", 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3483000000000001e-05 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.086 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.087 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.087 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:19.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:19.089 INFO:teuthology.orchestra.run.smithi018.stdout:1125 trunc from 0xeb3cd68 to 0x258d842 2024-09-22T01:35:19.089 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:19.085+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:19.094 INFO:teuthology.orchestra.run.smithi018.stdout:1127 read 0x1b4d6ec thru 0x1b58d5b (0xb670 bytes) 2024-09-22T01:35:19.112 INFO:teuthology.orchestra.run.smithi018.stdout:1128 write 0x4265b07 thru 0x4270e29 (0xb323 bytes) 2024-09-22T01:35:19.123 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:19.142 INFO:teuthology.orchestra.run.smithi018.stdout:1130 write 0x7f57abb thru 0x7f5aa57 (0x2f9d bytes) 2024-09-22T01:35:19.151 INFO:teuthology.orchestra.run.smithi018.stdout:1132 read 0x417f922 thru 0x418cbbe (0xd29d bytes) 2024-09-22T01:35:19.153 INFO:teuthology.orchestra.run.smithi018.stdout:1133 punch from 0x3328acd to 0x332c90b, (0x3e3e bytes) 2024-09-22T01:35:19.153 INFO:teuthology.orchestra.run.smithi018.stdout:1134 read 0xfd591e thru 0xfd5ca4 (0x387 bytes) 2024-09-22T01:35:19.153 INFO:teuthology.orchestra.run.smithi018.stdout:1135 read 0x26b2904 thru 0x26b36d4 (0xdd1 bytes) 2024-09-22T01:35:19.162 INFO:teuthology.orchestra.run.smithi018.stdout:1137 trunc from 0x7f5aa58 to 0xc92744d 2024-09-22T01:35:19.182 INFO:teuthology.orchestra.run.smithi018.stdout:1138 trunc from 0xc92744d to 0x6f3581b 2024-09-22T01:35:19.188 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:19.186+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:19.207 INFO:teuthology.orchestra.run.smithi018.stdout:1139 write 0x5366534 thru 0x5373a25 (0xd4f2 bytes) 2024-09-22T01:35:19.218 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:19.218 INFO:teuthology.orchestra.run.smithi018.stdout:1141 punch from 0x33f7029 to 0x33fb2c9, (0x42a0 bytes) 2024-09-22T01:35:19.219 INFO:teuthology.orchestra.run.smithi018.stdout:1144 read 0x4092b20 thru 0x40a1236 (0xe717 bytes) 2024-09-22T01:35:19.219 INFO:teuthology.orchestra.run.smithi018.stdout:1145 read 0x5034a79 thru 0x50414f2 (0xca7a bytes) 2024-09-22T01:35:19.220 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:19.220 INFO:teuthology.orchestra.run.smithi018.stdout:1148 write 0x34184d5 thru 0x3423ab5 (0xb5e1 bytes) 2024-09-22T01:35:19.229 INFO:teuthology.orchestra.run.smithi018.stdout:1149 write 0x17ec114 thru 0x17f0144 (0x4031 bytes) 2024-09-22T01:35:19.233 INFO:teuthology.orchestra.run.smithi018.stdout:1153 writesame 0x5d3acb5 thru 0x5d40c59 data_size 0x3b(0x5fa5 bytes) 2024-09-22T01:35:19.237 INFO:teuthology.orchestra.run.smithi018.stdout:1154 read 0xc6836d thru 0xc6bd73 (0x3a07 bytes) 2024-09-22T01:35:19.237 INFO:teuthology.orchestra.run.smithi018.stdout:1155 write 0x5db8950 thru 0x5dc78a5 (0xef56 bytes) 2024-09-22T01:35:19.241 INFO:teuthology.orchestra.run.smithi018.stdout:1159 read 0x19f3a44 thru 0x19f4d08 (0x12c5 bytes) 2024-09-22T01:35:19.242 INFO:teuthology.orchestra.run.smithi018.stdout:1160 writesame 0x2e6f858 thru 0x2e7b9c9 data_size 0xb(0xc172 bytes) 2024-09-22T01:35:19.249 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:19.249 INFO:teuthology.orchestra.run.smithi018.stdout:1162 read 0x4aacc8 thru 0x4b4123 (0x945c bytes) 2024-09-22T01:35:19.249 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:19.250 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:19.250 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:19.250 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:19.251 INFO:teuthology.orchestra.run.smithi018.stdout:1166 punch from 0x3bfb5b5 to 0x3bfe613, (0x305e bytes) 2024-09-22T01:35:19.251 INFO:teuthology.orchestra.run.smithi018.stdout:1167 read 0x1e11216 thru 0x1e201bc (0xefa7 bytes) 2024-09-22T01:35:19.252 INFO:teuthology.orchestra.run.smithi018.stdout:1168 write 0x37e8230 thru 0x37f17c4 (0x9595 bytes) 2024-09-22T01:35:19.255 INFO:teuthology.orchestra.run.smithi018.stdout:1170 read 0x28f2fa0 thru 0x2902bd3 (0xfc34 bytes) 2024-09-22T01:35:19.257 INFO:teuthology.orchestra.run.smithi018.stdout:1171 read 0x6ba209c thru 0x6ba3b9a (0x1aff bytes) 2024-09-22T01:35:19.257 INFO:teuthology.orchestra.run.smithi018.stdout:1173 clone 13 order 24 su 8388608 sc 9 2024-09-22T01:35:19.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:19.289 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:19.285+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:19.390 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:19.389+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:19.432 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:19.433 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:19.433 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:19.433 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:19.433 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:19.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:19.491 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:19.490+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.441219693000001, 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:19.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:19.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:19.574 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.441193956999999, 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:35:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:35:19.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.441168175, 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:19.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:35:19.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:35:19.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:19.583 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.441123256000001, 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:35:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:35:19.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.4410911, 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.441063368, 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.591 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.441027544000001, 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.4409914, 2024-09-22T01:35:19.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.440955195000001, 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.602 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.440927843000001, 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.606 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:19.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:35:19.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.609 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.440890765000001, 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:19.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.440867228, 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12683 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.440377228999999, 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058771337, 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.617 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12683 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126558+0000", 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6399999999999998e-07 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126559+0000", 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8360000000000001e-06 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126567+0000", 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4189999999999996e-06 2024-09-22T01:35:19.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126578+0000", 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1439e-05 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185320+0000", 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058741987000000002 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185329+0000", 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2919999999999996e-06 2024-09-22T01:35:19.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.440320028, 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.440292271000001, 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:19.628 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.440270205000001, 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:19.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:35:19.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:35:19.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.440240044999999, 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:35:19.632 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:35:19.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.439819555, 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.439793774, 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 14.439772506000001, 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:19.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:19.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:35:19.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:19.647 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:19.647 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:19.648 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:19.649 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:19.646+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:19.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:19.749 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:19.746+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:19.749 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:35:19.788 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:19.788 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:19.788 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:19.788 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:19.803 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:19.844 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone12 from 0x6f3581b (overlap 0x325e19) to 0x284b47 2024-09-22T01:35:19.849 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:19.849+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:19.857 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:19.877 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:19.898 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:19.898 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:19.921 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:19.921 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:19.929 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:19.929 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:19.929 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:19.929 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:19.929 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:19.939 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:19.939 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:19.944 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:19.958 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-22T01:35:19.958 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:19.985 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:19.986 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:19.989 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:19.989+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:20.003 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:20.003 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:20.052 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:20.049+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:20.112 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:20.112 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:20.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:20.169 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:20.169+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:20.254 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:20.250+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:20.291 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:20.291 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:20.305 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:20.355 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:20.350+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:20.422 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:20.422 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:20.436 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:20.456 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:20.454+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:20.553 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:20.554 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:20.557 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:20.557+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:20.568 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:20.658 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:20.657+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:20.732 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:20.732 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:35:20.751 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:20.758 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:20.754+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:20.795 INFO:teuthology.orchestra.run.smithi018.stdout:1174 write 0x26b049e thru 0x26b7a01 (0x7564 bytes) 2024-09-22T01:35:20.811 INFO:teuthology.orchestra.run.smithi018.stdout:1175 write 0x46c59ff thru 0x46cde56 (0x8458 bytes) 2024-09-22T01:35:20.817 INFO:teuthology.orchestra.run.smithi018.stdout:1176 write 0x4d0858e thru 0x4d15923 (0xd396 bytes) 2024-09-22T01:35:20.840 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:20.858 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:20.854+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:20.867 INFO:teuthology.orchestra.run.smithi018.stdout:1181 write 0xe3cd5de thru 0xe3d6d64 (0x9787 bytes) 2024-09-22T01:35:20.902 INFO:teuthology.orchestra.run.smithi018.stdout:1182 trunc from 0xe3d6d65 to 0x2ebf511 2024-09-22T01:35:20.922 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:20.922 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:20.939 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:20.959 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:20.954+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:20.967 INFO:teuthology.orchestra.run.smithi018.stdout:1183 write 0x7799f5f thru 0x77a4b47 (0xabe9 bytes) 2024-09-22T01:35:20.974 INFO:teuthology.orchestra.run.smithi018.stdout:1185 trunc from 0x77a4b48 to 0x9529f95 2024-09-22T01:35:20.984 INFO:teuthology.orchestra.run.smithi018.stdout:1186 read 0x4346cbb thru 0x4349adf (0x2e25 bytes) 2024-09-22T01:35:21.005 INFO:teuthology.orchestra.run.smithi018.stdout:1187 trunc from 0x9529f95 to 0x1bef874 2024-09-22T01:35:21.042 INFO:teuthology.orchestra.run.smithi018.stdout:1188 writesame 0x26f6d37 thru 0x27007ce data_size 0x88(0x9a98 bytes) 2024-09-22T01:35:21.060 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:21.057+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:21.063 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:21.063 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:21.073 INFO:teuthology.orchestra.run.smithi018.stdout:1190 writesame 0x82022e3 thru 0x82091a9 data_size 0x45(0x6ec7 bytes) 2024-09-22T01:35:21.079 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:21.095 INFO:teuthology.orchestra.run.smithi018.stdout:1191 write 0xb191c1f thru 0xb1a0c89 (0xf06b bytes) 2024-09-22T01:35:21.101 INFO:teuthology.orchestra.run.smithi018.stdout:1192 read 0x9fc345f thru 0x9fce1ce (0xad70 bytes) 2024-09-22T01:35:21.102 INFO:teuthology.orchestra.run.smithi018.stdout:1193 write 0x6f3cebf thru 0x6f4c3ff (0xf541 bytes) 2024-09-22T01:35:21.108 INFO:teuthology.orchestra.run.smithi018.stdout:1195 write 0xa1190f8 thru 0xa1288d2 (0xf7db bytes) 2024-09-22T01:35:21.114 INFO:teuthology.orchestra.run.smithi018.stdout:1196 write 0x897b067 thru 0x8982672 (0x760c bytes) 2024-09-22T01:35:21.119 INFO:teuthology.orchestra.run.smithi018.stdout:1197 read 0x6ddc25b thru 0x6de1b7c (0x5922 bytes) 2024-09-22T01:35:21.120 INFO:teuthology.orchestra.run.smithi018.stdout:1198 write 0x1a78e95 thru 0x1a888db (0xfa47 bytes) 2024-09-22T01:35:21.124 INFO:teuthology.orchestra.run.smithi018.stdout:1199 punch from 0x8062908 to 0x806df7d, (0xb675 bytes) 2024-09-22T01:35:21.124 INFO:teuthology.orchestra.run.smithi018.stdout:1200 punch from 0x248170f to 0x248a0da, (0x89cb bytes) 2024-09-22T01:35:21.133 INFO:teuthology.orchestra.run.smithi018.stdout:1201 trunc from 0xb1a0c8a to 0x82612ee 2024-09-22T01:35:21.155 INFO:teuthology.orchestra.run.smithi018.stdout:1202 read 0x61c7d2a thru 0x61d5595 (0xd86c bytes) 2024-09-22T01:35:21.165 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:21.165+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:1203 writesame 0xb650218 thru 0xb65bd08 data_size 0x1(0xbaf1 bytes) 2024-09-22T01:35:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:1204 punch from 0x3daf120 to 0x3db2026, (0x2f06 bytes) 2024-09-22T01:35:21.175 INFO:teuthology.orchestra.run.smithi018.stdout:1205 write 0xab46533 thru 0xab4f2aa (0x8d78 bytes) 2024-09-22T01:35:21.181 INFO:teuthology.orchestra.run.smithi018.stdout:1207 read 0x2d72d00 thru 0x2d819ff (0xed00 bytes) 2024-09-22T01:35:21.181 INFO:teuthology.orchestra.run.smithi018.stdout:1208 writesame 0x16f699 thru 0x1755d3 data_size 0x1(0x5f3b bytes) 2024-09-22T01:35:21.204 INFO:teuthology.orchestra.run.smithi018.stdout:1210 trunc from 0xb65bd09 to 0xdc6ee3a 2024-09-22T01:35:21.217 INFO:teuthology.orchestra.run.smithi018.stdout:1212 write 0x56f6538 thru 0x5703d9c (0xd865 bytes) 2024-09-22T01:35:21.221 INFO:teuthology.orchestra.run.smithi018.stdout:1214 read 0x8cc9d4b thru 0x8ccece4 (0x4f9a bytes) 2024-09-22T01:35:21.222 INFO:teuthology.orchestra.run.smithi018.stdout:1215 write 0x5f7296 thru 0x5fae51 (0x3bbc bytes) 2024-09-22T01:35:21.225 INFO:teuthology.orchestra.run.smithi018.stdout:1216 writesame 0x64a4d0d thru 0x64a7462 data_size 0xa(0x2756 bytes) 2024-09-22T01:35:21.230 INFO:teuthology.orchestra.run.smithi018.stdout:1219 write 0xa09175e thru 0xa09c808 (0xb0ab bytes) 2024-09-22T01:35:21.237 INFO:teuthology.orchestra.run.smithi018.stdout:1221 writesame 0x14e8521 thru 0x14f6f8e data_size 0x25(0xea6e bytes) 2024-09-22T01:35:21.239 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:21.239 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:21.252 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:21.261 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:21.258+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:21.263 INFO:teuthology.orchestra.run.smithi018.stdout:1222 trunc from 0xdc6ee3a to 0x61d8643 2024-09-22T01:35:21.286 INFO:teuthology.orchestra.run.smithi018.stdout:1223 read 0x213c812 thru 0x2141729 (0x4f18 bytes) 2024-09-22T01:35:21.287 INFO:teuthology.orchestra.run.smithi018.stdout:1224 punch from 0x429ab2c to 0x429ddd2, (0x32a6 bytes) 2024-09-22T01:35:21.305 INFO:teuthology.orchestra.run.smithi018.stdout:1226 trunc from 0x61d8643 to 0xcf3670f 2024-09-22T01:35:21.317 INFO:teuthology.orchestra.run.smithi018.stdout:1227 write 0x57f3f61 thru 0x57fd623 (0x96c3 bytes) 2024-09-22T01:35:21.319 INFO:teuthology.orchestra.run.smithi018.stdout:1228 writesame 0x86c807b thru 0x86d6c89 data_size 0x7(0xec0f bytes) 2024-09-22T01:35:21.329 INFO:teuthology.orchestra.run.smithi018.stdout:1229 read 0x3806cc4 thru 0x380ebdb (0x7f18 bytes) 2024-09-22T01:35:21.329 INFO:teuthology.orchestra.run.smithi018.stdout:1230 read 0x618e6aa thru 0x618f282 (0xbd9 bytes) 2024-09-22T01:35:21.330 INFO:teuthology.orchestra.run.smithi018.stdout:1233 clone 14 order 23 su 4194304 sc 8 2024-09-22T01:35:21.362 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:21.361+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:21.412 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:21.412 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:21.425 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:21.469 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:21.469+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:21.564 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:21.561+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:21.590 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:21.590 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:21.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:21.666 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:21.665+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:21.735 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:21.735 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:35:21.735 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T01:35:21.735 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T01:35:21.742 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:21.742 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:21.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:21.807 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:21.806+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:21.867 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:21.866+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:no valid command found; 10 closest matches: 2024-09-22T01:35:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:0 2024-09-22T01:35:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:1 2024-09-22T01:35:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:2 2024-09-22T01:35:21.897 INFO:teuthology.orchestra.run.smithi018.stderr:abort 2024-09-22T01:35:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:assert 2024-09-22T01:35:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:bench [] [] [] [] 2024-09-22T01:35:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs debug_inject_read_zeros 2024-09-22T01:35:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs files list 2024-09-22T01:35:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs stats 2024-09-22T01:35:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:bluestore allocator dump block 2024-09-22T01:35:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:Error EINVAL: invalid command 2024-09-22T01:35:21.900 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T01:35:21.900 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T01:35:21.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T01:35:21.924 INFO:teuthology.orchestra.run.smithi018.stdout:flattening image image_client.0-clone13 2024-09-22T01:35:21.931 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:21.931 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:21.949 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:21.968 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:21.965+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:22.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:22.068 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:22.065+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:22.114 INFO:teuthology.orchestra.run.smithi018.stderr:no valid command found; 10 closest matches: 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:0 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:1 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:2 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:abort 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:assert 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:bench [] [] [] [] 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs debug_inject_read_zeros 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs files list 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs stats 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:bluestore allocator dump block 2024-09-22T01:35:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:Error EINVAL: invalid command 2024-09-22T01:35:22.118 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T01:35:22.118 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T01:35:22.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T01:35:22.121 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:22.121 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:22.139 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:22.146 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-22T01:35:22.158 INFO:teuthology.orchestra.run.smithi018.stdout:1234 read 0x610dff4 thru 0x610ee8f (0xe9c bytes) 2024-09-22T01:35:22.167 INFO:teuthology.orchestra.run.smithi018.stdout:1235 trunc from 0xcf3670f to 0x80e79b4 2024-09-22T01:35:22.168 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:22.165+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:22.215 INFO:teuthology.orchestra.run.smithi018.stdout:1236 writesame 0xb9f26a5 thru 0xb9f7111 data_size 0x49(0x4a6d bytes) 2024-09-22T01:35:22.215 INFO:teuthology.orchestra.run.smithi018.stdout:1237 read 0x9c80ed thru 0x9c8c22 (0xb36 bytes) 2024-09-22T01:35:22.218 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:22.219 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:22.219 INFO:teuthology.orchestra.run.smithi018.stdout:1238 trunc from 0xb9f7112 to 0x9e71505 2024-09-22T01:35:22.237 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:22.237 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:22.247 INFO:teuthology.orchestra.run.smithi018.stdout:1239 writesame 0xa391609 thru 0xa3922aa data_size 0x2a(0xca2 bytes) 2024-09-22T01:35:22.250 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:22.258 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:22.265 INFO:teuthology.orchestra.run.smithi018.stdout:1244 writesame 0xb581502 thru 0xb58d097 data_size 0xd(0xbb96 bytes) 2024-09-22T01:35:22.269 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:22.266+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:22.277 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:22.277 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:22.279 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:22.280 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:22.280 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:22.281 INFO:teuthology.orchestra.run.smithi018.stdout:1246 write 0xcfbe576 thru 0xcfcc54e (0xdfd9 bytes) 2024-09-22T01:35:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:no valid command found; 10 closest matches: 2024-09-22T01:35:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:0 2024-09-22T01:35:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:1 2024-09-22T01:35:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:2 2024-09-22T01:35:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:abort 2024-09-22T01:35:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:assert 2024-09-22T01:35:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:bench [] [] [] [] 2024-09-22T01:35:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs debug_inject_read_zeros 2024-09-22T01:35:22.283 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs files list 2024-09-22T01:35:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs stats 2024-09-22T01:35:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:bluestore allocator dump block 2024-09-22T01:35:22.284 INFO:teuthology.orchestra.run.smithi018.stderr:Error EINVAL: invalid command 2024-09-22T01:35:22.287 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T01:35:22.287 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T01:35:22.287 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-22T01:35:22.289 INFO:teuthology.orchestra.run.smithi018.stdout:1247 write 0x70cabfe thru 0x70d4818 (0x9c1b bytes) 2024-09-22T01:35:22.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:22.296 INFO:teuthology.orchestra.run.smithi018.stdout:1248 read 0x4a9cc91 thru 0x4aa5c77 (0x8fe7 bytes) 2024-09-22T01:35:22.298 INFO:teuthology.orchestra.run.smithi018.stdout:1251 writesame 0x1af785b thru 0x1b0366a data_size 0x8(0xbe10 bytes) 2024-09-22T01:35:22.301 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:22.302 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:22.312 INFO:teuthology.orchestra.run.smithi018.stdout:1252 trunc from 0xcfcc54f to 0xd6d0456 2024-09-22T01:35:22.327 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:22.327 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:22.336 INFO:teuthology.orchestra.run.smithi018.stdout:1254 write 0xdcb6ac8 thru 0xdcb9500 (0x2a39 bytes) 2024-09-22T01:35:22.343 INFO:teuthology.orchestra.run.smithi018.stdout:1256 writesame 0x5911d6c thru 0x591d9a3 data_size 0x26(0xbc38 bytes) 2024-09-22T01:35:22.349 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:22.349 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:22.362 INFO:teuthology.orchestra.run.smithi018.stdout:1257 write 0xea35ef5 thru 0xea40329 (0xa435 bytes) 2024-09-22T01:35:22.368 INFO:teuthology.orchestra.run.smithi018.stdout:1258 writesame 0x960276b thru 0x9608414 data_size 0x2(0x5caa bytes) 2024-09-22T01:35:22.370 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:22.369+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:22.386 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:22.386 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:22.387 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:22.387 INFO:teuthology.orchestra.run.smithi018.stdout:1260 writesame 0xc15a5e5 thru 0xc1644b7 data_size 0x1(0x9ed3 bytes) 2024-09-22T01:35:22.418 INFO:teuthology.orchestra.run.smithi018.stdout:1262 read 0x185f9b8 thru 0x1866461 (0x6aaa bytes) 2024-09-22T01:35:22.419 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:22.424 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:22.424 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:22.425 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:22.425 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:22.436 INFO:teuthology.orchestra.run.smithi018.stdout:1265 trunc from 0xea4032a to 0x2e2b18 2024-09-22T01:35:22.450 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:no valid command found; 10 closest matches: 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:0 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:1 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:2 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:abort 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:assert 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:bench [] [] [] [] 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs debug_inject_read_zeros 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs files list 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs stats 2024-09-22T01:35:22.459 INFO:teuthology.orchestra.run.smithi018.stderr:bluestore allocator dump block 2024-09-22T01:35:22.460 INFO:teuthology.orchestra.run.smithi018.stderr:Error EINVAL: invalid command 2024-09-22T01:35:22.461 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T01:35:22.462 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T01:35:22.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-22T01:35:22.471 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:22.469+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:22.505 INFO:teuthology.orchestra.run.smithi018.stdout:1269 punch from 0x1d8ebf to 0x1e04ae, (0x75ef bytes) 2024-09-22T01:35:22.505 INFO:teuthology.orchestra.run.smithi018.stdout:1271 read 0x269a5a thru 0x26fd8a (0x6331 bytes) 2024-09-22T01:35:22.506 INFO:teuthology.orchestra.run.smithi018.stdout:1272 punch from 0x7c825 to 0x87638, (0xae13 bytes) 2024-09-22T01:35:22.520 INFO:teuthology.orchestra.run.smithi018.stdout:1273 write 0x18e9979 thru 0x18f4d14 (0xb39c bytes) 2024-09-22T01:35:22.526 INFO:teuthology.orchestra.run.smithi018.stdout:1274 read 0x178c371 thru 0x178faab (0x373b bytes) 2024-09-22T01:35:22.538 INFO:teuthology.orchestra.run.smithi018.stdout:1275 trunc from 0x18f4d15 to 0xbd49089 2024-09-22T01:35:22.549 INFO:teuthology.orchestra.run.smithi018.stdout:1276 read 0x1096a2 thru 0x10fc3a (0x6599 bytes) 2024-09-22T01:35:22.551 INFO:teuthology.orchestra.run.smithi018.stdout:1277 write 0x71c259d thru 0x71c7c56 (0x56ba bytes) 2024-09-22T01:35:22.556 INFO:teuthology.orchestra.run.smithi018.stdout:1278 read 0x4442cf0 thru 0x444e323 (0xb634 bytes) 2024-09-22T01:35:22.556 INFO:teuthology.orchestra.run.smithi018.stdout:1279 read 0x449305f thru 0x449fd3e (0xcce0 bytes) 2024-09-22T01:35:22.556 INFO:teuthology.orchestra.run.smithi018.stdout:1283 punch from 0x74c904c to 0x74d471c, (0xb6d0 bytes) 2024-09-22T01:35:22.556 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:22.556 INFO:teuthology.orchestra.run.smithi018.stdout:1290 read 0x5754cb8 thru 0x575e18d (0x94d6 bytes) 2024-09-22T01:35:22.556 INFO:teuthology.orchestra.run.smithi018.stdout:1292 read 0x86eca76 thru 0x86ed073 (0x5fe bytes) 2024-09-22T01:35:22.571 INFO:teuthology.orchestra.run.smithi018.stdout:1293 writesame 0xe639f4d thru 0xe642615 data_size 0x43(0x86c9 bytes) 2024-09-22T01:35:22.571 INFO:teuthology.orchestra.run.smithi018.stdout:1295 read 0x8a78b26 thru 0x8a88381 (0xf85c bytes) 2024-09-22T01:35:22.571 INFO:teuthology.orchestra.run.smithi018.stdout:1296 write 0x38da7d0 thru 0x38e60a1 (0xb8d2 bytes) 2024-09-22T01:35:22.572 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:22.570+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:22.573 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:602 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 27.872422932999999, 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055897943999999998, 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.574 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 602 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699628+0000", 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6330000000000002e-06 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699650+0000", 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2056999999999999e-05 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699689+0000", 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9109000000000001e-05 2024-09-22T01:35:22.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699707+0000", 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7207e-05 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699868+0000", 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016106200000000001 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.700040+0000", 2024-09-22T01:35:22.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171865 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.707678+0000", 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076380479999999997 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755348+0000", 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.047670037999999998 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:22.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755387+0000", 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9662000000000001e-05 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755455+0000", 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7995000000000002e-05 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755523+0000", 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7267999999999994e-05 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.579 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11290 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.701797664000001, 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048997573000000003, 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11290 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.580 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:35:22.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870253+0000", 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5019999999999999e-06 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870274+0000", 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1064999999999999e-05 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870280+0000", 2024-09-22T01:35:22.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3230000000000003e-06 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919056+0000", 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048776031999999997 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919138+0000", 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1846000000000002e-05 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919247+0000", 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000109329 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11291 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.701755856999998, 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049210375000000001, 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.584 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11291 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:22.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870461+0000", 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169476 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870465+0000", 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870477+0000", 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1207e-05 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870484+0000", 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.481e-06 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919295+0000", 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048810529999999998 2024-09-22T01:35:22.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919380+0000", 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5773999999999996e-05 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919502+0000", 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121662 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11292 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.701549926999999, 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049215074999999997, 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11292 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870610+0000", 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112569 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870615+0000", 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3630000000000004e-06 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870626+0000", 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1460999999999999e-05 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870633+0000", 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8170000000000001e-06 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919546+0000", 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048912723999999998 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919651+0000", 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105437 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919713+0000", 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1704000000000004e-05 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11293 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.701403395, 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049300425000000002, 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11293 2024-09-22T01:35:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870769+0000", 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125289 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870774+0000", 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1099999999999996e-06 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870784+0000", 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0664e-05 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870791+0000", 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919753+0000", 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048961849000000002 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919840+0000", 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6917999999999997e-05 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919945+0000", 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010444499999999999 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.597 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11294 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 694272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.701244551999999, 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049352066999999999, 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11294 2024-09-22T01:35:22.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870909+0000", 2024-09-22T01:35:22.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105821 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870913+0000", 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3329999999999998e-06 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870929+0000", 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6146000000000001e-05 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870938+0000", 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8470000000000002e-06 2024-09-22T01:35:22.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919988+0000", 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049050170999999997 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920051+0000", 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2337999999999998e-05 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920155+0000", 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104411 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.601 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11295 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 868352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.701097221000001, 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049438600999999999, 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11295 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.602 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872025+0000", 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001075037 2024-09-22T01:35:22.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872031+0000", 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3619999999999997e-06 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872043+0000", 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2075999999999999e-05 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872052+0000", 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-06 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920196+0000", 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048143803999999998 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920284+0000", 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7454999999999995e-05 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920389+0000", 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105167 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11313 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 346112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.699932641, 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048873528999999999, 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11313 2024-09-22T01:35:22.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6300000000000001e-07 2024-09-22T01:35:22.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872117+0000", 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2450000000000001e-06 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872125+0000", 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872130+0000", 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9280000000000001e-06 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920837+0000", 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048706948999999999 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920921+0000", 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3459000000000002e-05 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920988+0000", 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7644000000000005e-05 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11314 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.699910126999999, 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049091919999999997, 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11314 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872138+0000", 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3799999999999998e-07 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872140+0000", 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5500000000000001e-06 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872147+0000", 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6680000000000004e-06 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872152+0000", 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4269999999999999e-06 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921028+0000", 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048875778000000002 2024-09-22T01:35:22.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921118+0000", 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0148000000000005e-05 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921229+0000", 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110911 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11315 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.613 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.699888473000001, 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049217209999999997, 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11315 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:22.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872362+0000", 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203131 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872368+0000", 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6210000000000001e-06 2024-09-22T01:35:22.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872379+0000", 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872388+0000", 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000002e-06 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921263+0000", 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048874828000000002 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921309+0000", 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5843000000000001e-05 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921376+0000", 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7429999999999996e-05 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11316 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.699645734000001, 2024-09-22T01:35:22.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049209332000000001, 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11316 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872627+0000", 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022554899999999999 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872638+0000", 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0964e-05 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872652+0000", 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100999999999999e-05 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872661+0000", 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8340000000000005e-06 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921415+0000", 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048753713999999997 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921505+0000", 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9554000000000004e-05 2024-09-22T01:35:22.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921611+0000", 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106616 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11317 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 714752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.699373433000002, 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049068392000000002, 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.621 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11317 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872821+0000", 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014710999999999999 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872826+0000", 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5399999999999997e-06 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872839+0000", 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3441999999999999e-05 2024-09-22T01:35:22.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872854+0000", 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4364e-05 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921646+0000", 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048791961000000002 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921688+0000", 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.286e-05 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921742+0000", 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4114999999999999e-05 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11318 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 888832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.699181797000001, 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049108288, 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11318 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873096+0000", 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023050300000000001 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873102+0000", 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5269999999999998e-06 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873114+0000", 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1802e-05 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873121+0000", 2024-09-22T01:35:22.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4209999999999998e-06 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921782+0000", 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048660582000000001 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921869+0000", 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7798000000000002e-05 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921974+0000", 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010465499999999999 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11319 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 899072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.698914172999999, 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048963590000000001, 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11319 2024-09-22T01:35:22.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873305+0000", 2024-09-22T01:35:22.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017154 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873310+0000", 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873326+0000", 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.558e-05 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873343+0000", 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6894000000000001e-05 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922006+0000", 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.04866293 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922047+0000", 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0952999999999999e-05 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922097+0000", 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0413e-05 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.632 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11333 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 8192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.698691492000002, 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048982295000000002, 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11333 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875169+0000", 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018133089999999999 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875175+0000", 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875189+0000", 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3886999999999999e-05 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875197+0000", 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5369999999999997e-06 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922139+0000", 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.046941573 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922231+0000", 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2565000000000006e-05 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922338+0000", 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107124 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11384 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 755712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.694268492999999, 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048901420000000001, 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11384 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877943+0000", 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164411 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877948+0000", 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3340000000000003e-06 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877959+0000", 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1027e-05 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877966+0000", 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1099999999999997e-06 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926570+0000", 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048603810999999997 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926616+0000", 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6335999999999998e-05 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926680+0000", 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4391000000000001e-05 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11386 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 940032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.641 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.693928514, 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048882052000000002, 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11386 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:22.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878210+0000", 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1310999999999994e-05 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878215+0000", 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4259999999999996e-06 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878229+0000", 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.448e-05 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878244+0000", 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718e-05 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926854+0000", 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048610318999999999 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926939+0000", 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4919999999999993e-05 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927001+0000", 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1878000000000006e-05 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11401 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.693790030999999, 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048953133000000003, 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11401 2024-09-22T01:35:22.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878258+0000", 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878261+0000", 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7590000000000002e-06 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878269+0000", 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878276+0000", 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2420000000000003e-06 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927095+0000", 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048819573999999998 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927153+0000", 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7120000000000002e-05 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927211+0000", 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8062000000000001e-05 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11402 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 59392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.693764235, 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049110529, 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:22.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11402 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879206+0000", 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092231699999999997 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879211+0000", 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1830000000000002e-06 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879223+0000", 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2388000000000001e-05 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879229+0000", 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3800000000000002e-06 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927251+0000", 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048022479999999999 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927321+0000", 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9760999999999998e-05 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927394+0000", 2024-09-22T01:35:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3020000000000002e-05 2024-09-22T01:35:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.654 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:57526 3.4 3:206aa493:::rbd_data.110f75bcea59.000000000000001b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 7372800~19816] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e44)", 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:17.724909+0000", 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.8471384989999997, 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3084367779999999, 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 57526 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:22.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724909+0000", 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724909+0000", 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724911+0000", 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8309999999999999e-06 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:22.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724927+0000", 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6178e-05 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724943+0000", 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6288000000000001e-05 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724956+0000", 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3061000000000001e-05 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.725164+0000", 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020745400000000001 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.725175+0000", 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1342000000000001e-05 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.027010+0000", 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3018344230000001 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for missing object", 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.027093+0000", 2024-09-22T01:35:22.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3839999999999997e-05 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.030511+0000", 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034172019999999998 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.030758+0000", 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024743999999999998 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5", 2024-09-22T01:35:22.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.031007+0000", 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024887500000000002 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.032445+0000", 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001438153 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.033242+0000", 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079685900000000002 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.033282+0000", 2024-09-22T01:35:22.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0346000000000003e-05 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.033346+0000", 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3485999999999995e-05 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:22.661 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:22.662 INFO:teuthology.orchestra.run.smithi018.stdout:1297 read 0x19652b8 thru 0x19652d7 (0x20 bytes) 2024-09-22T01:35:22.662 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:22.662 INFO:teuthology.orchestra.run.smithi018.stdout:1299 write 0x76930c7 thru 0x769a3ad (0x72e7 bytes) 2024-09-22T01:35:22.662 INFO:teuthology.orchestra.run.smithi018.stdout:1300 writesame 0x5c9802f thru 0x5c9ff55 data_size 0x1(0x7f27 bytes) 2024-09-22T01:35:22.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:22.664 INFO:teuthology.orchestra.run.smithi018.stdout:1301 writesame 0x49f5453 thru 0x49fb18b data_size 0x2b(0x5d39 bytes) 2024-09-22T01:35:22.664 INFO:teuthology.orchestra.run.smithi018.stdout:1302 read 0xd7f301d thru 0xd7fd99c (0xa980 bytes) 2024-09-22T01:35:22.664 INFO:teuthology.orchestra.run.smithi018.stdout:1303 write 0x8b074e6 thru 0x8b1567f (0xe19a bytes) 2024-09-22T01:35:22.664 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:22.664 INFO:teuthology.orchestra.run.smithi018.stdout:1305 trunc from 0xe642616 to 0x70040d6 2024-09-22T01:35:22.665 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T01:35:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:no valid command found; 10 closest matches: 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:0 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:1 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:abort 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:assert 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:bench [] [] [] [] 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs debug_inject_read_zeros 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs files list 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs stats 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:bluestore allocator dump block 2024-09-22T01:35:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:Error EINVAL: invalid command 2024-09-22T01:35:22.667 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T01:35:22.667 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-09-22T01:35:22.667 INFO:teuthology.orchestra.run.smithi018.stdout:1306 punch from 0x218eb8f to 0x218f57c, (0x9ed bytes) 2024-09-22T01:35:22.673 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:22.669+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:22.685 INFO:teuthology.orchestra.run.smithi018.stdout:1307 write 0xbed225f thru 0xbed33cd (0x116f bytes) 2024-09-22T01:35:22.693 INFO:teuthology.orchestra.run.smithi018.stdout:1308 write 0x4c3404e thru 0x4c343de (0x391 bytes) 2024-09-22T01:35:22.700 INFO:teuthology.orchestra.run.smithi018.stdout:1309 read 0xbc8342f thru 0xbc8b0b1 (0x7c83 bytes) 2024-09-22T01:35:22.701 INFO:teuthology.orchestra.run.smithi018.stdout:1310 writesame 0x20f28b9 thru 0x20fb368 data_size 0x38(0x8ab0 bytes) 2024-09-22T01:35:22.705 INFO:teuthology.orchestra.run.smithi018.stdout:1311 write 0x6085f1f thru 0x6092717 (0xc7f9 bytes) 2024-09-22T01:35:22.711 INFO:teuthology.orchestra.run.smithi018.stdout:1312 read 0x579c150 thru 0x57a2815 (0x66c6 bytes) 2024-09-22T01:35:22.712 INFO:teuthology.orchestra.run.smithi018.stdout:1313 write 0x298c9d thru 0x29b78f (0x2af3 bytes) 2024-09-22T01:35:22.716 INFO:teuthology.orchestra.run.smithi018.stdout:1314 write 0x234562a thru 0x23488ef (0x32c6 bytes) 2024-09-22T01:35:22.719 INFO:teuthology.orchestra.run.smithi018.stdout:1315 write 0x2b578fc thru 0x2b65c34 (0xe339 bytes) 2024-09-22T01:35:22.725 INFO:teuthology.orchestra.run.smithi018.stdout:1316 read 0x3893585 thru 0x3899f94 (0x6a10 bytes) 2024-09-22T01:35:22.726 INFO:teuthology.orchestra.run.smithi018.stdout:1317 write 0x55906 thru 0x6178c (0xbe87 bytes) 2024-09-22T01:35:22.730 INFO:teuthology.orchestra.run.smithi018.stdout:1318 read 0x8446c18 thru 0x8449059 (0x2442 bytes) 2024-09-22T01:35:22.730 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:22.730 INFO:teuthology.orchestra.run.smithi018.stdout:1320 writesame 0x6448f8d thru 0x644cd06 data_size 0x6(0x3d7a bytes) 2024-09-22T01:35:22.753 INFO:teuthology.orchestra.run.smithi018.stdout:1321 write 0xdfd203f thru 0xdfdfaed (0xdaaf bytes) 2024-09-22T01:35:22.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:35:22.772 INFO:teuthology.orchestra.run.smithi018.stdout:1322 trunc from 0xdfdfaee to 0x506b0a6 2024-09-22T01:35:22.774 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:22.770+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:22.804 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:22.804 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:22.804 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:22.820 INFO:teuthology.orchestra.run.smithi018.stdout:1324 write 0x5094344 thru 0x50948b8 (0x575 bytes) 2024-09-22T01:35:22.822 INFO:teuthology.orchestra.run.smithi018.stdout:1325 read 0x1a45257 thru 0x1a473af (0x2159 bytes) 2024-09-22T01:35:22.823 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:22.825 INFO:teuthology.orchestra.run.smithi018.stdout:1326 trunc from 0x50948b9 to 0x6d2b891 2024-09-22T01:35:22.836 INFO:teuthology.orchestra.run.smithi018.stdout:1327 write 0x5ea43d8 thru 0x5eb207f (0xdca8 bytes) 2024-09-22T01:35:22.840 INFO:teuthology.orchestra.run.smithi018.stderr:no valid command found; 10 closest matches: 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:0 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:1 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:2 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:abort 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:assert 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:bench [] [] [] [] 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs debug_inject_read_zeros 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs files list 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs stats 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:bluestore allocator dump block 2024-09-22T01:35:22.841 INFO:teuthology.orchestra.run.smithi018.stderr:Error EINVAL: invalid command 2024-09-22T01:35:22.842 INFO:teuthology.orchestra.run.smithi018.stdout:1329 read 0x2975d97 thru 0x2980f7c (0xb1e6 bytes) 2024-09-22T01:35:22.842 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:22.843 INFO:teuthology.orchestra.run.smithi018.stdout:1331 write 0x691ccbc thru 0x69296fa (0xca3f bytes) 2024-09-22T01:35:22.844 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T01:35:22.844 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T01:35:22.845 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-22T01:35:22.846 INFO:teuthology.orchestra.run.smithi018.stdout:1332 read 0x4fa8116 thru 0x4fb793a (0xf825 bytes) 2024-09-22T01:35:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:1334 punch from 0x1d80e50 to 0x1d87c1e, (0x6dce bytes) 2024-09-22T01:35:22.847 INFO:teuthology.orchestra.run.smithi018.stdout:1335 write 0x44c2e4f thru 0x44d1db0 (0xef62 bytes) 2024-09-22T01:35:22.851 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:22.870 INFO:teuthology.orchestra.run.smithi018.stdout:1338 write 0xc7f869a thru 0xc8002d3 (0x7c3a bytes) 2024-09-22T01:35:22.873 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:22.870+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:22.878 INFO:teuthology.orchestra.run.smithi018.stdout:1339 read 0xa9f402d thru 0xa9fe63a (0xa60e bytes) 2024-09-22T01:35:22.888 INFO:teuthology.orchestra.run.smithi018.stdout:1340 trunc from 0xc8002d4 to 0x4e65a69 2024-09-22T01:35:22.938 INFO:teuthology.orchestra.run.smithi018.stdout:1341 trunc from 0x4e65a69 to 0xe9c6f8f 2024-09-22T01:35:22.947 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:22.947 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:22.947 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:22.949 INFO:teuthology.orchestra.run.smithi018.stdout:1342 write 0x8cbdb1f thru 0x8cc138d (0x386f bytes) 2024-09-22T01:35:22.956 INFO:teuthology.orchestra.run.smithi018.stdout:1343 writesame 0x8d91b48 thru 0x8d95e0b data_size 0x2(0x42c4 bytes) 2024-09-22T01:35:22.961 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:22.968 INFO:teuthology.orchestra.run.smithi018.stdout:1344 writesame 0xc2b75d0 thru 0xc2bad75 data_size 0x11(0x37a6 bytes) 2024-09-22T01:35:22.973 INFO:teuthology.orchestra.run.smithi018.stdout:1347 read 0x6f585d8 thru 0x6f627d0 (0xa1f9 bytes) 2024-09-22T01:35:22.974 INFO:teuthology.orchestra.run.smithi018.stdout:1348 write 0x81f30c6 thru 0x81fc8b0 (0x97eb bytes) 2024-09-22T01:35:22.974 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:22.970+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:22.996 INFO:teuthology.orchestra.run.smithi018.stdout:1349 trunc from 0xe9c6f8f to 0x456912f 2024-09-22T01:35:23.015 INFO:teuthology.orchestra.run.smithi018.stderr:no valid command found; 10 closest matches: 2024-09-22T01:35:23.015 INFO:teuthology.orchestra.run.smithi018.stderr:0 2024-09-22T01:35:23.015 INFO:teuthology.orchestra.run.smithi018.stderr:1 2024-09-22T01:35:23.015 INFO:teuthology.orchestra.run.smithi018.stderr:2 2024-09-22T01:35:23.015 INFO:teuthology.orchestra.run.smithi018.stderr:abort 2024-09-22T01:35:23.015 INFO:teuthology.orchestra.run.smithi018.stderr:assert 2024-09-22T01:35:23.015 INFO:teuthology.orchestra.run.smithi018.stderr:bench [] [] [] [] 2024-09-22T01:35:23.016 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs debug_inject_read_zeros 2024-09-22T01:35:23.016 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs files list 2024-09-22T01:35:23.016 INFO:teuthology.orchestra.run.smithi018.stderr:bluefs stats 2024-09-22T01:35:23.016 INFO:teuthology.orchestra.run.smithi018.stderr:bluestore allocator dump block 2024-09-22T01:35:23.016 INFO:teuthology.orchestra.run.smithi018.stderr:Error EINVAL: invalid command 2024-09-22T01:35:23.018 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T01:35:23.018 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T01:35:23.036 INFO:teuthology.orchestra.run.smithi018.stdout:1350 read 0x2af8946 thru 0x2b04499 (0xbb54 bytes) 2024-09-22T01:35:23.048 INFO:teuthology.orchestra.run.smithi018.stdout:1351 trunc from 0x456912f to 0xea9b5b0 2024-09-22T01:35:23.060 INFO:teuthology.orchestra.run.smithi018.stdout:1352 read 0x748bb3c thru 0x74968de (0xada3 bytes) 2024-09-22T01:35:23.060 INFO:teuthology.orchestra.run.smithi018.stdout:1353 write 0x2296b82 thru 0x22a3145 (0xc5c4 bytes) 2024-09-22T01:35:23.064 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.064 INFO:teuthology.orchestra.run.smithi018.stdout:1356 write 0xcf08ae6 thru 0xcf0aada (0x1ff5 bytes) 2024-09-22T01:35:23.071 INFO:teuthology.orchestra.run.smithi018.stdout:1357 write 0xd3a0376 thru 0xd3a1eeb (0x1b76 bytes) 2024-09-22T01:35:23.075 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:23.070+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:23.088 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:23.088 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.088382228, 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.758732575, 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.093 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:23.098 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.758589069999999, 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:23.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:35:23.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:35:23.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.103 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.983269797999998, 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.104 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:35:23.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:35:23.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:35:23.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.982204103000001, 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.109 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:35:23.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:35:23.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:35:23.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:35:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:35:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:35:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:35:23.114 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.674171612999999, 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.115 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:23.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:35:23.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:35:23.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 17.673797318999998, 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:23.121 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:23.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:35:23.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:35:23.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54465 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2659374710000009, 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050651180000000004, 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54465 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821068+0000", 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821078+0000", 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0164e-05 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821107+0000", 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8985000000000001e-05 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821121+0000", 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.307e-05 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821387+0000", 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026639200000000001 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821395+0000", 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3040000000000005e-06 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825493+0000", 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040977399999999999 2024-09-22T01:35:23.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825630+0000", 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136971 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826131+0000", 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050110499999999995 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.131 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54466 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2658509420000001, 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052214690000000003, 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54466 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821153+0000", 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7499999999999999e-07 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821158+0000", 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3800000000000004e-06 2024-09-22T01:35:23.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821169+0000", 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1124000000000001e-05 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821177+0000", 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1040000000000007e-06 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821467+0000", 2024-09-22T01:35:23.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029025299999999997 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821474+0000", 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826170+0000", 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046964709999999998 2024-09-22T01:35:23.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826261+0000", 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0708e-05 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826374+0000", 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113182 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54467 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2658146109999997, 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054437169999999998, 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54467 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1900000000000002e-07 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821193+0000", 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4130000000000002e-06 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821202+0000", 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821209+0000", 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8800000000000002e-06 2024-09-22T01:35:23.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821504+0000", 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029444600000000002 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821509+0000", 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5500000000000002e-06 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826415+0000", 2024-09-22T01:35:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004905492 2024-09-22T01:35:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826527+0000", 2024-09-22T01:35:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112144 2024-09-22T01:35:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.142 INFO:teuthology.orchestra.run.smithi018.stdout:1359 trunc from 0xea9b5b0 to 0x60161d2 2024-09-22T01:35:23.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826633+0000", 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105795 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54510 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2657846789999994, 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057311339999999997, 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.143 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54510 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821245+0000", 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5774000000000001e-05 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821257+0000", 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2045000000000001e-05 2024-09-22T01:35:23.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821265+0000", 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821538+0000", 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027359599999999997 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821544+0000", 2024-09-22T01:35:23.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7450000000000001e-06 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826699+0000", 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051546229999999997 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826815+0000", 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011646600000000001 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826950+0000", 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013463700000000001 2024-09-22T01:35:23.147 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54511 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2657262070000002, 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058910409999999996, 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54511 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821278+0000", 2024-09-22T01:35:23.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821282+0000", 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821291+0000", 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3039999999999994e-06 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821298+0000", 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.041e-06 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821573+0000", 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000274283 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821578+0000", 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0679999999999996e-06 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827015+0000", 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054370670000000003 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827070+0000", 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5773999999999998e-05 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827168+0000", 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7814999999999998e-05 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54512 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2656953049999995, 2024-09-22T01:35:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061320309999999996, 2024-09-22T01:35:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.153 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54512 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821309+0000", 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.51e-07 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821312+0000", 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0419999999999998e-06 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821320+0000", 2024-09-22T01:35:23.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.422e-06 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821332+0000", 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1951e-05 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821937+0000", 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060522400000000002 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821944+0000", 2024-09-22T01:35:23.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.404e-06 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827219+0000", 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052754389999999998 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827317+0000", 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7536999999999998e-05 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827440+0000", 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123461 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54555 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2652262749999998, 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059477050000000002, 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54555 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821778+0000", 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0500000000000002e-07 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821783+0000", 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.135e-06 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821798+0000", 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4688000000000001e-05 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821808+0000", 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6690000000000001e-06 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821977+0000", 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169541 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821982+0000", 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-06 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827481+0000", 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054988470000000003 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827582+0000", 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100554 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827725+0000", 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014320199999999999 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.162 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54556 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2651794550000002, 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00620654, 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54556 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.163 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821825+0000", 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821828+0000", 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8809999999999998e-06 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821839+0000", 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.027e-05 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821846+0000", 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822011+0000", 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822017+0000", 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6099999999999997e-06 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827802+0000", 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057848509999999997 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827892+0000", 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0880999999999999e-05 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828030+0000", 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013803200000000001 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54557 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2651451619999996, 2024-09-22T01:35:23.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064190469999999998, 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54557 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821859+0000", 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.99e-07 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821863+0000", 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6569999999999999e-06 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821871+0000", 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9719999999999998e-06 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821878+0000", 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.917e-06 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822045+0000", 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016703000000000001 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822051+0000", 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.626e-06 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828069+0000", 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060179919999999998 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828161+0000", 2024-09-22T01:35:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1731999999999995e-05 2024-09-22T01:35:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828277+0000", 2024-09-22T01:35:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011652199999999999 2024-09-22T01:35:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.173 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54600 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2647095890000006, 2024-09-22T01:35:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062310530000000003, 2024-09-22T01:35:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.174 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54600 2024-09-22T01:35:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:23.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822295+0000", 2024-09-22T01:35:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.19e-06 2024-09-22T01:35:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822301+0000", 2024-09-22T01:35:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5010000000000004e-06 2024-09-22T01:35:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822320+0000", 2024-09-22T01:35:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9724e-05 2024-09-22T01:35:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822330+0000", 2024-09-22T01:35:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3899999999999999e-06 2024-09-22T01:35:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822464+0000", 2024-09-22T01:35:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013444100000000001 2024-09-22T01:35:23.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822470+0000", 2024-09-22T01:35:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3690000000000003e-06 2024-09-22T01:35:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828314+0000", 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058434719999999997 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828405+0000", 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1166000000000001e-05 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828525+0000", 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001198 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54601 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2646519709999993, 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064068470000000002, 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54601 2024-09-22T01:35:23.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822352+0000", 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822356+0000", 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6519999999999999e-06 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822366+0000", 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0686000000000001e-05 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822374+0000", 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4200000000000001e-06 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822500+0000", 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012665800000000001 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822505+0000", 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.938e-06 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828560+0000", 2024-09-22T01:35:23.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060544969999999998 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828651+0000", 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0758000000000001e-05 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828758+0000", 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010760900000000001 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54602 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2646175789999994, 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066069279999999998, 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54602 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.187 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6599999999999996e-07 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822390+0000", 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.377e-06 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822399+0000", 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822406+0000", 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822534+0000", 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012761900000000001 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822539+0000", 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3639999999999998e-06 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828797+0000", 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006257365 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828885+0000", 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8818000000000002e-05 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828993+0000", 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107336 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.191 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54688 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 8.2607366940000002, 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044478340000000003, 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54688 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826268+0000", 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-06 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826274+0000", 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826294+0000", 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0211999999999999e-05 2024-09-22T01:35:23.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826310+0000", 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6039999999999999e-05 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830569+0000", 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004258632 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830641+0000", 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2064000000000007e-05 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830715+0000", 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3483000000000001e-05 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.196 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:23.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:23.198 INFO:teuthology.orchestra.run.smithi018.stdout:1360 read 0x21ffa8 thru 0x220ddf (0xe38 bytes) 2024-09-22T01:35:23.198 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.198 INFO:teuthology.orchestra.run.smithi018.stdout:1363 trunc from 0x60161d2 to 0xac62a1 2024-09-22T01:35:23.198 INFO:teuthology.orchestra.run.smithi018.stdout:1364 write 0xb5b6ac2 thru 0xb5c271a (0xbc59 bytes) 2024-09-22T01:35:23.199 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:23.194+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:23.205 INFO:teuthology.orchestra.run.smithi018.stdout:1365 read 0x43811f1 thru 0x4386738 (0x5548 bytes) 2024-09-22T01:35:23.205 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.226 INFO:teuthology.orchestra.run.smithi018.stdout:1367 trunc from 0xb5c271b to 0x1be594f 2024-09-22T01:35:23.252 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.295 INFO:teuthology.orchestra.run.smithi018.stdout:1370 writesame 0xe102882 thru 0xe102e67 data_size 0x5(0x5e6 bytes) 2024-09-22T01:35:23.295 INFO:teuthology.orchestra.run.smithi018.stdout:1372 read 0x93ccce9 thru 0x93d5b05 (0x8e1d bytes) 2024-09-22T01:35:23.295 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.296 INFO:teuthology.orchestra.run.smithi018.stdout:1374 write 0xc357cc thru 0xc35eea (0x71f bytes) 2024-09-22T01:35:23.300 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:23.297+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:23.303 INFO:teuthology.orchestra.run.smithi018.stdout:1376 write 0x220357a thru 0x220ef40 (0xb9c7 bytes) 2024-09-22T01:35:23.307 INFO:teuthology.orchestra.run.smithi018.stdout:1377 write 0x84c5764 thru 0x84d488e (0xf12b bytes) 2024-09-22T01:35:23.316 INFO:teuthology.orchestra.run.smithi018.stdout:1378 trunc from 0xe102e68 to 0xda1318e 2024-09-22T01:35:23.330 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:23.331 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:23.344 INFO:teuthology.orchestra.run.smithi018.stdout:1379 write 0xe68fe6a thru 0xe692f75 (0x310c bytes) 2024-09-22T01:35:23.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:23.377 INFO:teuthology.orchestra.run.smithi018.stdout:1380 trunc from 0xe692f76 to 0x35f270b 2024-09-22T01:35:23.401 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:23.397+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:23.420 INFO:teuthology.orchestra.run.smithi018.stdout:1381 write 0x5d3b068 thru 0x5d46aae (0xba47 bytes) 2024-09-22T01:35:23.425 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.426 INFO:teuthology.orchestra.run.smithi018.stdout:1384 write 0x1d9433e thru 0x1d95562 (0x1225 bytes) 2024-09-22T01:35:23.431 INFO:teuthology.orchestra.run.smithi018.stdout:1385 write 0x1c58060 thru 0x1c66c6a (0xec0b bytes) 2024-09-22T01:35:23.463 INFO:teuthology.orchestra.run.smithi018.stdout:1386 write 0xd0a0219 thru 0xd0a33c9 (0x31b1 bytes) 2024-09-22T01:35:23.469 INFO:teuthology.orchestra.run.smithi018.stdout:1388 punch from 0xbded174 to 0xbdf53d5, (0x8261 bytes) 2024-09-22T01:35:23.469 INFO:teuthology.orchestra.run.smithi018.stdout:1390 read 0x523788 thru 0x523a0e (0x287 bytes) 2024-09-22T01:35:23.469 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.469 INFO:teuthology.orchestra.run.smithi018.stdout:1392 punch from 0x2f52cd to 0x2f609d, (0xdd0 bytes) 2024-09-22T01:35:23.469 INFO:teuthology.orchestra.run.smithi018.stdout:1394 writesame 0x309d7d0 thru 0x30aaecb data_size 0x2(0xd6fc bytes) 2024-09-22T01:35:23.502 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:23.501+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:23.506 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:23.507 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:23.507 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:23.512 INFO:teuthology.orchestra.run.smithi018.stdout:1395 punch from 0xb057528 to 0xb060a55, (0x952d bytes) 2024-09-22T01:35:23.512 INFO:teuthology.orchestra.run.smithi018.stdout:1396 write 0x6caf22a thru 0x6cb448b (0x5262 bytes) 2024-09-22T01:35:23.519 INFO:teuthology.orchestra.run.smithi018.stdout:1398 read 0x3a60466 thru 0x3a6dedb (0xda76 bytes) 2024-09-22T01:35:23.520 INFO:teuthology.orchestra.run.smithi018.stdout:1401 write 0x435b4ec thru 0x4368028 (0xcb3d bytes) 2024-09-22T01:35:23.521 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:23.526 INFO:teuthology.orchestra.run.smithi018.stdout:1402 punch from 0xd060874 to 0xd06c409, (0xbb95 bytes) 2024-09-22T01:35:23.526 INFO:teuthology.orchestra.run.smithi018.stdout:1403 read 0x6bb545a thru 0x6bbcb33 (0x76da bytes) 2024-09-22T01:35:23.526 INFO:teuthology.orchestra.run.smithi018.stdout:1405 write 0x38efbcd thru 0x38faab6 (0xaeea bytes) 2024-09-22T01:35:23.534 INFO:teuthology.orchestra.run.smithi018.stdout:1406 write 0x7a03811 thru 0x7a088d2 (0x50c2 bytes) 2024-09-22T01:35:23.540 INFO:teuthology.orchestra.run.smithi018.stdout:1409 writesame 0x7c71434 thru 0x7c74129 data_size 0x5(0x2cf6 bytes) 2024-09-22T01:35:23.543 INFO:teuthology.orchestra.run.smithi018.stdout:1410 trunc from 0xd0a33ca to 0xda16d36 2024-09-22T01:35:23.556 INFO:teuthology.orchestra.run.smithi018.stdout:1411 punch from 0x713922f to 0x7148349, (0xf11a bytes) 2024-09-22T01:35:23.556 INFO:teuthology.orchestra.run.smithi018.stdout:1413 read 0xa5e96f thru 0xa6064d (0x1cdf bytes) 2024-09-22T01:35:23.556 INFO:teuthology.orchestra.run.smithi018.stdout:1416 writesame 0x98aa897 thru 0x98b0b1e data_size 0xc(0x6288 bytes) 2024-09-22T01:35:23.564 INFO:teuthology.orchestra.run.smithi018.stdout:1420 write 0x72d0b90 thru 0x72d2ae3 (0x1f54 bytes) 2024-09-22T01:35:23.571 INFO:teuthology.orchestra.run.smithi018.stdout:1421 punch from 0x4f3b544 to 0x4f42851, (0x730d bytes) 2024-09-22T01:35:23.571 INFO:teuthology.orchestra.run.smithi018.stdout:1423 writesame 0xd5eebc7 thru 0xd5fdaef data_size 0x4f(0xef29 bytes) 2024-09-22T01:35:23.579 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.579 INFO:teuthology.orchestra.run.smithi018.stdout:1425 writesame 0x5b3c349 thru 0x5b412d6 data_size 0x11(0x4f8e bytes) 2024-09-22T01:35:23.584 INFO:teuthology.orchestra.run.smithi018.stdout:1426 trunc from 0xda16d36 to 0xc4c7ca2 2024-09-22T01:35:23.602 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:23.598+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:23.610 INFO:teuthology.orchestra.run.smithi018.stdout:1427 write 0x5102ffa thru 0x5107f70 (0x4f77 bytes) 2024-09-22T01:35:23.611 INFO:teuthology.orchestra.run.smithi018.stdout:1428 punch from 0xc1f3f4c to 0xc201619, (0xd6cd bytes) 2024-09-22T01:35:23.612 INFO:teuthology.orchestra.run.smithi018.stdout:1429 trunc from 0xc4c7ca2 to 0xcb33c25 2024-09-22T01:35:23.640 INFO:teuthology.orchestra.run.smithi018.stdout:1431 writesame 0xe3cb6e9 thru 0xe3db2c2 data_size 0x1(0xfbda bytes) 2024-09-22T01:35:23.640 INFO:teuthology.orchestra.run.smithi018.stdout:1432 read 0x3fe4c48 thru 0x3fee04b (0x9404 bytes) 2024-09-22T01:35:23.641 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:23.641 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512851591, 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:35:23.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:35:23.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.645 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512825854999999, 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.649 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512800073000001, 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:35:23.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:35:23.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512755154000001, 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512722998000001, 2024-09-22T01:35:23.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:23.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:35:23.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:35:23.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512695266000001, 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:35:23.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512659442, 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.668 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512623298000001, 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:35:23.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:35:23.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512587093, 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:35:23.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.676 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512559741, 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:23.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512522662999999, 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:35:23.680 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512499126000002, 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:23.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:35:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:35:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:35:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:35:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:35:23.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:35:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:35:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:35:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:35:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:35:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:35:23.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:35:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12683 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.512009126999999, 2024-09-22T01:35:23.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058771337, 2024-09-22T01:35:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12683 2024-09-22T01:35:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:23.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126558+0000", 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6399999999999998e-07 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126559+0000", 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8360000000000001e-06 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126567+0000", 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4189999999999996e-06 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126578+0000", 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1439e-05 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185320+0000", 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058741987000000002 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185329+0000", 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2919999999999996e-06 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.511951925999998, 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.511924169, 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:35:23.700 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:35:23.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.511902103000001, 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:35:23.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:35:23.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.511871942999999, 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:35:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:35:23.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.711 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.511451452999999, 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.712 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:35:23.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:35:23.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.511425672000001, 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:35:23.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:35:23.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 18.511404404, 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:35:23.719 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:23.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:23.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:35:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:35:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:23.723 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:23.723 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:23.724 INFO:teuthology.orchestra.run.smithi018.stdout:1434 read 0x649b0a8 thru 0x64a6d0c (0xbc65 bytes) 2024-09-22T01:35:23.724 INFO:teuthology.orchestra.run.smithi018.stdout:1435 read 0x85e2b97 thru 0x85f1d47 (0xf1b1 bytes) 2024-09-22T01:35:23.724 INFO:teuthology.orchestra.run.smithi018.stdout:1436 write 0x1051d93 thru 0x105616c (0x43da bytes) 2024-09-22T01:35:23.724 INFO:teuthology.orchestra.run.smithi018.stdout:1437 punch from 0xeb1e1d to 0xeb4a9d, (0x2c80 bytes) 2024-09-22T01:35:23.724 INFO:teuthology.orchestra.run.smithi018.stdout:1438 write 0x1229d27 thru 0x122b645 (0x191f bytes) 2024-09-22T01:35:23.724 INFO:teuthology.orchestra.run.smithi018.stdout:1440 write 0x8aafd4 thru 0x8accb6 (0x1ce3 bytes) 2024-09-22T01:35:23.724 INFO:teuthology.orchestra.run.smithi018.stdout:1442 write 0x2885caf thru 0x288671f (0xa71 bytes) 2024-09-22T01:35:23.724 INFO:teuthology.orchestra.run.smithi018.stdout:1443 write 0x263f847 thru 0x2646e08 (0x75c2 bytes) 2024-09-22T01:35:23.725 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:23.727 INFO:teuthology.orchestra.run.smithi018.stdout:1445 read 0x681d0fa thru 0x68202d7 (0x31de bytes) 2024-09-22T01:35:23.727 INFO:teuthology.orchestra.run.smithi018.stdout:1446 writesame 0x732897d thru 0x7332fa1 data_size 0x1(0xa625 bytes) 2024-09-22T01:35:23.727 INFO:teuthology.orchestra.run.smithi018.stdout:1447 trunc from 0xe3db2c3 to 0xe472040 2024-09-22T01:35:23.727 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.727 INFO:teuthology.orchestra.run.smithi018.stdout:1449 write 0x7a164e2 thru 0x7a25373 (0xee92 bytes) 2024-09-22T01:35:23.727 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.727 INFO:teuthology.orchestra.run.smithi018.stdout:1453 read 0xdf7f56 thru 0xdfb27f (0x332a bytes) 2024-09-22T01:35:23.727 INFO:teuthology.orchestra.run.smithi018.stdout:1454 read 0x56e4484 thru 0x56e486e (0x3eb bytes) 2024-09-22T01:35:23.727 INFO:teuthology.orchestra.run.smithi018.stdout:1455 write 0x16713d8 thru 0x1679bf3 (0x881c bytes) 2024-09-22T01:35:23.727 INFO:teuthology.orchestra.run.smithi018.stdout:1456 read 0x4a16322 thru 0x4a2619c (0xfe7b bytes) 2024-09-22T01:35:23.728 INFO:teuthology.orchestra.run.smithi018.stdout:1458 write 0x90242ef thru 0x902cb70 (0x8882 bytes) 2024-09-22T01:35:23.735 INFO:teuthology.orchestra.run.smithi018.stdout:1459 trunc from 0xe472040 to 0xb569e27 2024-09-22T01:35:23.736 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:23.734+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:23.752 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:35:23.769 INFO:teuthology.orchestra.run.smithi018.stdout:1460 trunc from 0xb569e27 to 0x6b1d35 2024-09-22T01:35:23.813 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.813 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.813 INFO:teuthology.orchestra.run.smithi018.stdout:1463 read 0x19b5c thru 0x23227 (0x96cc bytes) 2024-09-22T01:35:23.814 INFO:teuthology.orchestra.run.smithi018.stdout:1465 punch from 0x53c77f to 0x545738, (0x8fb9 bytes) 2024-09-22T01:35:23.828 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:23.825+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:23.839 INFO:teuthology.orchestra.run.smithi018.stdout:1467 trunc from 0x6b1d35 to 0xebadc24 2024-09-22T01:35:23.850 INFO:teuthology.orchestra.run.smithi018.stdout:1469 read 0xde55f4d thru 0xde62b68 (0xcc1c bytes) 2024-09-22T01:35:23.850 INFO:teuthology.orchestra.run.smithi018.stdout:1470 read 0xcfc90be thru 0xcfd005f (0x6fa2 bytes) 2024-09-22T01:35:23.850 INFO:teuthology.orchestra.run.smithi018.stdout:1471 read 0xe97460 thru 0xe9c233 (0x4dd4 bytes) 2024-09-22T01:35:23.850 INFO:teuthology.orchestra.run.smithi018.stdout:1473 read 0x815cbee thru 0x8162931 (0x5d44 bytes) 2024-09-22T01:35:23.850 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.850 INFO:teuthology.orchestra.run.smithi018.stdout:1476 read 0xe6a7401 thru 0xe6aa50f (0x310f bytes) 2024-09-22T01:35:23.850 INFO:teuthology.orchestra.run.smithi018.stdout:1477 read 0x7c103a2 thru 0x7c19047 (0x8ca6 bytes) 2024-09-22T01:35:23.853 INFO:teuthology.orchestra.run.smithi018.stdout:1478 trunc from 0xebadc24 to 0xd319b11 2024-09-22T01:35:23.869 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:23.869 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:23.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:23.870 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop(client.4367.0:59306 3.f e49/22 3:f4668406:::rbd_object_map.110f9cb308d1:head v 49'177, mlcod=49'175)", 2024-09-22T01:35:23.870 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:23.869778+0000", 2024-09-22T01:35:23.870 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00024572999999999999, 2024-09-22T01:35:23.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028468500000000002, 2024-09-22T01:35:23.870 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:23.871 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:23.871 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:23.871 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:23.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:23.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:23.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:23.869778+0000", 2024-09-22T01:35:23.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:23.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:23.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:23.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:23.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:23.869778+0000", 2024-09-22T01:35:23.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:23.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:23.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:23.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:23.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:23.869780+0000", 2024-09-22T01:35:23.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6300000000000001e-06 2024-09-22T01:35:23.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:23.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:23.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:23.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:23.869801+0000", 2024-09-22T01:35:23.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1166e-05 2024-09-22T01:35:23.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:23.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:23.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:23.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:23.869830+0000", 2024-09-22T01:35:23.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8532000000000001e-05 2024-09-22T01:35:23.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:23.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:23.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:23.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:23.869848+0000", 2024-09-22T01:35:23.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7842999999999998e-05 2024-09-22T01:35:23.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:23.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:23.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:23.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:23.869912+0000", 2024-09-22T01:35:23.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4706e-05 2024-09-22T01:35:23.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:23.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:23.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:23.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:23.869925+0000", 2024-09-22T01:35:23.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2422999999999999e-05 2024-09-22T01:35:23.876 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:23.876 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:23.876 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:23.876 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:23.877 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:35:23.877 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 1 2024-09-22T01:35:23.877 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:23.879 INFO:teuthology.orchestra.run.smithi018.stdout:1479 write 0xed08b92 thru 0xed11902 (0x8d71 bytes) 2024-09-22T01:35:23.886 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:23.887 INFO:teuthology.orchestra.run.smithi018.stdout:1480 read 0xac9da47 thru 0xaca746e (0x9a28 bytes) 2024-09-22T01:35:23.889 INFO:teuthology.orchestra.run.smithi018.stdout:1481 writesame 0xb170595 thru 0xb173303 data_size 0x1(0x2d6f bytes) 2024-09-22T01:35:23.903 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:23.924 INFO:teuthology.orchestra.run.smithi018.stdout:1483 trunc from 0xed11903 to 0x601d887 2024-09-22T01:35:23.929 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:23.926+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:23.945 INFO:teuthology.orchestra.run.smithi018.stdout:1485 read 0x458cc6e thru 0x458f29a (0x262d bytes) 2024-09-22T01:35:23.945 INFO:teuthology.orchestra.run.smithi018.stdout:1488 writesame 0x494cb8c thru 0x495b98b data_size 0x88(0xee00 bytes) 2024-09-22T01:35:23.974 INFO:teuthology.orchestra.run.smithi018.stdout:1490 write 0xbb69441 thru 0xbb6cf69 (0x3b29 bytes) 2024-09-22T01:35:23.980 INFO:teuthology.orchestra.run.smithi018.stdout:1491 read 0xb4e0422 thru 0xb4e7987 (0x7566 bytes) 2024-09-22T01:35:23.997 INFO:teuthology.orchestra.run.smithi018.stdout:1492 write 0xe9f953d thru 0xe9fd678 (0x413c bytes) 2024-09-22T01:35:24.003 INFO:teuthology.orchestra.run.smithi018.stdout:1493 writesame 0x646391a thru 0x64730ce data_size 0x1(0xf7b5 bytes) 2024-09-22T01:35:24.030 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:24.026+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:24.045 INFO:teuthology.orchestra.run.smithi018.stdout:1494 read 0x8053d55 thru 0x80619bc (0xdc68 bytes) 2024-09-22T01:35:24.045 INFO:teuthology.orchestra.run.smithi018.stdout:1496 write 0x11ed738 thru 0x11fc743 (0xf00c bytes) 2024-09-22T01:35:24.052 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.052 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.053 INFO:teuthology.orchestra.run.smithi018.stdout:1499 write 0xc32612b thru 0xc3293fa (0x32d0 bytes) 2024-09-22T01:35:24.059 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.059 INFO:teuthology.orchestra.run.smithi018.stdout:1501 read 0x364c15f thru 0x3653885 (0x7727 bytes) 2024-09-22T01:35:24.059 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.059 INFO:teuthology.orchestra.run.smithi018.stdout:1503 writesame 0x2f9d3ff thru 0x2f9e004 data_size 0x9(0xc06 bytes) 2024-09-22T01:35:24.062 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:24.062 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:24.063 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:24.063 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:24.063 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:24.065 INFO:teuthology.orchestra.run.smithi018.stdout:1504 write 0x4333371 thru 0x433fb1a (0xc7aa bytes) 2024-09-22T01:35:24.072 INFO:teuthology.orchestra.run.smithi018.stdout:1505 writesame 0x754bead thru 0x7553496 data_size 0x1(0x75ea bytes) 2024-09-22T01:35:24.078 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:24.101 INFO:teuthology.orchestra.run.smithi018.stdout:1506 read 0x87ca549 thru 0x87d79c5 (0xd47d bytes) 2024-09-22T01:35:24.101 INFO:teuthology.orchestra.run.smithi018.stdout:1507 write 0x81bf95a thru 0x81ce130 (0xe7d7 bytes) 2024-09-22T01:35:24.106 INFO:teuthology.orchestra.run.smithi018.stdout:1508 punch from 0x153bb74 to 0x1545c34, (0xa0c0 bytes) 2024-09-22T01:35:24.106 INFO:teuthology.orchestra.run.smithi018.stdout:1511 writesame 0xaeeb744 thru 0xaef7607 data_size 0x1d(0xbec4 bytes) 2024-09-22T01:35:24.110 INFO:teuthology.orchestra.run.smithi018.stdout:1512 write 0xd753060 thru 0xd75d9c1 (0xa962 bytes) 2024-09-22T01:35:24.116 INFO:teuthology.orchestra.run.smithi018.stdout:1515 read 0x7cd935 thru 0x7dacd6 (0xd3a2 bytes) 2024-09-22T01:35:24.116 INFO:teuthology.orchestra.run.smithi018.stdout:1516 writesame 0x1999579 thru 0x199c99b data_size 0x3(0x3423 bytes) 2024-09-22T01:35:24.126 INFO:teuthology.orchestra.run.smithi018.stdout:1517 read 0x57e7d39 thru 0x57e81b5 (0x47d bytes) 2024-09-22T01:35:24.127 INFO:teuthology.orchestra.run.smithi018.stdout:1518 punch from 0x936ec2b to 0x937e30a, (0xf6df bytes) 2024-09-22T01:35:24.127 INFO:teuthology.orchestra.run.smithi018.stdout:1521 punch from 0x8fb8a5f to 0x8fc74d7, (0xea78 bytes) 2024-09-22T01:35:24.127 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.127 INFO:teuthology.orchestra.run.smithi018.stdout:1523 read 0x4adab6a thru 0x4ae3d52 (0x91e9 bytes) 2024-09-22T01:35:24.128 INFO:teuthology.orchestra.run.smithi018.stdout:1525 read 0x6d64aed thru 0x6d6f253 (0xa767 bytes) 2024-09-22T01:35:24.128 INFO:teuthology.orchestra.run.smithi018.stdout:1526 writesame 0x1b4a678 thru 0x1b53948 data_size 0x1(0x92d1 bytes) 2024-09-22T01:35:24.130 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:24.126+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:24.178 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.179 INFO:teuthology.orchestra.run.smithi018.stdout:1528 read 0xe3cf6ec thru 0xe3dec83 (0xf598 bytes) 2024-09-22T01:35:24.192 INFO:teuthology.orchestra.run.smithi018.stdout:1529 trunc from 0xe9fd679 to 0x9df1b75 2024-09-22T01:35:24.204 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19458 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1417216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.745551255999999, 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.056428816, 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.205 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19458 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7700000000000005e-07 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457940+0000", 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4329999999999998e-06 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457947+0000", 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9029999999999998e-06 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457953+0000", 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8900000000000004e-06 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512121+0000", 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054168717999999998 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512221+0000", 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9279999999999998e-05 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514366+0000", 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002145115 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19462 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1775616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458239+0000", 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.745249049999998, 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054903667000000003, 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.209 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19462 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458239+0000", 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458239+0000", 2024-09-22T01:35:24.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458240+0000", 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.32e-07 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458242+0000", 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6369999999999999e-06 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458249+0000", 2024-09-22T01:35:24.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5050000000000004e-06 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458255+0000", 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9710000000000001e-06 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512972+0000", 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054717215999999999 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513054+0000", 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2365000000000002e-05 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513143+0000", 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8541000000000005e-05 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19463 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1959936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458341+0000", 2024-09-22T01:35:24.213 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.745147631000002, 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054996745999999999, 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19463 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458341+0000", 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.214 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458341+0000", 2024-09-22T01:35:24.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458341+0000", 2024-09-22T01:35:24.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.3499999999999995e-07 2024-09-22T01:35:24.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458345+0000", 2024-09-22T01:35:24.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4989999999999999e-06 2024-09-22T01:35:24.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.217 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.217 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458360+0000", 2024-09-22T01:35:24.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4963999999999999e-05 2024-09-22T01:35:24.217 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.217 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.217 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.217 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458372+0000", 2024-09-22T01:35:24.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2235999999999999e-05 2024-09-22T01:35:24.218 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.218 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.218 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.218 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513169+0000", 2024-09-22T01:35:24.218 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054796563999999999 2024-09-22T01:35:24.218 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.218 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.218 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.219 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513251+0000", 2024-09-22T01:35:24.219 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2099000000000001e-05 2024-09-22T01:35:24.219 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.219 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.219 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.219 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513337+0000", 2024-09-22T01:35:24.219 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6649000000000003e-05 2024-09-22T01:35:24.219 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.219 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.220 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.220 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.220 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.220 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19464 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1949696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.220 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:35:24.220 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.745040033999999, 2024-09-22T01:35:24.220 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055080249999999997, 2024-09-22T01:35:24.221 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.221 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.221 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.221 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.221 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.221 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.221 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19464 2024-09-22T01:35:24.222 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.222 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.222 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.222 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.222 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:35:24.222 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.222 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.223 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.223 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.223 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:35:24.223 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.223 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.223 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.223 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.223 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459822+0000", 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013738540000000001 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459827+0000", 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1630000000000004e-06 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459840+0000", 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2775000000000001e-05 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459847+0000", 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8360000000000003e-06 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513362+0000", 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053515442000000003 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513441+0000", 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8708000000000006e-05 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513528+0000", 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7472000000000005e-05 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19484 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1437696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.743498639999999, 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055077586999999997, 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.226 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19484 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.227 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7e-07 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.228 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459993+0000", 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8380000000000002e-06 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460000+0000", 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460005+0000", 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3680000000000001e-06 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514879+0000", 2024-09-22T01:35:24.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054874038999999999 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514965+0000", 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5574000000000004e-05 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515067+0000", 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010228100000000001 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.230 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19485 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1796096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.743475843999999, 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055255209, 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19485 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460300+0000", 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028730299999999998 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460304+0000", 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460314+0000", 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7119999999999995e-06 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460321+0000", 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6710000000000002e-06 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515101+0000", 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054780263000000003 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515180+0000", 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9074999999999998e-05 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515268+0000", 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7416999999999993e-05 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.234 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19486 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1970176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.743123961999999, 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055098253, 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19486 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.235 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460365+0000", 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9599999999999999e-07 2024-09-22T01:35:24.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460369+0000", 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460382+0000", 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3478999999999999e-05 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460390+0000", 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5340000000000002e-06 2024-09-22T01:35:24.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515297+0000", 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054907665000000001 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515373+0000", 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5721000000000002e-05 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515463+0000", 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9653000000000004e-05 2024-09-22T01:35:24.238 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19487 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1980416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.743075589, 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055238787999999997, 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.239 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19487 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:35:24.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460764+0000", 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035164799999999998 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460769+0000", 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.169e-06 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460779+0000", 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3239999999999992e-06 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460786+0000", 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0500000000000003e-06 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515497+0000", 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054711098 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.242 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515576+0000", 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9085999999999995e-05 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515651+0000", 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5413000000000005e-05 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19501 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1089536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.742668885000001, 2024-09-22T01:35:24.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055065846000000002, 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19501 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460820+0000", 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000005e-07 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460823+0000", 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9459999999999998e-06 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460831+0000", 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6839999999999996e-06 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460837+0000", 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9479999999999996e-06 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515696+0000", 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054859053999999997 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515783+0000", 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7705000000000001e-05 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515885+0000", 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101908 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19502 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1263616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:35:24.247 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.742642727, 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055304409999999998, 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19502 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461917+0000", 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0010713960000000001 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461923+0000", 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7030000000000003e-06 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461936+0000", 2024-09-22T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2903e-05 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461944+0000", 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4169999999999992e-06 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515939+0000", 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053995026000000002 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516037+0000", 2024-09-22T01:35:24.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8462999999999996e-05 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516150+0000", 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000112502 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19506 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1632256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462061+0000", 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.741427686000002, 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055013708000000001, 2024-09-22T01:35:24.252 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19506 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462061+0000", 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462061+0000", 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462061+0000", 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462064+0000", 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:35:24.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462072+0000", 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5040000000000002e-06 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462078+0000", 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2859999999999999e-06 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516962+0000", 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054884672000000002 2024-09-22T01:35:24.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517013+0000", 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0368999999999998e-05 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517074+0000", 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1612000000000006e-05 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.256 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19507 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1806336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.741403954999999, 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055141745999999998, 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19507 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.257 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462085+0000", 2024-09-22T01:35:24.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:35:24.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462087+0000", 2024-09-22T01:35:24.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.418e-06 2024-09-22T01:35:24.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462095+0000", 2024-09-22T01:35:24.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0460000000000006e-06 2024-09-22T01:35:24.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462101+0000", 2024-09-22T01:35:24.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1150000000000002e-06 2024-09-22T01:35:24.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517103+0000", 2024-09-22T01:35:24.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055002874 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517153+0000", 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9888000000000001e-05 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517226+0000", 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2775999999999996e-05 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19508 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1816576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.741381232999998, 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055377692999999999, 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19508 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462497+0000", 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038960900000000002 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462501+0000", 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2640000000000002e-06 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462513+0000", 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1643e-05 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462520+0000", 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.148e-06 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517286+0000", 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054766269999999999 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517378+0000", 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1853000000000003e-05 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517485+0000", 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106906 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19509 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1990656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.740950403999999, 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055183229, 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.266 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19509 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462541+0000", 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6460000000000002e-06 2024-09-22T01:35:24.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462550+0000", 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3440000000000007e-06 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462556+0000", 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5330000000000002e-06 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517517+0000", 2024-09-22T01:35:24.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054960822999999999 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517620+0000", 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010306600000000001 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517721+0000", 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010129299999999999 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19524 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1099776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.740923331000001, 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055394339000000001, 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19524 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462933+0000", 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00036762399999999999 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462937+0000", 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5580000000000002e-06 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462946+0000", 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3179999999999996e-06 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462953+0000", 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8560000000000001e-06 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517759+0000", 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054806133 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517856+0000", 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7048999999999999e-05 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517959+0000", 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010280099999999999 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.274 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19525 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1110016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.740520515, 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055216300000000003, 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19525 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.275 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463068+0000", 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100511 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463072+0000", 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.563e-06 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463081+0000", 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.816e-06 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463087+0000", 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5910000000000001e-06 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517994+0000", 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054906644999999997 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518084+0000", 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9806e-05 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518184+0000", 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100368 2024-09-22T01:35:24.278 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19526 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1284096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.740391867, 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.05530989, 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.279 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19526 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463491+0000", 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00039443699999999998 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463497+0000", 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463508+0000", 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1685000000000001e-05 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463517+0000", 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2479999999999996e-06 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518222+0000", 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054705548 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518317+0000", 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4660999999999994e-05 2024-09-22T01:35:24.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518406+0000", 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9580999999999995e-05 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19527 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1458176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.739913225999999, 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055079491000000001, 2024-09-22T01:35:24.283 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19527 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463576+0000", 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3099999999999997e-07 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463579+0000", 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5719999999999999e-06 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463589+0000", 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4020000000000008e-06 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463595+0000", 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1140000000000002e-06 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518459+0000", 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054863737000000003 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518543+0000", 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4690000000000004e-05 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518655+0000", 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111345 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19528 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1468416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.287 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.739882792, 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.059935753000000001, 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19528 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463794+0000", 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018894199999999999 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463798+0000", 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7000000000000002e-06 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463808+0000", 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0045e-05 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463814+0000", 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518732+0000", 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054917796999999997 2024-09-22T01:35:24.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518812+0000", 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9759999999999995e-05 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.523541+0000", 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0047297270000000004 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19529 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1642496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:24.291 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.739664434000002, 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055275522000000001, 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19529 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:24.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465588+0000", 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017641309999999999 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:24.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465593+0000", 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7350000000000004e-06 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465602+0000", 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.329e-06 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465608+0000", 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6779999999999997e-06 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:24.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518932+0000", 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053324085 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519006+0000", 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4072000000000005e-05 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519099+0000", 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3492000000000005e-05 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:24.295 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:24.296 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:24.297 INFO:teuthology.orchestra.run.smithi018.stdout:1530 writesame 0xc198df9 thru 0xc1a7119 data_size 0x1d(0xe321 bytes) 2024-09-22T01:35:24.297 INFO:teuthology.orchestra.run.smithi018.stdout:1531 trunc from 0xc1a711a to 0x1f02c8b 2024-09-22T01:35:24.297 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:24.298 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:24.294+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:24.304 INFO:teuthology.orchestra.run.smithi018.stdout:1532 write 0x25c3c71 thru 0x25cfbc6 (0xbf56 bytes) 2024-09-22T01:35:24.330 INFO:teuthology.orchestra.run.smithi018.stdout:1533 trunc from 0x25cfbc7 to 0xa860600 2024-09-22T01:35:24.340 INFO:teuthology.orchestra.run.smithi018.stdout:1534 writesame 0xdd4edb thru 0xddc854 data_size 0x49(0x797a bytes) 2024-09-22T01:35:24.343 INFO:teuthology.orchestra.run.smithi018.stdout:1535 read 0x9a89b67 thru 0x9a8b2d9 (0x1773 bytes) 2024-09-22T01:35:24.343 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.343 INFO:teuthology.orchestra.run.smithi018.stdout:1541 read 0x8fc874 thru 0x90164e (0x4ddb bytes) 2024-09-22T01:35:24.344 INFO:teuthology.orchestra.run.smithi018.stdout:1542 read 0x2e9f0b6 thru 0x2ea140c (0x2357 bytes) 2024-09-22T01:35:24.344 INFO:teuthology.orchestra.run.smithi018.stdout:1545 write 0x102b337 thru 0x103b1ec (0xfeb6 bytes) 2024-09-22T01:35:24.348 INFO:teuthology.orchestra.run.smithi018.stdout:1549 write 0x9c9c7 thru 0xa621d (0x9857 bytes) 2024-09-22T01:35:24.351 INFO:teuthology.orchestra.run.smithi018.stdout:1550 punch from 0x5a2cd33 to 0x5a3cc87, (0xff54 bytes) 2024-09-22T01:35:24.365 INFO:teuthology.orchestra.run.smithi018.stdout:1551 write 0xc2c5cdf thru 0xc2cb27e (0x55a0 bytes) 2024-09-22T01:35:24.372 INFO:teuthology.orchestra.run.smithi018.stdout:1552 punch from 0x64c82c3 to 0x64c8b68, (0x8a5 bytes) 2024-09-22T01:35:24.372 INFO:teuthology.orchestra.run.smithi018.stdout:1553 read 0x70a25fc thru 0x70aa3fa (0x7dff bytes) 2024-09-22T01:35:24.372 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.372 INFO:teuthology.orchestra.run.smithi018.stdout:1555 read 0xbdeb130 thru 0xbdf4b21 (0x99f2 bytes) 2024-09-22T01:35:24.372 INFO:teuthology.orchestra.run.smithi018.stdout:1557 punch from 0x983b5ae to 0x984afc9, (0xfa1b bytes) 2024-09-22T01:35:24.372 INFO:teuthology.orchestra.run.smithi018.stdout:1559 read 0xf9a2f1 thru 0xfa1dd7 (0x7ae7 bytes) 2024-09-22T01:35:24.373 INFO:teuthology.orchestra.run.smithi018.stdout:1560 write 0xa91b8bb thru 0xa923fb2 (0x86f8 bytes) 2024-09-22T01:35:24.378 INFO:teuthology.orchestra.run.smithi018.stdout:1561 write 0x30aa7e0 thru 0x30b0077 (0x5898 bytes) 2024-09-22T01:35:24.382 INFO:teuthology.orchestra.run.smithi018.stdout:1562 punch from 0xaba8a87 to 0xabafc99, (0x7212 bytes) 2024-09-22T01:35:24.382 INFO:teuthology.orchestra.run.smithi018.stdout:1563 write 0x1977e26 thru 0x197c527 (0x4702 bytes) 2024-09-22T01:35:24.393 INFO:teuthology.orchestra.run.smithi018.stdout:1564 trunc from 0xc2cb27f to 0x912f716 2024-09-22T01:35:24.397 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:24.394+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:24.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:24.417 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.417 INFO:teuthology.orchestra.run.smithi018.stdout:1566 read 0x89d1752 thru 0x89d83de (0x6c8d bytes) 2024-09-22T01:35:24.418 INFO:teuthology.orchestra.run.smithi018.stdout:1567 read 0x3a6b837 thru 0x3a7674a (0xaf14 bytes) 2024-09-22T01:35:24.430 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:24.431 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:24.431 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:24.431 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:24.442 INFO:teuthology.orchestra.run.smithi018.stdout:1569 write 0xe77f119 thru 0xe7885ee (0x94d6 bytes) 2024-09-22T01:35:24.446 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:24.448 INFO:teuthology.orchestra.run.smithi018.stdout:1570 write 0xd01588f thru 0xd01db0e (0x8280 bytes) 2024-09-22T01:35:24.452 INFO:teuthology.orchestra.run.smithi018.stdout:1572 writesame 0x7a09f87 thru 0x7a17f24 data_size 0x5e(0xdf9e bytes) 2024-09-22T01:35:24.458 INFO:teuthology.orchestra.run.smithi018.stdout:1573 write 0xcd3c092 thru 0xcd41d70 (0x5cdf bytes) 2024-09-22T01:35:24.462 INFO:teuthology.orchestra.run.smithi018.stdout:1574 punch from 0x9a446a to 0x9a4d55, (0x8eb bytes) 2024-09-22T01:35:24.462 INFO:teuthology.orchestra.run.smithi018.stdout:1575 punch from 0x287fc3c to 0x2880e62, (0x1226 bytes) 2024-09-22T01:35:24.462 INFO:teuthology.orchestra.run.smithi018.stdout:1576 read 0xcfa4364 thru 0xcfb3425 (0xf0c2 bytes) 2024-09-22T01:35:24.463 INFO:teuthology.orchestra.run.smithi018.stdout:1577 read 0x1ec10c9 thru 0x1ed0a92 (0xf9ca bytes) 2024-09-22T01:35:24.463 INFO:teuthology.orchestra.run.smithi018.stdout:1578 write 0x42d2fc5 thru 0x42d3027 (0x63 bytes) 2024-09-22T01:35:24.467 INFO:teuthology.orchestra.run.smithi018.stdout:1579 writesame 0x7003865 thru 0x7003fd2 data_size 0x3(0x76e bytes) 2024-09-22T01:35:24.471 INFO:teuthology.orchestra.run.smithi018.stdout:1581 punch from 0x7a02d13 to 0x7a0c1ac, (0x9499 bytes) 2024-09-22T01:35:24.471 INFO:teuthology.orchestra.run.smithi018.stdout:1582 writesame 0x278b589 thru 0x27934d8 data_size 0x61(0x7f50 bytes) 2024-09-22T01:35:24.473 INFO:teuthology.orchestra.run.smithi018.stdout:1583 write 0x5e12ff1 thru 0x5e132f3 (0x303 bytes) 2024-09-22T01:35:24.478 INFO:teuthology.orchestra.run.smithi018.stdout:1586 writesame 0x5840b07 thru 0x584fe3f data_size 0x23(0xf339 bytes) 2024-09-22T01:35:24.481 INFO:teuthology.orchestra.run.smithi018.stdout:1587 write 0xc4dc799 thru 0xc4e79e8 (0xb250 bytes) 2024-09-22T01:35:24.487 INFO:teuthology.orchestra.run.smithi018.stdout:1588 trunc from 0xe7885ef to 0xc07b854 2024-09-22T01:35:24.498 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:24.497+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:24.507 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.507 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:24.507 INFO:teuthology.orchestra.run.smithi018.stdout:1593 punch from 0x7975e73 to 0x7981608, (0xb795 bytes) 2024-09-22T01:35:24.507 INFO:teuthology.orchestra.run.smithi018.stdout:1594 writesame 0x8d4b2fa thru 0x8d5209f data_size 0x23(0x6da6 bytes) 2024-09-22T01:35:24.511 INFO:teuthology.orchestra.run.smithi018.stdout:1595 read 0xa49ecf9 thru 0xa4a550a (0x6812 bytes) 2024-09-22T01:35:24.511 INFO:teuthology.orchestra.run.smithi018.stdout:1597 writesame 0x6ea52e4 thru 0x6eaabe3 data_size 0x20(0x5900 bytes) 2024-09-22T01:35:24.516 INFO:teuthology.orchestra.run.smithi018.stdout:1598 clone 15 order 18 su 1024 sc 12 2024-09-22T01:35:24.568 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:24.569 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:24.573 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:24.573 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:24.573 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:24.573 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:24.573 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:24.585 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:24.585 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:24.587 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:24.604 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:24.604 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:24.621 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:24.621 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:24.634 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:24.633+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:24.642 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:24.642 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:24.660 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:24.678 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:24.698 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:24.698 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:24.699 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:24.697+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:24.756 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:24.756 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:24.774 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:24.822 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:24.821+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:24.866 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone14 from 0xc07b854 (overlap 0x2e2b18) to 0x0 2024-09-22T01:35:24.901 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:24.897+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:24.957 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:24.957 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:24.972 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:24.982 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-22T01:35:25.002 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:24.998+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:25.103 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:25.101+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:25.136 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:25.136 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:25.150 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:25.242 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:25.241+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:25.304 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:25.301+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:25.318 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:25.318 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:25.333 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:25.418 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:25.417+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:25.420 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:25.420 INFO:teuthology.orchestra.run.smithi018.stdout:1602 read 0xb570116 thru 0xb57551e (0x5409 bytes) 2024-09-22T01:35:25.422 INFO:teuthology.orchestra.run.smithi018.stdout:1603 read 0xbf859b5 thru 0xbf8cd21 (0x736d bytes) 2024-09-22T01:35:25.423 INFO:teuthology.orchestra.run.smithi018.stdout:1604 write 0x6bbbdff thru 0x6bbe485 (0x2687 bytes) 2024-09-22T01:35:25.463 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:25.463 INFO:teuthology.orchestra.run.smithi018.stdout:1607 writesame 0x6866d9a thru 0x686c472 data_size 0x1(0x56d9 bytes) 2024-09-22T01:35:25.492 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:25.492 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:25.493 INFO:teuthology.orchestra.run.smithi018.stdout:1610 trunc from 0xc07b854 to 0xb7144ad 2024-09-22T01:35:25.506 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:25.505+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:25.514 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:25.514 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:25.526 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:25.526 INFO:teuthology.orchestra.run.smithi018.stdout:1612 write 0x884faa2 thru 0x8851ac8 (0x2027 bytes) 2024-09-22T01:35:25.530 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:25.607 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:25.606+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:25.708 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:25.706+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:25.736 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:25.736 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:25.751 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:25.783 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:35:25.810 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:25.809+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:25.869 INFO:teuthology.orchestra.run.smithi018.stdout:1613 read 0xa4e701b thru 0xa4f2c14 (0xbbfa bytes) 2024-09-22T01:35:25.869 INFO:teuthology.orchestra.run.smithi018.stdout:1614 writesame 0x38b844 thru 0x3950c9 data_size 0x7(0x9886 bytes) 2024-09-22T01:35:25.889 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:25.889 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:25.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:25.953 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:25.953+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:26.011 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:26.006+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:26.059 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:26.060 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:26.075 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:26.120 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:26.118+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:26.212 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:26.209+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:26.242 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:26.242 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:26.253 INFO:teuthology.orchestra.run.smithi018.stdout:1615 trunc from 0xb7144ad to 0x9199c53 2024-09-22T01:35:26.261 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:26.293 INFO:teuthology.orchestra.run.smithi018.stdout:1617 read 0x7ea4d28 thru 0x7eab975 (0x6c4e bytes) 2024-09-22T01:35:26.300 INFO:teuthology.orchestra.run.smithi018.stdout:1618 read 0x68d45c2 thru 0x68df914 (0xb353 bytes) 2024-09-22T01:35:26.302 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:26.302 INFO:teuthology.orchestra.run.smithi018.stdout:1621 write 0x8c6d552 thru 0x8c71aca (0x4579 bytes) 2024-09-22T01:35:26.313 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:26.310+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:26.401 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:26.401 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:26.414 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:26.413+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:26.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:26.515 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:26.513+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:26.598 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:26.599 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:26.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:26.659 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:26.658+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:26.717 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:26.714+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:26.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:26.729 INFO:teuthology.orchestra.run.smithi018.stdout:1622 write 0x8c8af41 thru 0x8c8f6fa (0x47ba bytes) 2024-09-22T01:35:26.734 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:26.742 INFO:teuthology.orchestra.run.smithi018.stdout:1625 writesame 0x959099f thru 0x959fcf7 data_size 0x1(0xf359 bytes) 2024-09-22T01:35:26.742 INFO:teuthology.orchestra.run.smithi018.stdout:1626 write 0x6d422ea thru 0x6d468ab (0x45c2 bytes) 2024-09-22T01:35:26.747 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:26.747 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:26.762 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:35:26.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:26.817 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:26.817+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:26.871 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:26.872 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:26.889 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:26.910 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:26.910 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:26.918 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:26.914+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:26.929 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:26.929 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:26.947 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:26.948 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:26.954 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:602 3.19 3:9cb5f23f:::rbd_data.110fc6985e86.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.253629961000001, 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.055897943999999998, 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:26.955 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 602 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699625+0000", 2024-09-22T01:35:26.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699628+0000", 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6330000000000002e-06 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699650+0000", 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2056999999999999e-05 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699689+0000", 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9109000000000001e-05 2024-09-22T01:35:26.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699707+0000", 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7207e-05 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.699868+0000", 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016106200000000001 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.700040+0000", 2024-09-22T01:35:26.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171865 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 3", 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.707678+0000", 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0076380479999999997 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755348+0000", 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.047670037999999998 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755387+0000", 2024-09-22T01:35:26.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9662000000000001e-05 2024-09-22T01:35:26.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:26.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755455+0000", 2024-09-22T01:35:26.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7995000000000002e-05 2024-09-22T01:35:26.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.755523+0000", 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7267999999999994e-05 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11290 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.083004691999999, 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048997573000000003, 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:26.962 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11290 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870250+0000", 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870253+0000", 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5019999999999999e-06 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870274+0000", 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1064999999999999e-05 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:26.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870280+0000", 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3230000000000003e-06 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919056+0000", 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048776031999999997 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919138+0000", 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1846000000000002e-05 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919247+0000", 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000109329 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11291 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 335872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.082962885000001, 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049210375000000001, 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:26.966 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11291 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870292+0000", 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870461+0000", 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169476 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870465+0000", 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:35:26.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870477+0000", 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1207e-05 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870484+0000", 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.481e-06 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919295+0000", 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048810529999999998 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919380+0000", 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5773999999999996e-05 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919502+0000", 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000121662 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11292 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 509952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:26.970 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.082756955000001, 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049215074999999997, 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11292 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870498+0000", 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870610+0000", 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112569 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870615+0000", 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3630000000000004e-06 2024-09-22T01:35:26.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870626+0000", 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1460999999999999e-05 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870633+0000", 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8170000000000001e-06 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919546+0000", 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048912723999999998 2024-09-22T01:35:26.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919651+0000", 2024-09-22T01:35:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105437 2024-09-22T01:35:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919713+0000", 2024-09-22T01:35:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1704000000000004e-05 2024-09-22T01:35:26.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11293 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 520192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.082610422999998, 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049300425000000002, 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11293 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870644+0000", 2024-09-22T01:35:26.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870769+0000", 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125289 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870774+0000", 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1099999999999996e-06 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870784+0000", 2024-09-22T01:35:26.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0664e-05 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870791+0000", 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919753+0000", 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048961849000000002 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919840+0000", 2024-09-22T01:35:26.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6917999999999997e-05 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919945+0000", 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010444499999999999 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11294 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 694272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.082451580000001, 2024-09-22T01:35:26.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049352066999999999, 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11294 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870803+0000", 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870909+0000", 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105821 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:26.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870913+0000", 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3329999999999998e-06 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870929+0000", 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6146000000000001e-05 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870938+0000", 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8470000000000002e-06 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.919988+0000", 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049050170999999997 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920051+0000", 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2337999999999998e-05 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920155+0000", 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104411 2024-09-22T01:35:26.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11295 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 868352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.082304249, 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049438600999999999, 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:26.984 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11295 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.870950+0000", 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872025+0000", 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001075037 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872031+0000", 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3619999999999997e-06 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:26.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872043+0000", 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2075999999999999e-05 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872052+0000", 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-06 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920196+0000", 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048143803999999998 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:26.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920284+0000", 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7454999999999995e-05 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920389+0000", 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105167 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11313 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 346112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:26.988 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.081139668999999, 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048873528999999999, 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11313 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872115+0000", 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6300000000000001e-07 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872117+0000", 2024-09-22T01:35:26.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2450000000000001e-06 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872125+0000", 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872130+0000", 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9280000000000001e-06 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:26.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920837+0000", 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048706948999999999 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920921+0000", 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3459000000000002e-05 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.920988+0000", 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7644000000000005e-05 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11314 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 356352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.081117155000001, 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049091919999999997, 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11314 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:26.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872137+0000", 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872138+0000", 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3799999999999998e-07 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:26.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872140+0000", 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5500000000000001e-06 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872147+0000", 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6680000000000004e-06 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872152+0000", 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4269999999999999e-06 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:26.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921028+0000", 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048875778000000002 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921118+0000", 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0148000000000005e-05 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921229+0000", 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110911 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.996 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11315 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 530432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.081095501, 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049217209999999997, 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:26.997 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11315 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872159+0000", 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872362+0000", 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203131 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872368+0000", 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6210000000000001e-06 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:26.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872379+0000", 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872388+0000", 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1800000000000002e-06 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921263+0000", 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048874828000000002 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921309+0000", 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5843000000000001e-05 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921376+0000", 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7429999999999996e-05 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11316 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 704512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:27.001 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.080852761999999, 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049209332000000001, 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11316 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:27.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872402+0000", 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872627+0000", 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022554899999999999 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872638+0000", 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0964e-05 2024-09-22T01:35:27.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872652+0000", 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100999999999999e-05 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872661+0000", 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8340000000000005e-06 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921415+0000", 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048753713999999997 2024-09-22T01:35:27.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921505+0000", 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9554000000000004e-05 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921611+0000", 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106616 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.005 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11317 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 714752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.080580461, 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049068392000000002, 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11317 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.006 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872674+0000", 2024-09-22T01:35:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872821+0000", 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014710999999999999 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872826+0000", 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5399999999999997e-06 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872839+0000", 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3441999999999999e-05 2024-09-22T01:35:27.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872854+0000", 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4364e-05 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921646+0000", 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048791961000000002 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921688+0000", 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.286e-05 2024-09-22T01:35:27.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921742+0000", 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4114999999999999e-05 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11318 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 888832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.080388825, 2024-09-22T01:35:27.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049108288, 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11318 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:27.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.872866+0000", 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873096+0000", 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023050300000000001 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873102+0000", 2024-09-22T01:35:27.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5269999999999998e-06 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873114+0000", 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1802e-05 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873121+0000", 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4209999999999998e-06 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921782+0000", 2024-09-22T01:35:27.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048660582000000001 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921869+0000", 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7798000000000002e-05 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.921974+0000", 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010465499999999999 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11319 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 899072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.080121201000001, 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048963590000000001, 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11319 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873133+0000", 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873305+0000", 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017154 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873310+0000", 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873326+0000", 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.558e-05 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873343+0000", 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6894000000000001e-05 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922006+0000", 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.04866293 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922047+0000", 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0952999999999999e-05 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922097+0000", 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0413e-05 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11333 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 8192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.07989852, 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048982295000000002, 2024-09-22T01:35:27.019 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11333 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.873356+0000", 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875169+0000", 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0018133089999999999 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875175+0000", 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875189+0000", 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3886999999999999e-05 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.875197+0000", 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5369999999999997e-06 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922139+0000", 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.046941573 2024-09-22T01:35:27.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922231+0000", 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2565000000000006e-05 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.922338+0000", 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107124 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11384 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 755712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.023 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.075475521000001, 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048901420000000001, 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11384 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877779+0000", 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877943+0000", 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164411 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877948+0000", 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3340000000000003e-06 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877959+0000", 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1027e-05 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.877966+0000", 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1099999999999997e-06 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926570+0000", 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048603810999999997 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926616+0000", 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6335999999999998e-05 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926680+0000", 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4391000000000001e-05 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11386 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 940032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.075135542000002, 2024-09-22T01:35:27.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048882052000000002, 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11386 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878119+0000", 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878210+0000", 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1310999999999994e-05 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878215+0000", 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4259999999999996e-06 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878229+0000", 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.448e-05 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878244+0000", 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4718e-05 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926854+0000", 2024-09-22T01:35:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048610318999999999 2024-09-22T01:35:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.926939+0000", 2024-09-22T01:35:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4919999999999993e-05 2024-09-22T01:35:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927001+0000", 2024-09-22T01:35:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1878000000000006e-05 2024-09-22T01:35:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.032 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11401 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.074997059000001, 2024-09-22T01:35:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048953133000000003, 2024-09-22T01:35:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.033 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11401 2024-09-22T01:35:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878257+0000", 2024-09-22T01:35:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878258+0000", 2024-09-22T01:35:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:35:27.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878261+0000", 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7590000000000002e-06 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878269+0000", 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878276+0000", 2024-09-22T01:35:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2420000000000003e-06 2024-09-22T01:35:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927095+0000", 2024-09-22T01:35:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048819573999999998 2024-09-22T01:35:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927153+0000", 2024-09-22T01:35:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7120000000000002e-05 2024-09-22T01:35:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927211+0000", 2024-09-22T01:35:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8062000000000001e-05 2024-09-22T01:35:27.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:11402 3.19 3:9c9d078e:::rbd_data.110f880def8d.0000000000000004:7 [read 59392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.074971262999998, 2024-09-22T01:35:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.049110529, 2024-09-22T01:35:27.039 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 11402 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.878283+0000", 2024-09-22T01:35:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879206+0000", 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092231699999999997 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879211+0000", 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1830000000000002e-06 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879223+0000", 2024-09-22T01:35:27.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2388000000000001e-05 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.879229+0000", 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3800000000000002e-06 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927251+0000", 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.048022479999999999 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927321+0000", 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9760999999999998e-05 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:04.927394+0000", 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3020000000000002e-05 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:57526 3.4 3:206aa493:::rbd_data.110f75bcea59.000000000000001b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 7372800~19816] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e44)", 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:17.724909+0000", 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 9.2283455270000001, 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3084367779999999, 2024-09-22T01:35:27.044 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 57526 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724909+0000", 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724909+0000", 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724911+0000", 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8309999999999999e-06 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724927+0000", 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6178e-05 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724943+0000", 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6288000000000001e-05 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.724956+0000", 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3061000000000001e-05 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.725164+0000", 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020745400000000001 2024-09-22T01:35:27.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:17.725175+0000", 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1342000000000001e-05 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.027010+0000", 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3018344230000001 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for missing object", 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.027093+0000", 2024-09-22T01:35:27.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3839999999999997e-05 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.030511+0000", 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0034172019999999998 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.030758+0000", 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024743999999999998 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 5", 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.031007+0000", 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024887500000000002 2024-09-22T01:35:27.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.032445+0000", 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001438153 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.033242+0000", 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00079685900000000002 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.033282+0000", 2024-09-22T01:35:27.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0346000000000003e-05 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:19.033346+0000", 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3485999999999995e-05 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.051 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:27.053 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:27.053 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:27.053 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:27.054 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:27.054 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:27.054 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:27.055 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:27.055 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:27.049+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:27.153 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:27.150+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:27.239 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:27.240 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:27.240 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:27.240 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:27.254 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:27.253+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:27.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:27.354 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:27.353+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:27.425 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:27.426 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:27.426 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:27.426 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:27.426 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:27.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:27.455 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:27.453+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:27.556 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:27.553+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:27.571 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:27.571 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:27.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:27.571 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.571205384000002, 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.241555730999998, 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:27.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.241412226000001, 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.581 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:35:27.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:35:27.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:27.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.466092954000001, 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:35:27.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:35:27.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:35:27.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:35:27.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:35:27.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.465027258999999, 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:35:27.592 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.156994769000001, 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:35:27.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:27.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 22.156620475, 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:35:27.603 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:27.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:35:27.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:35:27.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:35:27.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.608 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54465 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.748760626999999, 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050651180000000004, 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54465 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821068+0000", 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:35:27.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821078+0000", 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0164e-05 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821107+0000", 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8985000000000001e-05 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821121+0000", 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.307e-05 2024-09-22T01:35:27.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821387+0000", 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026639200000000001 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821395+0000", 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3040000000000005e-06 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825493+0000", 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040977399999999999 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825630+0000", 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136971 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826131+0000", 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050110499999999995 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54466 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.748674098, 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052214690000000003, 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54466 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.614 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821153+0000", 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7499999999999999e-07 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821158+0000", 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3800000000000004e-06 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821169+0000", 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1124000000000001e-05 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821177+0000", 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1040000000000007e-06 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821467+0000", 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029025299999999997 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821474+0000", 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826170+0000", 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046964709999999998 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826261+0000", 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0708e-05 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826374+0000", 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113182 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54467 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.618 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.748637767, 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054437169999999998, 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54467 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:27.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1900000000000002e-07 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821193+0000", 2024-09-22T01:35:27.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4130000000000002e-06 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821202+0000", 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821209+0000", 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8800000000000002e-06 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821504+0000", 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029444600000000002 2024-09-22T01:35:27.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821509+0000", 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5500000000000002e-06 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826415+0000", 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004905492 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826527+0000", 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112144 2024-09-22T01:35:27.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826633+0000", 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105795 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54510 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.748607835, 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057311339999999997, 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54510 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:27.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821245+0000", 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5774000000000001e-05 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821257+0000", 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2045000000000001e-05 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821265+0000", 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821538+0000", 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027359599999999997 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821544+0000", 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7450000000000001e-06 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826699+0000", 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051546229999999997 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826815+0000", 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011646600000000001 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826950+0000", 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013463700000000001 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.627 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54511 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.748549363, 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058910409999999996, 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54511 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821278+0000", 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821282+0000", 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-09-22T01:35:27.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821291+0000", 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3039999999999994e-06 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821298+0000", 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.041e-06 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821573+0000", 2024-09-22T01:35:27.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000274283 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821578+0000", 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0679999999999996e-06 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827015+0000", 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054370670000000003 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827070+0000", 2024-09-22T01:35:27.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5773999999999998e-05 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827168+0000", 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7814999999999998e-05 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54512 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.748518461, 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061320309999999996, 2024-09-22T01:35:27.632 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54512 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:27.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821309+0000", 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.51e-07 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821312+0000", 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0419999999999998e-06 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821320+0000", 2024-09-22T01:35:27.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.422e-06 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821332+0000", 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1951e-05 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821937+0000", 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060522400000000002 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821944+0000", 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.404e-06 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827219+0000", 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052754389999999998 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827317+0000", 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7536999999999998e-05 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827440+0000", 2024-09-22T01:35:27.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123461 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54555 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.748049431, 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059477050000000002, 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54555 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821778+0000", 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0500000000000002e-07 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821783+0000", 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.135e-06 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821798+0000", 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4688000000000001e-05 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821808+0000", 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6690000000000001e-06 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821977+0000", 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169541 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821982+0000", 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-06 2024-09-22T01:35:27.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827481+0000", 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054988470000000003 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827582+0000", 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100554 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827725+0000", 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014320199999999999 2024-09-22T01:35:27.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54556 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.748002611, 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00620654, 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54556 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821825+0000", 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821828+0000", 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8809999999999998e-06 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821839+0000", 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.027e-05 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821846+0000", 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822011+0000", 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822017+0000", 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6099999999999997e-06 2024-09-22T01:35:27.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827802+0000", 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057848509999999997 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827892+0000", 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0880999999999999e-05 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828030+0000", 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013803200000000001 2024-09-22T01:35:27.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54557 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.747968318, 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064190469999999998, 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54557 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821859+0000", 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.99e-07 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821863+0000", 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6569999999999999e-06 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821871+0000", 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9719999999999998e-06 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821878+0000", 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.917e-06 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822045+0000", 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016703000000000001 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822051+0000", 2024-09-22T01:35:27.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.626e-06 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828069+0000", 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060179919999999998 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828161+0000", 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1731999999999995e-05 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828277+0000", 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011652199999999999 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54600 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.747532745000001, 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062310530000000003, 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54600 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822295+0000", 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.19e-06 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822301+0000", 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5010000000000004e-06 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822320+0000", 2024-09-22T01:35:27.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9724e-05 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822330+0000", 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3899999999999999e-06 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822464+0000", 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013444100000000001 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822470+0000", 2024-09-22T01:35:27.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3690000000000003e-06 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828314+0000", 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058434719999999997 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828405+0000", 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1166000000000001e-05 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828525+0000", 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001198 2024-09-22T01:35:27.656 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54601 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.747475127, 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064068470000000002, 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54601 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.657 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822352+0000", 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822356+0000", 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6519999999999999e-06 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822366+0000", 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0686000000000001e-05 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822374+0000", 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4200000000000001e-06 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822500+0000", 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012665800000000001 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822505+0000", 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.938e-06 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828560+0000", 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060544969999999998 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828651+0000", 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0758000000000001e-05 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828758+0000", 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010760900000000001 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.661 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54602 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.747440735, 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066069279999999998, 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54602 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6599999999999996e-07 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822390+0000", 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.377e-06 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822399+0000", 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822406+0000", 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822534+0000", 2024-09-22T01:35:27.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012761900000000001 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822539+0000", 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3639999999999998e-06 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828797+0000", 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006257365 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828885+0000", 2024-09-22T01:35:27.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8818000000000002e-05 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828993+0000", 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107336 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54688 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 12.74355985, 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044478340000000003, 2024-09-22T01:35:27.666 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54688 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826268+0000", 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-06 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826274+0000", 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826294+0000", 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0211999999999999e-05 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826310+0000", 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6039999999999999e-05 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830569+0000", 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004258632 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830641+0000", 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2064000000000007e-05 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830715+0000", 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3483000000000001e-05 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:27.670 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:27.671 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:27.672 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:27.672 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:27.670+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:27.705 INFO:teuthology.orchestra.run.smithi018.stdout:1628 writesame 0x946c9a9 thru 0x947763a data_size 0x6f(0xac92 bytes) 2024-09-22T01:35:27.747 INFO:teuthology.orchestra.run.smithi018.stdout:1629 trunc from 0x959fcf8 to 0x2bc7777 2024-09-22T01:35:27.773 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:27.770+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:27.853 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:27.853 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:27.853 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:27.853 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:27.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:27.874 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:27.873+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:27.975 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:27.970+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:28.019 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 3, 4, 5, 6, 7] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:28.020 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:35:28.020 INFO:tasks.thrashosds.thrasher:Removing osd 0, in_osds are: [0, 1, 3, 4, 5, 6, 7] 2024-09-22T01:35:28.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 0 2024-09-22T01:35:28.042 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:28.042 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:28.058 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:28.104 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:28.102+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:28.177 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:28.174+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:28.201 INFO:teuthology.orchestra.run.smithi018.stdout:1630 read 0xdc3cb4 thru 0xdc5cee (0x203b bytes) 2024-09-22T01:35:28.206 INFO:teuthology.orchestra.run.smithi018.stdout:1631 read 0xe4802a thru 0xe54ed9 (0xceb0 bytes) 2024-09-22T01:35:28.223 INFO:teuthology.orchestra.run.smithi018.stdout:1633 read 0x4fe1ef thru 0x505988 (0x779a bytes) 2024-09-22T01:35:28.238 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:28.238 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111375800000001, 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.239 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:28.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111350064, 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:28.247 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111324281999998, 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:28.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:28.251 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111279363000001, 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:28.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:35:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111247207000002, 2024-09-22T01:35:28.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:35:28.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111219474999999, 2024-09-22T01:35:28.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:35:28.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:35:28.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111183651000001, 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:28.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111147506999998, 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:28.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:35:28.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111111302000001, 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.271 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.274 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111083950000001, 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:35:28.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:28.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:35:28.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.278 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111046871999999, 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.111023334999999, 2024-09-22T01:35:28.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:35:28.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12683 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.110533336, 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058771337, 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12683 2024-09-22T01:35:28.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126558+0000", 2024-09-22T01:35:28.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6399999999999998e-07 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126559+0000", 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8360000000000001e-06 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126567+0000", 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4189999999999996e-06 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126578+0000", 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1439e-05 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185320+0000", 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058741987000000002 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185329+0000", 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2919999999999996e-06 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.110476134999999, 2024-09-22T01:35:28.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.110448378000001, 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:35:28.293 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:35:28.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.110426312000001, 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:35:28.297 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:35:28.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.110396152, 2024-09-22T01:35:28.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.109975662, 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.305 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:35:28.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.109949880999999, 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:35:28.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.313 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 23.109928613000001, 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:35:28.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:35:28.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:28.317 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:28.318 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:28.319 INFO:teuthology.orchestra.run.smithi018.stdout:1635 write 0x903799c thru 0x9037b6b (0x1d0 bytes) 2024-09-22T01:35:28.319 INFO:teuthology.orchestra.run.smithi018.stdout:1636 trunc from 0x9037b6c to 0x5821eba 2024-09-22T01:35:28.320 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:28.320 INFO:teuthology.orchestra.run.smithi018.stdout:1638 write 0xb9d1d9e thru 0xb9dec02 (0xce65 bytes) 2024-09-22T01:35:28.320 INFO:teuthology.orchestra.run.smithi018.stdout:1639 punch from 0x809cf16 to 0x80a276c, (0x5856 bytes) 2024-09-22T01:35:28.321 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:28.314+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:28.321 INFO:teuthology.orchestra.run.smithi018.stdout:1640 trunc from 0xb9dec03 to 0xcc8173e 2024-09-22T01:35:28.331 INFO:teuthology.orchestra.run.smithi018.stdout:1641 writesame 0xcadc202 thru 0xcae9a86 data_size 0x1(0xd885 bytes) 2024-09-22T01:35:28.360 INFO:teuthology.orchestra.run.smithi018.stdout:1642 write 0x4607f32 thru 0x460eaa7 (0x6b76 bytes) 2024-09-22T01:35:28.374 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-22T01:35:28.370+0000 7fb667fae640 -1 mon.a@0(leader).osd e51 definitely_dead 0 2024-09-22T01:35:28.380 INFO:teuthology.orchestra.run.smithi018.stdout:1643 punch from 0xadc2b8f to 0xadc51ef, (0x2660 bytes) 2024-09-22T01:35:28.381 INFO:teuthology.orchestra.run.smithi018.stdout:1644 read 0x77022ec thru 0x7710ebb (0xebd0 bytes) 2024-09-22T01:35:28.381 INFO:teuthology.orchestra.run.smithi018.stdout:1645 write 0x307f9cb thru 0x308c833 (0xce69 bytes) 2024-09-22T01:35:28.403 INFO:teuthology.orchestra.run.smithi018.stdout:1647 trunc from 0xcc8173e to 0xa0778d7 2024-09-22T01:35:28.420 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:28.418+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:28.425 INFO:teuthology.orchestra.run.smithi018.stdout:1648 read 0x3c7034c thru 0x3c77597 (0x724c bytes) 2024-09-22T01:35:28.425 INFO:teuthology.orchestra.run.smithi018.stdout:1649 read 0x44d3ed6 thru 0x44dceca (0x8ff5 bytes) 2024-09-22T01:35:28.433 INFO:teuthology.orchestra.run.smithi018.stdout:1650 trunc from 0xa0778d7 to 0xdf9b0b5 2024-09-22T01:35:28.443 INFO:teuthology.orchestra.run.smithi018.stdout:1651 writesame 0x8cda964 thru 0x8ce1a33 data_size 0x50(0x70d0 bytes) 2024-09-22T01:35:28.463 INFO:teuthology.orchestra.run.smithi018.stdout:1653 write 0xa7efe4 thru 0xa8ae97 (0xbeb4 bytes) 2024-09-22T01:35:28.469 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:28.469 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:28.469 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:28.469 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:28.486 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:28.491 INFO:teuthology.orchestra.run.smithi018.stdout:1657 read 0x1dec5c9 thru 0x1dfbc85 (0xf6bd bytes) 2024-09-22T01:35:28.492 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:28.492 INFO:teuthology.orchestra.run.smithi018.stdout:1661 punch from 0xa4a78c3 to 0xa4ad1ba, (0x58f7 bytes) 2024-09-22T01:35:28.492 INFO:teuthology.orchestra.run.smithi018.stdout:1663 punch from 0x92cac44 to 0x92cd211, (0x25cd bytes) 2024-09-22T01:35:28.492 INFO:teuthology.orchestra.run.smithi018.stdout:1664 writesame 0x7621106 thru 0x762afff data_size 0x99(0x9efa bytes) 2024-09-22T01:35:28.516 INFO:teuthology.orchestra.run.smithi018.stdout:1665 write 0x1319edc thru 0x131c92b (0x2a50 bytes) 2024-09-22T01:35:28.533 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:28.533+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:28.606 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:28.606 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:28.606 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:28.606 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:28.606 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:28.620 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:28.621 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:28.618+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:28.722 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:28.718+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:28.786 INFO:teuthology.orchestra.run.smithi018.stderr:marked out osd.0. 2024-09-22T01:35:28.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:35:28.788 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19458 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1417216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.327172615999999, 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.056428816, 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.789 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19458 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7700000000000005e-07 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457940+0000", 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4329999999999998e-06 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457947+0000", 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9029999999999998e-06 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457953+0000", 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8900000000000004e-06 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512121+0000", 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054168717999999998 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512221+0000", 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9279999999999998e-05 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514366+0000", 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002145115 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19462 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1775616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458239+0000", 2024-09-22T01:35:28.793 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.326870410000001, 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054903667000000003, 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19462 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458239+0000", 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458239+0000", 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458240+0000", 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.32e-07 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458242+0000", 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6369999999999999e-06 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.795 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458249+0000", 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5050000000000004e-06 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458255+0000", 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9710000000000001e-06 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512972+0000", 2024-09-22T01:35:28.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054717215999999999 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513054+0000", 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2365000000000002e-05 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513143+0000", 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8541000000000005e-05 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.797 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19463 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1959936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458341+0000", 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.326768991000002, 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054996745999999999, 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19463 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458341+0000", 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458341+0000", 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458341+0000", 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.3499999999999995e-07 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458345+0000", 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4989999999999999e-06 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458360+0000", 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4963999999999999e-05 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458372+0000", 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2235999999999999e-05 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513169+0000", 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054796563999999999 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513251+0000", 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2099000000000001e-05 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513337+0000", 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6649000000000003e-05 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19464 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1949696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.326661393999998, 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055080249999999997, 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19464 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.802 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459822+0000", 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013738540000000001 2024-09-22T01:35:28.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459827+0000", 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1630000000000004e-06 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459840+0000", 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2775000000000001e-05 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459847+0000", 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8360000000000003e-06 2024-09-22T01:35:28.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513362+0000", 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053515442000000003 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513441+0000", 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8708000000000006e-05 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513528+0000", 2024-09-22T01:35:28.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7472000000000005e-05 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19484 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1437696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.325119999999998, 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055077586999999997, 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.806 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19484 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7e-07 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459993+0000", 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8380000000000002e-06 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460000+0000", 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460005+0000", 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3680000000000001e-06 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514879+0000", 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054874038999999999 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514965+0000", 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5574000000000004e-05 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515067+0000", 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010228100000000001 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19485 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1796096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.325097203999999, 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055255209, 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.810 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19485 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460300+0000", 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028730299999999998 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460304+0000", 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460314+0000", 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7119999999999995e-06 2024-09-22T01:35:28.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460321+0000", 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6710000000000002e-06 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515101+0000", 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054780263000000003 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515180+0000", 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9074999999999998e-05 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515268+0000", 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7416999999999993e-05 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19486 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1970176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.324745321999998, 2024-09-22T01:35:28.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055098253, 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19486 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460365+0000", 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9599999999999999e-07 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460369+0000", 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460382+0000", 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3478999999999999e-05 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460390+0000", 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5340000000000002e-06 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515297+0000", 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054907665000000001 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515373+0000", 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5721000000000002e-05 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515463+0000", 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9653000000000004e-05 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.818 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19487 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1980416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.324696949, 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055238787999999997, 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19487 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460764+0000", 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035164799999999998 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460769+0000", 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.169e-06 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460779+0000", 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3239999999999992e-06 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460786+0000", 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0500000000000003e-06 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515497+0000", 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054711098 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515576+0000", 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9085999999999995e-05 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515651+0000", 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5413000000000005e-05 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.822 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19501 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1089536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.324290245, 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055065846000000002, 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19501 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460820+0000", 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000005e-07 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460823+0000", 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9459999999999998e-06 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460831+0000", 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6839999999999996e-06 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460837+0000", 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9479999999999996e-06 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515696+0000", 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054859053999999997 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515783+0000", 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7705000000000001e-05 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515885+0000", 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101908 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.826 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19502 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1263616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.324264087, 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055304409999999998, 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19502 2024-09-22T01:35:28.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461917+0000", 2024-09-22T01:35:28.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0010713960000000001 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461923+0000", 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7030000000000003e-06 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461936+0000", 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2903e-05 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461944+0000", 2024-09-22T01:35:28.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4169999999999992e-06 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515939+0000", 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053995026000000002 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516037+0000", 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8462999999999996e-05 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516150+0000", 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000112502 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19506 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1632256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462061+0000", 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.323049046000001, 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055013708000000001, 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.831 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19506 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462061+0000", 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462061+0000", 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462061+0000", 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462064+0000", 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462072+0000", 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5040000000000002e-06 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462078+0000", 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2859999999999999e-06 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516962+0000", 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054884672000000002 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517013+0000", 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0368999999999998e-05 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517074+0000", 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1612000000000006e-05 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19507 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1806336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.323025314999999, 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055141745999999998, 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.835 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19507 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462085+0000", 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462087+0000", 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.418e-06 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462095+0000", 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0460000000000006e-06 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462101+0000", 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1150000000000002e-06 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517103+0000", 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055002874 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517153+0000", 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9888000000000001e-05 2024-09-22T01:35:28.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517226+0000", 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2775999999999996e-05 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19508 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1816576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.323002592999998, 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055377692999999999, 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.839 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19508 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:35:28.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462497+0000", 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038960900000000002 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462501+0000", 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2640000000000002e-06 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462513+0000", 2024-09-22T01:35:28.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1643e-05 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462520+0000", 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.148e-06 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517286+0000", 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054766269999999999 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517378+0000", 2024-09-22T01:35:28.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1853000000000003e-05 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517485+0000", 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106906 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19509 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1990656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.322571763999999, 2024-09-22T01:35:28.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055183229, 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19509 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462541+0000", 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6460000000000002e-06 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462550+0000", 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3440000000000007e-06 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462556+0000", 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5330000000000002e-06 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517517+0000", 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054960822999999999 2024-09-22T01:35:28.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517620+0000", 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010306600000000001 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517721+0000", 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010129299999999999 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19524 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1099776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.322544691000001, 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055394339000000001, 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19524 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462933+0000", 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00036762399999999999 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462937+0000", 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5580000000000002e-06 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462946+0000", 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3179999999999996e-06 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462953+0000", 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8560000000000001e-06 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517759+0000", 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054806133 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517856+0000", 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7048999999999999e-05 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517959+0000", 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010280099999999999 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19525 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1110016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.322141875, 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055216300000000003, 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19525 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463068+0000", 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100511 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463072+0000", 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.563e-06 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463081+0000", 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.816e-06 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463087+0000", 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5910000000000001e-06 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517994+0000", 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054906644999999997 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518084+0000", 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9806e-05 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518184+0000", 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100368 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19526 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1284096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.322013226999999, 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.05530989, 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.856 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19526 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463491+0000", 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00039443699999999998 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463497+0000", 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463508+0000", 2024-09-22T01:35:28.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1685000000000001e-05 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463517+0000", 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2479999999999996e-06 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518222+0000", 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054705548 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518317+0000", 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4660999999999994e-05 2024-09-22T01:35:28.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518406+0000", 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9580999999999995e-05 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19527 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1458176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.321534585999999, 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055079491000000001, 2024-09-22T01:35:28.860 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19527 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463576+0000", 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3099999999999997e-07 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463579+0000", 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5719999999999999e-06 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463589+0000", 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4020000000000008e-06 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463595+0000", 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1140000000000002e-06 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518459+0000", 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054863737000000003 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518543+0000", 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4690000000000004e-05 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518655+0000", 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111345 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19528 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1468416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.864 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.321504151999999, 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.059935753000000001, 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19528 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:35:28.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463794+0000", 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018894199999999999 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463798+0000", 2024-09-22T01:35:28.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7000000000000002e-06 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463808+0000", 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0045e-05 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463814+0000", 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518732+0000", 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054917796999999997 2024-09-22T01:35:28.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518812+0000", 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9759999999999995e-05 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.523541+0000", 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0047297270000000004 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19529 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1642496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.321285794000001, 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055275522000000001, 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19529 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.869 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465588+0000", 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017641309999999999 2024-09-22T01:35:28.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465593+0000", 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7350000000000004e-06 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465602+0000", 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.329e-06 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465608+0000", 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6779999999999997e-06 2024-09-22T01:35:28.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518932+0000", 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053324085 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519006+0000", 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4072000000000005e-05 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519099+0000", 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3492000000000005e-05 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.872 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.873 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.873 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:28.873 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:28.873 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:28.875 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:28.870+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:28.875 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:28.975 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:28.970+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:29.000 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:29.001 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:29.001 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:29.001 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:29.016 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:29.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:29.076 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:29.073+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:29.136 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:29.136 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:29.136 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:29.136 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:29.136 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:29.151 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:29.177 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:29.174+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:29.193 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:29.194 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:29.278 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:29.274+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:29.321 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:5372 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:00.125466+0000", 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 29.193547516999999, 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.060015348000000003, 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.322 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 5372 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125466+0000", 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125466+0000", 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125468+0000", 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9999999999999999e-06 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125481+0000", 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2965e-05 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125512+0000", 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1387999999999998e-05 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125528+0000", 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5875e-05 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125711+0000", 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018251300000000001 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125849+0000", 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013890199999999999 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.135810+0000", 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.009960989 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185297+0000", 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049486143000000003 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185358+0000", 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0952999999999997e-05 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185423+0000", 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5665000000000002e-05 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185481+0000", 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7955000000000003e-05 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15848 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 802816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.995794828000001, 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048543573999999999, 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15848 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2200000000000003e-07 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323225+0000", 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2060000000000004e-06 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323233+0000", 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.114e-06 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323238+0000", 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4269999999999999e-06 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371630+0000", 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048391548 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371685+0000", 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5764999999999999e-05 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371762+0000", 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6792000000000006e-05 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15849 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 813056~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.995768308999999, 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048740787000000001, 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15849 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2300000000000002e-07 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323247+0000", 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.996e-06 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323255+0000", 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8189999999999992e-06 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323261+0000", 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2390000000000002e-06 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371802+0000", 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048541859999999999 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371888+0000", 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5841999999999996e-05 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371986+0000", 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7608000000000005e-05 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.335 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15850 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 987136~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323267+0000", 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.995745961000001, 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048897709999999997, 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.336 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15850 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323267+0000", 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323267+0000", 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323268+0000", 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7100000000000002e-07 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323270+0000", 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1789999999999998e-06 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323277+0000", 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4869999999999999e-06 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323281+0000", 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8919999999999999e-06 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372025+0000", 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048743109999999999 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372100+0000", 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5706999999999999e-05 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372165+0000", 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4863999999999994e-05 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15851 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 997376~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.995725435000001, 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049107096000000003, 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.340 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15851 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5499999999999999e-07 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323291+0000", 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.323e-06 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323300+0000", 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7389999999999994e-06 2024-09-22T01:35:29.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323306+0000", 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2979999999999999e-06 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372204+0000", 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048898832000000003 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372294+0000", 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9517000000000004e-05 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372395+0000", 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101032 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15856 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 106496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323312+0000", 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.995701189999998, 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049274633999999998, 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.344 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15856 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323312+0000", 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323312+0000", 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323313+0000", 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1699999999999999e-07 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323315+0000", 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1239999999999999e-06 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323321+0000", 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3470000000000004e-06 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323326+0000", 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0259999999999998e-06 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372436+0000", 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049109450999999998 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372504+0000", 2024-09-22T01:35:29.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8499999999999998e-05 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372587+0000", 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2769000000000007e-05 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15857 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 280576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323333+0000", 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.995680315000001, 2024-09-22T01:35:29.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049491571999999998, 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15857 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323333+0000", 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323333+0000", 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326605+0000", 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032723959999999999 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326610+0000", 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0929999999999996e-06 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326623+0000", 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3885e-05 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326629+0000", 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7069999999999997e-06 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372623+0000", 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.045994150999999997 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372725+0000", 2024-09-22T01:35:29.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000102135 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372825+0000", 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9204999999999996e-05 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15874 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 485376~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326789+0000", 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.992223895999999, 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048542634000000001, 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.352 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15874 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326789+0000", 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326789+0000", 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326790+0000", 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2300000000000002e-07 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326791+0000", 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2500000000000001e-06 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326797+0000", 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3730000000000001e-06 2024-09-22T01:35:29.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326801+0000", 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8409999999999999e-06 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375143+0000", 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048341692999999998 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375232+0000", 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8782000000000005e-05 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375332+0000", 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100272 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15875 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 659456~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326808+0000", 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.992205345999999, 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048705257000000002, 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.356 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15875 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326808+0000", 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326808+0000", 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.357 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326809+0000", 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6199999999999998e-07 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326811+0000", 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.074e-06 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326817+0000", 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4350000000000002e-06 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.358 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326822+0000", 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.938e-06 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375366+0000", 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048543513000000003 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375444+0000", 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8384e-05 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375513+0000", 2024-09-22T01:35:29.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9350999999999994e-05 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15876 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 669696~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326843+0000", 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.992170245000001, 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048891241000000002, 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.360 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15876 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326843+0000", 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326843+0000", 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326844+0000", 2024-09-22T01:35:29.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326846+0000", 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4260000000000002e-06 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326859+0000", 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326865+0000", 2024-09-22T01:35:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.998e-06 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375553+0000", 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048687268999999998 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375638+0000", 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4851000000000005e-05 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375734+0000", 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6779000000000003e-05 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15877 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 843776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.992139472000002, 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049047570999999998, 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.364 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15877 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5999999999999999e-07 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326877+0000", 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3700000000000002e-06 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326884+0000", 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2649999999999999e-06 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326891+0000", 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0809999999999996e-06 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375776+0000", 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048885021000000001 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375840+0000", 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3496000000000003e-05 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375921+0000", 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1878000000000004e-05 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15878 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 1028096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326898+0000", 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.99211498, 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049240253999999997, 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.368 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15878 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326898+0000", 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326898+0000", 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326899+0000", 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2500000000000001e-07 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326901+0000", 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2180000000000002e-06 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326916+0000", 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5294999999999998e-05 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326922+0000", 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0299999999999999e-06 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375957+0000", 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049034873999999999 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376044+0000", 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6496999999999995e-05 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376139+0000", 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4914999999999995e-05 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15879 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 1017856~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326931+0000", 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.992082624999998, 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049385907, 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.372 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15879 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326931+0000", 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326931+0000", 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330840+0000", 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039091799999999999 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330847+0000", 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.289e-06 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330859+0000", 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2101e-05 2024-09-22T01:35:29.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330867+0000", 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0180000000000001e-06 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376178+0000", 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.045310797999999999 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376240+0000", 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1863e-05 2024-09-22T01:35:29.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376317+0000", 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6657999999999997e-05 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15903 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 690176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.987772797000002, 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048413610000000003, 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.376 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15903 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331243+0000", 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5059999999999998e-06 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331261+0000", 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7768e-05 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331267+0000", 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0070000000000003e-06 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379464+0000", 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048196992000000001 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379552+0000", 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7756000000000005e-05 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379654+0000", 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010214500000000001 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15904 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 700416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.987737845000002, 2024-09-22T01:35:29.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048631483000000003, 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15904 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5600000000000001e-07 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331279+0000", 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.717e-06 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331286+0000", 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2099999999999996e-06 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331292+0000", 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6319999999999996e-06 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379689+0000", 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048397554000000002 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379792+0000", 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010319699999999999 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379907+0000", 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011471700000000001 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15905 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 874496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:29.384 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.987714531999998, 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048758479, 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15905 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331302+0000", 2024-09-22T01:35:29.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.497e-06 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331315+0000", 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3684e-05 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331321+0000", 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379946+0000", 2024-09-22T01:35:29.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048624779 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379998+0000", 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2303999999999999e-05 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380057+0000", 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9021000000000003e-05 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.388 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15911 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 167936~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331351+0000", 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.987662167, 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048937877999999997, 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15911 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.389 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331351+0000", 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331351+0000", 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331352+0000", 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.75e-07 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331355+0000", 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.112e-06 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331363+0000", 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0930000000000003e-06 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331369+0000", 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7760000000000003e-06 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380104+0000", 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048735140000000003 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380199+0000", 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4844000000000002e-05 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380289+0000", 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0338000000000001e-05 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.392 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15912 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 178176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.987636567999999, 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049071042000000002, 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15912 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1600000000000001e-07 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331380+0000", 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819999999999998e-06 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331394+0000", 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4239e-05 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331399+0000", 2024-09-22T01:35:29.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2159999999999997e-06 2024-09-22T01:35:29.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.397 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.397 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380338+0000", 2024-09-22T01:35:29.397 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048938447000000003 2024-09-22T01:35:29.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.397 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.397 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.397 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380389+0000", 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1635000000000003e-05 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380448+0000", 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8607000000000003e-05 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15913 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 352256~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.987606332999999, 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049229644000000003, 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15913 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8599999999999999e-07 2024-09-22T01:35:29.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331410+0000", 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.858e-06 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331418+0000", 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.267e-06 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331423+0000", 2024-09-22T01:35:29.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.519e-06 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380485+0000", 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049061912999999999 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380542+0000", 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7522000000000003e-05 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380637+0000", 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4178999999999994e-05 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15914 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 526336~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331430+0000", 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.987582886999999, 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049386494000000003, 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.403 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15914 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331430+0000", 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331430+0000", 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334567+0000", 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031364790000000002 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334573+0000", 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5429999999999999e-06 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334589+0000", 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5488000000000001e-05 2024-09-22T01:35:29.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334598+0000", 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2620000000000004e-06 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380677+0000", 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.046078612999999997 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380728+0000", 2024-09-22T01:35:29.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1232e-05 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380817+0000", 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8876999999999996e-05 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.407 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:29.409 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:29.409 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:29.405+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:29.510 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:29.508+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3.3f5963b0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.77355536300000005, 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.77359884099999998, 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "waiting for peered", 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.577 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.580 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.581 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:35:29.581 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 1 2024-09-22T01:35:29.581 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:29.590 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:29.611 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:29.606+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:29.712 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:29.710+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:29.755 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:29.755 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:29.755 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:29.756 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:29.756 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:29.769 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:29.794 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:35:29.813 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:29.810+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71861 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4369408~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075384+0000", 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8300237849999998, 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089568030000000007, 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.908 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71861 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075384+0000", 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075384+0000", 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075385+0000", 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5899999999999996e-07 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075388+0000", 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4369999999999999e-06 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075399+0000", 2024-09-22T01:35:29.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0835999999999999e-05 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075408+0000", 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6789999999999994e-06 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.164826+0000", 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089418628 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.164891+0000", 2024-09-22T01:35:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4874000000000003e-05 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.164952+0000", 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0917e-05 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.829987249, 2024-09-22T01:35:29.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:35:29.916 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.829950221, 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:35:29.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:35:29.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.920 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71899 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4836352~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.086965+0000", 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8184429739999999, 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089670389000000003, 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71899 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.086965+0000", 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.086965+0000", 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.086965+0000", 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.086977+0000", 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1113e-05 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.086988+0000", 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1228e-05 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.086996+0000", 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6410000000000008e-06 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176337+0000", 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089340739000000002 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176504+0000", 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016665699999999999 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176635+0000", 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013137500000000001 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.924 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.818399761, 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.925 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:35:29.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:35:29.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:35:29.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.818365754, 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.929 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:35:29.930 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:35:29.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:35:29.932 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8144984040000001, 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.933 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:35:29.934 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.935 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.937 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8144528559999999, 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.938 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:35:29.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.941 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.814407648, 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:35:29.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:35:29.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.945 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.814373056, 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.946 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:35:29.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8143394079999999, 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.950 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:35:29.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:35:29.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8106099179999999, 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8105734149999999, 2024-09-22T01:35:29.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.959 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:35:29.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:35:29.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.810528776, 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.963 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.964 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.81047855, 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.967 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:35:29.968 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:35:29.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:35:29.970 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8104401079999999, 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.971 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:35:29.972 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:35:29.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:35:29.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8103961129999999, 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.975 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.810356963, 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.979 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:35:29.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:35:29.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8065137949999999, 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.983 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:35:29.984 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:35:29.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.8064334689999999, 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:35:29.987 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:29.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:29.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:29.991 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:29.993 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:29.993 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:29.990+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:30.094 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:30.092+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:30.118 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:30.118 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:30.118 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:30.118 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:30.132 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:30.217 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:30.216+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:30.295 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:30.292+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:30.298 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:30.298 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:30.312 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:30.397 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:30.396+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:30.476 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:30.476 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:30.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:30.476 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:30.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.166154575, 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:35:30.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:35:30.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:35:30.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:35:30.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:35:30.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.635381879000001, 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.483 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:35:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.635154599, 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.487 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.491 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.631986314999999, 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:30.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:35:30.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.494 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.631902051000001, 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.499 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.631850555, 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:35:30.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:35:30.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.631805235000002, 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.504 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:35:30.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:30.508 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.628324977999998, 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:35:30.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:35:30.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.628020165999999, 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:35:30.516 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.627970722000001, 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.517 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.518 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.627926167999998, 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.521 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:30.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.627882518, 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:35:30.525 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.529 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.627835297000001, 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.627640290999999, 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:35:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:35:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:35:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.627590804, 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.624439745, 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:35:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:35:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.624094116999999, 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:35:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:35:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.623998694000001, 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.623946114999999, 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:35:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:35:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 25.623904348, 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:30.562 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:30.563 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:30.560+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:30.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:30.664 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:30.664+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:30.698 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:30.698 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:30.712 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:30.765 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:30.762+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:30.856 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:30.856 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:30.866 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:30.862+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:30.866 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:30.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:30.888 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:30.915 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:30.939 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:30.939 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:30.967 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:30.964+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:30.971 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:31.001 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:31.001 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:31.029 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:31.029 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:31.058 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:31.058 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:31.067 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:31.062+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:31.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:31.172 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:31.169+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:31.261 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:31.261 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:31.269 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:31.265+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:31.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:31.370 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:31.368+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:31.373 INFO:teuthology.orchestra.run.smithi018.stdout:1666 write 0x330dad3 thru 0x331776d (0x9c9b bytes) 2024-09-22T01:35:31.414 INFO:teuthology.orchestra.run.smithi018.stdout:1667 punch from 0x644a6a5 to 0x6459f01, (0xf85c bytes) 2024-09-22T01:35:31.415 INFO:teuthology.orchestra.run.smithi018.stdout:1668 trunc from 0xdf9b0b5 to 0xdea3cb2 2024-09-22T01:35:31.428 INFO:teuthology.orchestra.run.smithi018.stdout:1669 write 0x8696822 thru 0x869cbd6 (0x63b5 bytes) 2024-09-22T01:35:31.456 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:31.456 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:31.463 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:31.463 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:31.471 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:31.468+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:31.473 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:31.481 INFO:teuthology.orchestra.run.smithi018.stdout:1672 trunc from 0xdea3cb2 to 0x61aa6b8 2024-09-22T01:35:31.520 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:31.531 INFO:teuthology.orchestra.run.smithi018.stdout:1674 trunc from 0x61aa6b8 to 0xd7f89e9 2024-09-22T01:35:31.546 INFO:teuthology.orchestra.run.smithi018.stdout:1675 write 0xc16d900 thru 0xc175c1c (0x831d bytes) 2024-09-22T01:35:31.572 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:31.569+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:31.581 INFO:teuthology.orchestra.run.smithi018.stdout:1677 read 0x5b4a2e3 thru 0x5b578f1 (0xd60f bytes) 2024-09-22T01:35:31.581 INFO:teuthology.orchestra.run.smithi018.stdout:1679 read 0x43c0e1d thru 0x43ce004 (0xd1e8 bytes) 2024-09-22T01:35:31.589 INFO:teuthology.orchestra.run.smithi018.stdout:1681 trunc from 0xd7f89e9 to 0xa05c3fc 2024-09-22T01:35:31.608 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:31.608 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:31.625 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:31.629 INFO:teuthology.orchestra.run.smithi018.stdout:1684 write 0xb85e9d0 thru 0xb860489 (0x1aba bytes) 2024-09-22T01:35:31.651 INFO:teuthology.orchestra.run.smithi018.stdout:1685 punch from 0xa19c91a to 0xa19fa33, (0x3119 bytes) 2024-09-22T01:35:31.651 INFO:teuthology.orchestra.run.smithi018.stdout:1686 read 0xdcfb3c thru 0xdd1008 (0x14cd bytes) 2024-09-22T01:35:31.654 INFO:teuthology.orchestra.run.smithi018.stdout:1687 punch from 0xaddb9a0 to 0xaddcff6, (0x1656 bytes) 2024-09-22T01:35:31.654 INFO:teuthology.orchestra.run.smithi018.stdout:1688 punch from 0xb6e1313 to 0xb6f0f6d, (0xfc5a bytes) 2024-09-22T01:35:31.655 INFO:teuthology.orchestra.run.smithi018.stdout:1689 write 0x9181f6 thru 0x91968e (0x1499 bytes) 2024-09-22T01:35:31.660 INFO:teuthology.orchestra.run.smithi018.stdout:1690 writesame 0x41fbce0 thru 0x4208a96 data_size 0x1(0xcdb7 bytes) 2024-09-22T01:35:31.673 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:31.669+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:31.725 INFO:teuthology.orchestra.run.smithi018.stdout:1691 read 0x3d66086 thru 0x3d6685a (0x7d5 bytes) 2024-09-22T01:35:31.729 INFO:teuthology.orchestra.run.smithi018.stdout:1695 trunc from 0xb86048a to 0xd66b411 2024-09-22T01:35:31.740 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:31.740 INFO:teuthology.orchestra.run.smithi018.stdout:1701 read 0x6ec374a thru 0x6ec3b1a (0x3d1 bytes) 2024-09-22T01:35:31.740 INFO:teuthology.orchestra.run.smithi018.stdout:1702 punch from 0x38ab6a8 to 0x38b9c66, (0xe5be bytes) 2024-09-22T01:35:31.754 INFO:teuthology.orchestra.run.smithi018.stdout:1703 writesame 0xe6404b4 thru 0xe642db6 data_size 0x1(0x2903 bytes) 2024-09-22T01:35:31.755 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:31.764 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:31.764 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:31.766 INFO:teuthology.orchestra.run.smithi018.stdout:1707 trunc from 0xe642db7 to 0x976d66c 2024-09-22T01:35:31.774 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:31.772+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:31.782 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:31.813 INFO:teuthology.orchestra.run.smithi018.stdout:1708 write 0xc0602aa thru 0xc06ec7f (0xe9d6 bytes) 2024-09-22T01:35:31.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:35:31.875 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:31.872+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:31.946 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:31.947 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:31.961 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:31.976 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:31.972+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:32.077 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:32.073+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:32.082 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:32.096 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:32.184 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:32.181+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:32.264 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:32.264 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:32.278 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:32.279 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:32.273+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:32.379 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:32.376+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:32.451 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:32.452 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:32.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:32.516 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:32.513+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:32.582 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:32.580+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:32.592 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:32.592 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:32.606 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:32.682 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:32.680+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:32.740 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:32.741 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:32.754 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:32.798 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:32.796+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:32.834 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:35:32.847 INFO:teuthology.orchestra.run.smithi018.stdout:1709 write 0x181441b thru 0x1815312 (0xef8 bytes) 2024-09-22T01:35:32.884 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:32.880+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:32.946 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:32.946 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:32.961 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:33.006 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:33.004+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:33.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:33.057 INFO:teuthology.orchestra.run.smithi018.stdout:1710 read 0x2016a2d thru 0x2021bba (0xb18e bytes) 2024-09-22T01:35:33.063 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:33.066 INFO:teuthology.orchestra.run.smithi018.stdout:1714 trunc from 0xc06ec80 to 0xb18812a 2024-09-22T01:35:33.082 INFO:teuthology.orchestra.run.smithi018.stdout:1715 write 0x9f0307e thru 0x9f0df31 (0xaeb4 bytes) 2024-09-22T01:35:33.085 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:33.080+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:33.101 INFO:teuthology.orchestra.run.smithi018.stdout:1716 writesame 0x1a68655 thru 0x1a697ab data_size 0x1(0x1157 bytes) 2024-09-22T01:35:33.163 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:33.163 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:33.181 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:33.185 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:33.181+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:33.217 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:33.217 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:33.233 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:33.233 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:33.251 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:33.251 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:33.268 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:33.269 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:33.286 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:33.284+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:33.286 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:33.286 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:33.297 INFO:teuthology.orchestra.run.smithi018.stdout:1717 trunc from 0xb18812a to 0x2db0426 2024-09-22T01:35:33.307 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:33.307 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:33.330 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:33.330 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:33.330 INFO:teuthology.orchestra.run.smithi018.stdout:1718 trunc from 0x2db0426 to 0x7a2674 2024-09-22T01:35:33.351 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:33.352 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:33.359 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:33.360 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:33.360 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:33.360 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:33.375 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:33.415 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:33.413+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:33.488 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:33.485+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:33.550 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:33.550 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:33.550 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:33.551 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:33.551 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:33.564 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:33.589 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:33.585+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:33.689 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:33.688+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:33.693 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:33.693 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:33.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:33.693 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:33.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.693 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:5372 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:33.693 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:00.125466+0000", 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 33.566131552000002, 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.060015348000000003, 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 5372 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125466+0000", 2024-09-22T01:35:33.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125466+0000", 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125468+0000", 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9999999999999999e-06 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125481+0000", 2024-09-22T01:35:33.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2965e-05 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125512+0000", 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1387999999999998e-05 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125528+0000", 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5875e-05 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125711+0000", 2024-09-22T01:35:33.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018251300000000001 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125849+0000", 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013890199999999999 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.135810+0000", 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.009960989 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:33.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185297+0000", 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049486143000000003 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185358+0000", 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0952999999999997e-05 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185423+0000", 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5665000000000002e-05 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185481+0000", 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7955000000000003e-05 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15848 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 802816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.368378863, 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048543573999999999, 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15848 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2200000000000003e-07 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323225+0000", 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2060000000000004e-06 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323233+0000", 2024-09-22T01:35:33.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.114e-06 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323238+0000", 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4269999999999999e-06 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371630+0000", 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048391548 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371685+0000", 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5764999999999999e-05 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371762+0000", 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6792000000000006e-05 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15849 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 813056~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.368352344000002, 2024-09-22T01:35:33.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048740787000000001, 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15849 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2300000000000002e-07 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323247+0000", 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.996e-06 2024-09-22T01:35:33.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323255+0000", 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8189999999999992e-06 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323261+0000", 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2390000000000002e-06 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371802+0000", 2024-09-22T01:35:33.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048541859999999999 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371888+0000", 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5841999999999996e-05 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371986+0000", 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7608000000000005e-05 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15850 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 987136~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323267+0000", 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.368329996, 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048897709999999997, 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15850 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323267+0000", 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323267+0000", 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323268+0000", 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7100000000000002e-07 2024-09-22T01:35:33.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323270+0000", 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1789999999999998e-06 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323277+0000", 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4869999999999999e-06 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323281+0000", 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8919999999999999e-06 2024-09-22T01:35:33.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372025+0000", 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048743109999999999 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372100+0000", 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5706999999999999e-05 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372165+0000", 2024-09-22T01:35:33.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4863999999999994e-05 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15851 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 997376~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.36830947, 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049107096000000003, 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.712 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15851 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5499999999999999e-07 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323291+0000", 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.323e-06 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323300+0000", 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7389999999999994e-06 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323306+0000", 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2979999999999999e-06 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372204+0000", 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048898832000000003 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372294+0000", 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9517000000000004e-05 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372395+0000", 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101032 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15856 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 106496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323312+0000", 2024-09-22T01:35:33.716 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.368285225000001, 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049274633999999998, 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15856 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323312+0000", 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323312+0000", 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323313+0000", 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1699999999999999e-07 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323315+0000", 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1239999999999999e-06 2024-09-22T01:35:33.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323321+0000", 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3470000000000004e-06 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323326+0000", 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0259999999999998e-06 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372436+0000", 2024-09-22T01:35:33.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049109450999999998 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372504+0000", 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8499999999999998e-05 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372587+0000", 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2769000000000007e-05 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15857 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 280576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323333+0000", 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.36826435, 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049491571999999998, 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15857 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323333+0000", 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323333+0000", 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326605+0000", 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032723959999999999 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326610+0000", 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0929999999999996e-06 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326623+0000", 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3885e-05 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326629+0000", 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7069999999999997e-06 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372623+0000", 2024-09-22T01:35:33.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.045994150999999997 2024-09-22T01:35:33.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372725+0000", 2024-09-22T01:35:33.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000102135 2024-09-22T01:35:33.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372825+0000", 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9204999999999996e-05 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15874 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 485376~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326789+0000", 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.364807931000001, 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048542634000000001, 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.726 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15874 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326789+0000", 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326789+0000", 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326790+0000", 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2300000000000002e-07 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326791+0000", 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2500000000000001e-06 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326797+0000", 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3730000000000001e-06 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326801+0000", 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8409999999999999e-06 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375143+0000", 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048341692999999998 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375232+0000", 2024-09-22T01:35:33.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8782000000000005e-05 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375332+0000", 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100272 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15875 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 659456~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326808+0000", 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.364789381000001, 2024-09-22T01:35:33.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048705257000000002, 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15875 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326808+0000", 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326808+0000", 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326809+0000", 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6199999999999998e-07 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326811+0000", 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.074e-06 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326817+0000", 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4350000000000002e-06 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326822+0000", 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.938e-06 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375366+0000", 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048543513000000003 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375444+0000", 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8384e-05 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375513+0000", 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9350999999999994e-05 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15876 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 669696~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326843+0000", 2024-09-22T01:35:33.734 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.36475428, 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048891241000000002, 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15876 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326843+0000", 2024-09-22T01:35:33.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326843+0000", 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326844+0000", 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326846+0000", 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4260000000000002e-06 2024-09-22T01:35:33.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326859+0000", 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326865+0000", 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.998e-06 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375553+0000", 2024-09-22T01:35:33.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048687268999999998 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375638+0000", 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4851000000000005e-05 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375734+0000", 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6779000000000003e-05 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.738 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15877 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 843776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.364723507000001, 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049047570999999998, 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15877 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:33.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5999999999999999e-07 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326877+0000", 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3700000000000002e-06 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326884+0000", 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2649999999999999e-06 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326891+0000", 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0809999999999996e-06 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375776+0000", 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048885021000000001 2024-09-22T01:35:33.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375840+0000", 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3496000000000003e-05 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375921+0000", 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1878000000000004e-05 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15878 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 1028096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326898+0000", 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.364699014999999, 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049240253999999997, 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15878 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.743 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326898+0000", 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326898+0000", 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326899+0000", 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2500000000000001e-07 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326901+0000", 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2180000000000002e-06 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326916+0000", 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5294999999999998e-05 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326922+0000", 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0299999999999999e-06 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375957+0000", 2024-09-22T01:35:33.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049034873999999999 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376044+0000", 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6496999999999995e-05 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376139+0000", 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4914999999999995e-05 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.746 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15879 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 1017856~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326931+0000", 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.364666660000001, 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049385907, 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15879 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.747 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326931+0000", 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326931+0000", 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330840+0000", 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039091799999999999 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330847+0000", 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.289e-06 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330859+0000", 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2101e-05 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330867+0000", 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0180000000000001e-06 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376178+0000", 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.045310797999999999 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376240+0000", 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1863e-05 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376317+0000", 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6657999999999997e-05 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.750 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15903 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 690176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.360356832000001, 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048413610000000003, 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15903 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.751 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331243+0000", 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5059999999999998e-06 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331261+0000", 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7768e-05 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331267+0000", 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0070000000000003e-06 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.753 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379464+0000", 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048196992000000001 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379552+0000", 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7756000000000005e-05 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379654+0000", 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010214500000000001 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.754 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15904 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 700416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.360321880000001, 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048631483000000003, 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15904 2024-09-22T01:35:33.755 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5600000000000001e-07 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331279+0000", 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.717e-06 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331286+0000", 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2099999999999996e-06 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331292+0000", 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6319999999999996e-06 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379689+0000", 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048397554000000002 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379792+0000", 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010319699999999999 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.758 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379907+0000", 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011471700000000001 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15905 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 874496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.360298567000001, 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048758479, 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.759 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15905 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.760 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331302+0000", 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.497e-06 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331315+0000", 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3684e-05 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331321+0000", 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379946+0000", 2024-09-22T01:35:33.762 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048624779 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379998+0000", 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2303999999999999e-05 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380057+0000", 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9021000000000003e-05 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.763 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15911 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 167936~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331351+0000", 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.360246201999999, 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048937877999999997, 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15911 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.764 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331351+0000", 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331351+0000", 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331352+0000", 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.75e-07 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.765 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331355+0000", 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.112e-06 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331363+0000", 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0930000000000003e-06 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331369+0000", 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7760000000000003e-06 2024-09-22T01:35:33.766 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380104+0000", 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048735140000000003 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380199+0000", 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4844000000000002e-05 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380289+0000", 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0338000000000001e-05 2024-09-22T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15912 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 178176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.360220602999998, 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049071042000000002, 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.768 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15912 2024-09-22T01:35:33.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.769 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:33.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1600000000000001e-07 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331380+0000", 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819999999999998e-06 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.770 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331394+0000", 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4239e-05 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331399+0000", 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2159999999999997e-06 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380338+0000", 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048938447000000003 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380389+0000", 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1635000000000003e-05 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380448+0000", 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8607000000000003e-05 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15913 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 352256~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:33.772 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.360190368000001, 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049229644000000003, 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15913 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8599999999999999e-07 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331410+0000", 2024-09-22T01:35:33.774 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.858e-06 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331418+0000", 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.267e-06 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331423+0000", 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.519e-06 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380485+0000", 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049061912999999999 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380542+0000", 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7522000000000003e-05 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380637+0000", 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4178999999999994e-05 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15914 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 526336~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331430+0000", 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.360166922000001, 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049386494000000003, 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15914 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:33.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331430+0000", 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331430+0000", 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334567+0000", 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031364790000000002 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334573+0000", 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5429999999999999e-06 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334589+0000", 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5488000000000001e-05 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334598+0000", 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2620000000000004e-06 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380677+0000", 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.046078612999999997 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380728+0000", 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1232e-05 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380817+0000", 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8876999999999996e-05 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.780 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:33.781 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:33.781 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:33.781 INFO:teuthology.orchestra.run.smithi018.stdout:1719 write 0x60a56ed thru 0x60b1b52 (0xc466 bytes) 2024-09-22T01:35:33.782 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:33.791 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:33.785+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:33.792 INFO:teuthology.orchestra.run.smithi018.stdout:1720 write 0x6cae7a0 thru 0x6cbca5a (0xe2bb bytes) 2024-09-22T01:35:33.811 INFO:teuthology.orchestra.run.smithi018.stdout:1721 read 0x26b2513 thru 0x26bcbf0 (0xa6de bytes) 2024-09-22T01:35:33.838 INFO:teuthology.orchestra.run.smithi018.stdout:1722 write 0xd3b69d0 thru 0xd3b8d79 (0x23aa bytes) 2024-09-22T01:35:33.854 INFO:teuthology.orchestra.run.smithi018.stdout:1723 punch from 0xbb1b8c6 to 0xbb24d64, (0x949e bytes) 2024-09-22T01:35:33.854 INFO:teuthology.orchestra.run.smithi018.stdout:1725 read 0xc4902c0 thru 0xc49a8e6 (0xa627 bytes) 2024-09-22T01:35:33.864 INFO:teuthology.orchestra.run.smithi018.stdout:1726 writesame 0xdea9fc9 thru 0xdeb91ee data_size 0x5(0xf226 bytes) 2024-09-22T01:35:33.864 INFO:teuthology.orchestra.run.smithi018.stdout:1729 writesame 0xd8397e8 thru 0xd83ff12 data_size 0xb(0x672b bytes) 2024-09-22T01:35:33.875 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7] out_osds: [2, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:33.875 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:35:33.876 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-22T01:35:33.876 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 1.000000 2024-09-22T01:35:33.876 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-22T01:35:33.882 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:33.882 INFO:teuthology.orchestra.run.smithi018.stdout:1732 write 0x2b10d26 thru 0x2b1ca30 (0xbd0b bytes) 2024-09-22T01:35:33.891 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:33.888+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:33.903 INFO:teuthology.orchestra.run.smithi018.stdout:1734 trunc from 0xdeb91ef to 0xca5746f 2024-09-22T01:35:33.922 INFO:teuthology.orchestra.run.smithi018.stdout:1735 read 0x677a206 thru 0x6789c83 (0xfa7e bytes) 2024-09-22T01:35:33.922 INFO:teuthology.orchestra.run.smithi018.stdout:1736 read 0x7c4102a thru 0x7c4198c (0x963 bytes) 2024-09-22T01:35:33.944 INFO:teuthology.orchestra.run.smithi018.stdout:1737 trunc from 0xca5746f to 0x3ae456c 2024-09-22T01:35:33.969 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:33.969 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:33.969 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:33.969 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:33.983 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:33.988 INFO:teuthology.orchestra.run.smithi018.stdout:1741 writesame 0x8e1db80 thru 0x8e274c1 data_size 0xd(0x9942 bytes) 2024-09-22T01:35:33.988 INFO:teuthology.orchestra.run.smithi018.stdout:1743 punch from 0x6138b0d to 0x6145b91, (0xd084 bytes) 2024-09-22T01:35:33.988 INFO:teuthology.orchestra.run.smithi018.stdout:1745 read 0xa8bead thru 0xa8c3d5 (0x529 bytes) 2024-09-22T01:35:33.989 INFO:teuthology.orchestra.run.smithi018.stdout:1746 write 0x4da4930 thru 0x4daa7a2 (0x5e73 bytes) 2024-09-22T01:35:34.015 INFO:teuthology.orchestra.run.smithi018.stdout:1747 trunc from 0x8e274c2 to 0x6282858 2024-09-22T01:35:34.023 INFO:teuthology.orchestra.run.smithi018.stdout:1748 punch from 0x72c59a to 0x735d42, (0x97a8 bytes) 2024-09-22T01:35:34.026 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:34.024+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:34.044 INFO:teuthology.orchestra.run.smithi018.stdout:1749 write 0xe2b69b7 thru 0xe2bafce (0x4618 bytes) 2024-09-22T01:35:34.061 INFO:teuthology.orchestra.run.smithi018.stdout:1751 writesame 0x344a4cc thru 0x344ea27 data_size 0x2e(0x455c bytes) 2024-09-22T01:35:34.079 INFO:teuthology.orchestra.run.smithi018.stdout:1752 read 0xebba64 thru 0xec6a27 (0xafc4 bytes) 2024-09-22T01:35:34.079 INFO:teuthology.orchestra.run.smithi018.stdout:1754 read 0xc647e06 thru 0xc648edc (0x10d7 bytes) 2024-09-22T01:35:34.079 INFO:teuthology.orchestra.run.smithi018.stdout:1755 writesame 0x10680e8 thru 0x106a156 data_size 0x13(0x206f bytes) 2024-09-22T01:35:34.091 INFO:teuthology.orchestra.run.smithi018.stdout:1756 punch from 0x3dfca2b to 0x3e0b7e6, (0xedbb bytes) 2024-09-22T01:35:34.093 INFO:teuthology.orchestra.run.smithi018.stdout:1758 trunc from 0xe2bafcf to 0xcea904f 2024-09-22T01:35:34.093 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:34.088+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:34.106 INFO:teuthology.orchestra.run.smithi018.stdout:1759 read 0x1a6d520 thru 0x1a6e448 (0xf29 bytes) 2024-09-22T01:35:34.106 INFO:teuthology.orchestra.run.smithi018.stdout:1760 write 0x6f76760 thru 0x6f7daf0 (0x7391 bytes) 2024-09-22T01:35:34.122 INFO:teuthology.orchestra.run.smithi018.stdout:1761 write 0xaff7ef1 thru 0xb0049ed (0xcafd bytes) 2024-09-22T01:35:34.142 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:34.142 INFO:teuthology.orchestra.run.smithi018.stdout:1763 read 0x7f71151 thru 0x7f7d950 (0xc800 bytes) 2024-09-22T01:35:34.142 INFO:teuthology.orchestra.run.smithi018.stdout:1765 write 0x1ccd410 thru 0x1cdc98d (0xf57e bytes) 2024-09-22T01:35:34.173 INFO:teuthology.orchestra.run.smithi018.stdout:1766 write 0xdaa4091 thru 0xdaad9f2 (0x9962 bytes) 2024-09-22T01:35:34.179 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:34.179 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:34.180 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:34.180 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:34.180 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:34.191 INFO:teuthology.orchestra.run.smithi018.stdout:1768 read 0x268b495 thru 0x269698c (0xb4f8 bytes) 2024-09-22T01:35:34.191 INFO:teuthology.orchestra.run.smithi018.stdout:1769 writesame 0x2340fdd thru 0x234fc9d data_size 0x3(0xecc1 bytes) 2024-09-22T01:35:34.194 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:34.192+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:34.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:34.213 INFO:teuthology.orchestra.run.smithi018.stdout:1770 clone 16 order 18 su 65536 sc 10 2024-09-22T01:35:34.295 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:34.289+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:34.363 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2850193479999996, 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.364 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:34.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2849823200000001, 2024-09-22T01:35:34.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:35:34.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2734318599999996, 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2733978529999996, 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.377 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:35:34.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:35:34.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.380 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2695305030000004, 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.381 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2694849550000002, 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:35:34.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2694397469999998, 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.389 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:35:34.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:35:34.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2694051550000003, 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:35:34.396 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2693715069999998, 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:35:34.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:35:34.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.400 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2656420170000002, 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.401 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:35:34.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2656055139999998, 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.406 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2655608750000003, 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.410 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.412 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2655106490000003, 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.416 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2654722070000002, 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.420 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2654282119999998, 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.424 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2653890619999997, 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:35:34.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:35:34.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:35:34.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:35:34.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2615458940000002, 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.429 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:35:34.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:35:34.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.2614655680000002, 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:35:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 5.5569122719999999, 2024-09-22T01:35:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:35:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:35:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:35:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4.5627707040000001, 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:35:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.448 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:34.449 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:34.449 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:34.444+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:34.549 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:34.548+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:34.614 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:34.615 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:34.615 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:34.615 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:34.628 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:34.650 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:34.645+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:34.751 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:34.748+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:34.792 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:34.792 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:34.792 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:34.792 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:34.792 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:34.806 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-22T01:35:34.851 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:34.845+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:34.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:35:34.952 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:34.948+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:34.975 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone15 from 0xdaad9f3 (overlap 0x7a2674) to 0x61b85c 2024-09-22T01:35:34.983 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:34.983 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 61.672936295, 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:34.984 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:34.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.142163599, 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.990 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.992 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:34.994 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.141936318999999, 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:34.998 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.138768034999998, 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:34.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:35.002 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.138683771, 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:35.006 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.138632274999999, 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:35:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:35:35.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.138586955000001, 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.011 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:35:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:35:35.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.135106698000001, 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.015 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.134801886000002, 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.019 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:35:35.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:35:35.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.134752442, 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.134707888000001, 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.027 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.134664237999999, 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.031 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.134617017, 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.035 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:35:35.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.134422011000002, 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:35.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:35:35.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.134372524, 2024-09-22T01:35:35.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:35.047 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.131221464999999, 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:35.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:35.051 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.130875837000001, 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.130780414, 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:35.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.058 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.130727834999998, 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:35:35.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:35:35.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:35:35.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 30.130686067999999, 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:35.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:35.066 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:35.067 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:35.064+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:35.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:35.137 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-22T01:35:35.139 INFO:teuthology.orchestra.run.smithi018.stdout:1771 read 0x164e506 thru 0x16501d5 (0x1cd0 bytes) 2024-09-22T01:35:35.140 INFO:teuthology.orchestra.run.smithi018.stdout:1772 read 0x1a49019 thru 0x1a55cc2 (0xccaa bytes) 2024-09-22T01:35:35.141 INFO:teuthology.orchestra.run.smithi018.stdout:1774 writesame 0x4cc9c74 thru 0x4cccb35 data_size 0x5(0x2ec2 bytes) 2024-09-22T01:35:35.155 INFO:teuthology.orchestra.run.smithi018.stdout:1776 punch from 0x223e0d3 to 0x223fd57, (0x1c84 bytes) 2024-09-22T01:35:35.158 INFO:teuthology.orchestra.run.smithi018.stdout:1777 trunc from 0xdaad9f3 to 0xb6ce78e 2024-09-22T01:35:35.168 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:35.165+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:35.175 INFO:teuthology.orchestra.run.smithi018.stdout:1778 write 0x52e2766 thru 0x52e7b43 (0x53de bytes) 2024-09-22T01:35:35.180 INFO:teuthology.orchestra.run.smithi018.stdout:1780 read 0x103088a thru 0x1031726 (0xe9d bytes) 2024-09-22T01:35:35.186 INFO:teuthology.orchestra.run.smithi018.stdout:1781 trunc from 0xb6ce78e to 0xdf434c6 2024-09-22T01:35:35.194 INFO:teuthology.orchestra.run.smithi018.stdout:1783 write 0x6e5275f thru 0x6e5e1a0 (0xba42 bytes) 2024-09-22T01:35:35.200 INFO:teuthology.orchestra.run.smithi018.stdout:1784 writesame 0xca3866a thru 0xca46bab data_size 0x5(0xe542 bytes) 2024-09-22T01:35:35.202 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:35.202 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:35.202 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:35.202 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:35.212 INFO:teuthology.orchestra.run.smithi018.stdout:1785 punch from 0x31d6afc to 0x31e29d8, (0xbedc bytes) 2024-09-22T01:35:35.212 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.212 INFO:teuthology.orchestra.run.smithi018.stdout:1791 punch from 0xb83f155 to 0xb844423, (0x52ce bytes) 2024-09-22T01:35:35.212 INFO:teuthology.orchestra.run.smithi018.stdout:1795 write 0x237bb7d thru 0x2382f29 (0x73ad bytes) 2024-09-22T01:35:35.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:35.221 INFO:teuthology.orchestra.run.smithi018.stdout:1797 writesame 0xb257d0 thru 0xb29170 data_size 0x1(0x39a1 bytes) 2024-09-22T01:35:35.237 INFO:teuthology.orchestra.run.smithi018.stdout:1798 writesame 0x813e3b6 thru 0x8140c47 data_size 0x9(0x2892 bytes) 2024-09-22T01:35:35.245 INFO:teuthology.orchestra.run.smithi018.stdout:1799 punch from 0xcf4d3cf to 0xcf5ad72, (0xd9a3 bytes) 2024-09-22T01:35:35.245 INFO:teuthology.orchestra.run.smithi018.stdout:1800 read 0x4e47226 thru 0x4e47a78 (0x853 bytes) 2024-09-22T01:35:35.245 INFO:teuthology.orchestra.run.smithi018.stdout:1801 read 0xd753e37 thru 0xd75fe09 (0xbfd3 bytes) 2024-09-22T01:35:35.245 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.245 INFO:teuthology.orchestra.run.smithi018.stdout:1804 write 0x437dc3e thru 0x438c877 (0xec3a bytes) 2024-09-22T01:35:35.252 INFO:teuthology.orchestra.run.smithi018.stdout:1805 read 0x9581ad3 thru 0x959060a (0xeb38 bytes) 2024-09-22T01:35:35.252 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.252 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.252 INFO:teuthology.orchestra.run.smithi018.stdout:1808 read 0x2737c22 thru 0x2741142 (0x9521 bytes) 2024-09-22T01:35:35.258 INFO:teuthology.orchestra.run.smithi018.stdout:1809 trunc from 0xdf434c6 to 0xad10c8e 2024-09-22T01:35:35.269 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:35.268+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:35.299 INFO:teuthology.orchestra.run.smithi018.stdout:1812 read 0x954cc18 thru 0x9556648 (0x9a31 bytes) 2024-09-22T01:35:35.299 INFO:teuthology.orchestra.run.smithi018.stdout:1815 read 0x73d81d2 thru 0x73e0226 (0x8055 bytes) 2024-09-22T01:35:35.299 INFO:teuthology.orchestra.run.smithi018.stdout:1816 write 0x2f02037 thru 0x2f0e294 (0xc25e bytes) 2024-09-22T01:35:35.304 INFO:teuthology.orchestra.run.smithi018.stdout:1817 read 0x7eb9171 thru 0x7ec6145 (0xcfd5 bytes) 2024-09-22T01:35:35.304 INFO:teuthology.orchestra.run.smithi018.stdout:1820 punch from 0x5c33868 to 0x5c4120a, (0xd9a2 bytes) 2024-09-22T01:35:35.304 INFO:teuthology.orchestra.run.smithi018.stdout:1823 writesame 0xa8ce8af thru 0xa8d4174 data_size 0xb(0x58c6 bytes) 2024-09-22T01:35:35.321 INFO:teuthology.orchestra.run.smithi018.stdout:1824 write 0xc6b0067 thru 0xc6ba18b (0xa125 bytes) 2024-09-22T01:35:35.327 INFO:teuthology.orchestra.run.smithi018.stdout:1825 read 0x4ba65e2 thru 0x4bb1476 (0xae95 bytes) 2024-09-22T01:35:35.348 INFO:teuthology.orchestra.run.smithi018.stdout:1826 trunc from 0xc6ba18c to 0x6101cc 2024-09-22T01:35:35.364 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:35.364 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:35.364 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:35.364 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:35.364 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:35.371 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:35.365+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:35.371 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:35.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:35.437 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.437 INFO:teuthology.orchestra.run.smithi018.stdout:1829 read 0x1033d5 thru 0x10e62a (0xb256 bytes) 2024-09-22T01:35:35.451 INFO:teuthology.orchestra.run.smithi018.stdout:1830 punch from 0x23f251 to 0x24d0d9, (0xde88 bytes) 2024-09-22T01:35:35.471 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:35.468+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:35.479 INFO:teuthology.orchestra.run.smithi018.stdout:1831 write 0xedd8ca3 thru 0xede8301 (0xf65f bytes) 2024-09-22T01:35:35.506 INFO:teuthology.orchestra.run.smithi018.stdout:1832 trunc from 0xede8302 to 0xc059c6 2024-09-22T01:35:35.521 INFO:teuthology.orchestra.run.smithi018.stdout:1833 read 0x351a42 thru 0x358284 (0x6843 bytes) 2024-09-22T01:35:35.532 INFO:teuthology.orchestra.run.smithi018.stdout:1835 write 0x1843e32 thru 0x184b7ac (0x797b bytes) 2024-09-22T01:35:35.538 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:35.539 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:35.563 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:35.564 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:35.565 INFO:teuthology.orchestra.run.smithi018.stdout:1836 writesame 0xd3f8e4a thru 0xd400b97 data_size 0x2b(0x7d4e bytes) 2024-09-22T01:35:35.565 INFO:teuthology.orchestra.run.smithi018.stdout:1838 read 0xe592ba thru 0xe5cbbd (0x3904 bytes) 2024-09-22T01:35:35.567 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:35.568 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:35.572 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:35.569+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:35.574 INFO:teuthology.orchestra.run.smithi018.stdout:1839 write 0xe130233 thru 0xe13d24d (0xd01b bytes) 2024-09-22T01:35:35.580 INFO:teuthology.orchestra.run.smithi018.stdout:1840 writesame 0xb1c44ff thru 0xb1c6539 data_size 0x1(0x203b bytes) 2024-09-22T01:35:35.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:35.586 INFO:teuthology.orchestra.run.smithi018.stdout:1841 punch from 0x9c0c147 to 0x9c1bf16, (0xfdcf bytes) 2024-09-22T01:35:35.586 INFO:teuthology.orchestra.run.smithi018.stdout:1842 read 0xa2be66f thru 0xa2c54b0 (0x6e42 bytes) 2024-09-22T01:35:35.586 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.587 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.587 INFO:teuthology.orchestra.run.smithi018.stdout:1847 writesame 0xd3f8340 thru 0xd40341b data_size 0x16(0xb0dc bytes) 2024-09-22T01:35:35.588 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:35.588 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:35.592 INFO:teuthology.orchestra.run.smithi018.stdout:1848 write 0x6cda04a thru 0x6cdef92 (0x4f49 bytes) 2024-09-22T01:35:35.597 INFO:teuthology.orchestra.run.smithi018.stdout:1851 write 0x3b2ea79 thru 0x3b30c2e (0x21b6 bytes) 2024-09-22T01:35:35.603 INFO:teuthology.orchestra.run.smithi018.stdout:1852 punch from 0x6fc98b3 to 0x6fced36, (0x5483 bytes) 2024-09-22T01:35:35.603 INFO:teuthology.orchestra.run.smithi018.stdout:1853 punch from 0x6001e0e to 0x6007515, (0x5707 bytes) 2024-09-22T01:35:35.608 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:35.608 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:35.620 INFO:teuthology.orchestra.run.smithi018.stdout:1854 trunc from 0xe13d24e to 0x1e68444 2024-09-22T01:35:35.631 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:35.632 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:35.653 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:35.653 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:35.662 INFO:teuthology.orchestra.run.smithi018.stdout:1855 write 0xeb88946 thru 0xeb939c1 (0xb07c bytes) 2024-09-22T01:35:35.669 INFO:teuthology.orchestra.run.smithi018.stdout:1858 punch from 0x3460de7 to 0x34693df, (0x85f8 bytes) 2024-09-22T01:35:35.669 INFO:teuthology.orchestra.run.smithi018.stdout:1859 read 0xebff51 thru 0xec031e (0x3ce bytes) 2024-09-22T01:35:35.669 INFO:teuthology.orchestra.run.smithi018.stdout:1860 writesame 0x90d6761 thru 0x90dd917 data_size 0x1(0x71b7 bytes) 2024-09-22T01:35:35.673 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:35.669+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:35.676 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:35.676 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:35.687 INFO:teuthology.orchestra.run.smithi018.stdout:1862 read 0x68a3571 thru 0x68ae04c (0xaadc bytes) 2024-09-22T01:35:35.687 INFO:teuthology.orchestra.run.smithi018.stdout:1863 writesame 0x241ccc6 thru 0x2427688 data_size 0x1(0xa9c3 bytes) 2024-09-22T01:35:35.699 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:35.699 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:35.718 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:35.718 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:35.732 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:35.735 INFO:teuthology.orchestra.run.smithi018.stdout:1864 read 0xb8a7d45 thru 0xb8b2a0a (0xacc6 bytes) 2024-09-22T01:35:35.735 INFO:teuthology.orchestra.run.smithi018.stdout:1867 write 0x1567304 thru 0x156cd77 (0x5a74 bytes) 2024-09-22T01:35:35.739 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.739 INFO:teuthology.orchestra.run.smithi018.stdout:1869 writesame 0xf5d039 thru 0xf62331 data_size 0x1(0x52f9 bytes) 2024-09-22T01:35:35.761 INFO:teuthology.orchestra.run.smithi018.stdout:1871 write 0xb5b16a thru 0xb6b0e7 (0xff7e bytes) 2024-09-22T01:35:35.773 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:35.772+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:35.782 INFO:teuthology.orchestra.run.smithi018.stdout:1872 trunc from 0xeb939c2 to 0x624ca42 2024-09-22T01:35:35.813 INFO:teuthology.orchestra.run.smithi018.stdout:1873 write 0xb7eb875 thru 0xb7f6865 (0xaff1 bytes) 2024-09-22T01:35:35.820 INFO:teuthology.orchestra.run.smithi018.stdout:1874 punch from 0x25491d9 to 0x2555564, (0xc38b bytes) 2024-09-22T01:35:35.820 INFO:teuthology.orchestra.run.smithi018.stdout:1875 read 0x8dbc3a7 thru 0x8dc76d7 (0xb331 bytes) 2024-09-22T01:35:35.827 INFO:teuthology.orchestra.run.smithi018.stdout:1877 trunc from 0xb7f6866 to 0x6ec84fd 2024-09-22T01:35:35.843 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.843 INFO:teuthology.orchestra.run.smithi018.stdout:1879 read 0x22ed0cd thru 0x22f0acf (0x3a03 bytes) 2024-09-22T01:35:35.843 INFO:teuthology.orchestra.run.smithi018.stdout:1880 write 0x697d28a thru 0x697ff9f (0x2d16 bytes) 2024-09-22T01:35:35.849 INFO:teuthology.orchestra.run.smithi018.stdout:1883 punch from 0x5fe98f3 to 0x5ff2aa8, (0x91b5 bytes) 2024-09-22T01:35:35.856 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:35:35.862 INFO:teuthology.orchestra.run.smithi018.stdout:1884 write 0x7c405f1 thru 0x7c4fbf8 (0xf608 bytes) 2024-09-22T01:35:35.870 INFO:teuthology.orchestra.run.smithi018.stdout:1885 write 0x150181b thru 0x150638d (0x4b73 bytes) 2024-09-22T01:35:35.874 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:35.872+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:35.874 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.875 INFO:teuthology.orchestra.run.smithi018.stdout:1887 punch from 0x752725e to 0x7534113, (0xceb5 bytes) 2024-09-22T01:35:35.875 INFO:teuthology.orchestra.run.smithi018.stdout:1889 trunc from 0x7c4fbf9 to 0x856755d 2024-09-22T01:35:35.883 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.883 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:35.883 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:35.894 INFO:teuthology.orchestra.run.smithi018.stdout:1891 write 0xab8d7d6 thru 0xab94c08 (0x7433 bytes) 2024-09-22T01:35:35.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:35.904 INFO:teuthology.orchestra.run.smithi018.stdout:1894 read 0xa684337 thru 0xa685736 (0x1400 bytes) 2024-09-22T01:35:35.916 INFO:teuthology.orchestra.run.smithi018.stdout:1895 writesame 0xd9fccf8 thru 0xda07fee data_size 0x77(0xb2f7 bytes) 2024-09-22T01:35:35.916 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.920 INFO:teuthology.orchestra.run.smithi018.stdout:1898 trunc from 0xda07fef to 0xaaee848 2024-09-22T01:35:35.931 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:35.935 INFO:teuthology.orchestra.run.smithi018.stdout:1901 trunc from 0xaaee848 to 0xd8b9c4f 2024-09-22T01:35:35.953 INFO:teuthology.orchestra.run.smithi018.stdout:1902 trunc from 0xd8b9c4f to 0x6eb1ab1 2024-09-22T01:35:35.967 INFO:teuthology.orchestra.run.smithi018.stdout:1903 punch from 0x34db91c to 0x34e5694, (0x9d78 bytes) 2024-09-22T01:35:35.967 INFO:teuthology.orchestra.run.smithi018.stdout:1904 writesame 0x21d1a8 thru 0x22037e data_size 0x1(0x31d7 bytes) 2024-09-22T01:35:35.974 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:35.972+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:36.039 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:36.040 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:36.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:36.075 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:36.072+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:36.176 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:36.172+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:36.227 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:36.227 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:36.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:36.277 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:36.272+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:36.288 INFO:teuthology.orchestra.run.smithi018.stdout:1907 writesame 0xa60cffa thru 0xa618c5f data_size 0x82(0xbc66 bytes) 2024-09-22T01:35:36.288 INFO:teuthology.orchestra.run.smithi018.stdout:1908 read 0x142347a thru 0x1431d38 (0xe8bf bytes) 2024-09-22T01:35:36.289 INFO:teuthology.orchestra.run.smithi018.stdout:1909 punch from 0x4e6ea03 to 0x4e7d9bd, (0xefba bytes) 2024-09-22T01:35:36.299 INFO:teuthology.orchestra.run.smithi018.stdout:1911 writesame 0xba608b0 thru 0xba6d6e5 data_size 0x5(0xce36 bytes) 2024-09-22T01:35:36.300 INFO:teuthology.orchestra.run.smithi018.stdout:1913 writesame 0x8c70a3e thru 0x8c7e3ad data_size 0x8e(0xd970 bytes) 2024-09-22T01:35:36.305 INFO:teuthology.orchestra.run.smithi018.stdout:1914 read 0xa2afc0e thru 0xa2b91c6 (0x95b9 bytes) 2024-09-22T01:35:36.305 INFO:teuthology.orchestra.run.smithi018.stdout:1916 writesame 0x519efbc thru 0x51a8281 data_size 0x1(0x92c6 bytes) 2024-09-22T01:35:36.345 INFO:teuthology.orchestra.run.smithi018.stdout:1917 writesame 0xc0f2466 thru 0xc0f7605 data_size 0x10(0x51a0 bytes) 2024-09-22T01:35:36.345 INFO:teuthology.orchestra.run.smithi018.stdout:1919 read 0x7728fd7 thru 0x772b16f (0x2199 bytes) 2024-09-22T01:35:36.345 INFO:teuthology.orchestra.run.smithi018.stdout:1921 punch from 0x59f14a4 to 0x59f7c92, (0x67ee bytes) 2024-09-22T01:35:36.345 INFO:teuthology.orchestra.run.smithi018.stdout:1924 write 0x38b83eb thru 0x38c4b23 (0xc739 bytes) 2024-09-22T01:35:36.355 INFO:teuthology.orchestra.run.smithi018.stdout:1925 read 0x179e8ae thru 0x17aab06 (0xc259 bytes) 2024-09-22T01:35:36.356 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:36.356 INFO:teuthology.orchestra.run.smithi018.stdout:1929 read 0xb9ea246 thru 0xb9f9bf2 (0xf9ad bytes) 2024-09-22T01:35:36.356 INFO:teuthology.orchestra.run.smithi018.stdout:1931 read 0xa1d9279 thru 0xa1e4136 (0xaebe bytes) 2024-09-22T01:35:36.365 INFO:teuthology.orchestra.run.smithi018.stdout:1932 trunc from 0xc0f7606 to 0x8636775 2024-09-22T01:35:36.378 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:36.373+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:36.388 INFO:teuthology.orchestra.run.smithi018.stdout:1933 writesame 0x22263d3 thru 0x222d4be data_size 0x16(0x70ec bytes) 2024-09-22T01:35:36.388 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:36.389 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:36.396 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:36.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:36.416 INFO:teuthology.orchestra.run.smithi018.stdout:1938 write 0xd2c05e8 thru 0xd2c7715 (0x712e bytes) 2024-09-22T01:35:36.420 INFO:teuthology.orchestra.run.smithi018.stdout:1940 writesame 0xaa15859 thru 0xaa18089 data_size 0x1(0x2831 bytes) 2024-09-22T01:35:36.429 INFO:teuthology.orchestra.run.smithi018.stdout:1944 read 0x38435d1 thru 0x384755b (0x3f8b bytes) 2024-09-22T01:35:36.429 INFO:teuthology.orchestra.run.smithi018.stdout:1945 read 0xc116beb thru 0xc122612 (0xba28 bytes) 2024-09-22T01:35:36.429 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:36.429 INFO:teuthology.orchestra.run.smithi018.stdout:1948 write 0x3020cfd thru 0x3024a2f (0x3d33 bytes) 2024-09-22T01:35:36.436 INFO:teuthology.orchestra.run.smithi018.stdout:1950 read 0x2e54bac thru 0x2e63511 (0xe966 bytes) 2024-09-22T01:35:36.436 INFO:teuthology.orchestra.run.smithi018.stdout:1952 writesame 0xc14f7ba thru 0xc15cb43 data_size 0x1(0xd38a bytes) 2024-09-22T01:35:36.470 INFO:teuthology.orchestra.run.smithi018.stdout:1955 read 0x177b537 thru 0x1785372 (0x9e3c bytes) 2024-09-22T01:35:36.470 INFO:teuthology.orchestra.run.smithi018.stdout:1957 write 0xa264f7f thru 0xa2739ab (0xea2d bytes) 2024-09-22T01:35:36.477 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:36.479 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:36.476+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:36.479 INFO:teuthology.orchestra.run.smithi018.stdout:1959 trunc from 0xd2c7716 to 0xb801f86 2024-09-22T01:35:36.496 INFO:teuthology.orchestra.run.smithi018.stdout:1960 punch from 0x74d6ff3 to 0x74e5620, (0xe62d bytes) 2024-09-22T01:35:36.496 INFO:teuthology.orchestra.run.smithi018.stdout:1962 writesame 0x631e4ec thru 0x631e95f data_size 0x14(0x474 bytes) 2024-09-22T01:35:36.500 INFO:teuthology.orchestra.run.smithi018.stdout:1963 punch from 0x9de6a7c to 0x9de759b, (0xb1f bytes) 2024-09-22T01:35:36.513 INFO:teuthology.orchestra.run.smithi018.stdout:1964 writesame 0xd25e2e4 thru 0xd26746e data_size 0x25(0x918b bytes) 2024-09-22T01:35:36.513 INFO:teuthology.orchestra.run.smithi018.stdout:1965 punch from 0x1a82ef to 0x1af9cf, (0x76e0 bytes) 2024-09-22T01:35:36.513 INFO:teuthology.orchestra.run.smithi018.stdout:1967 write 0x22366f thru 0x22b0d3 (0x7a65 bytes) 2024-09-22T01:35:36.515 INFO:teuthology.orchestra.run.smithi018.stdout:1968 write 0x47244ca thru 0x472a844 (0x637b bytes) 2024-09-22T01:35:36.522 INFO:teuthology.orchestra.run.smithi018.stdout:1969 read 0xc0c3277 thru 0xc0d1821 (0xe5ab bytes) 2024-09-22T01:35:36.522 INFO:teuthology.orchestra.run.smithi018.stdout:1970 write 0xa24012e thru 0xa24ca8d (0xc960 bytes) 2024-09-22T01:35:36.528 INFO:teuthology.orchestra.run.smithi018.stdout:1971 punch from 0x6f862d7 to 0x6f875f4, (0x131d bytes) 2024-09-22T01:35:36.528 INFO:teuthology.orchestra.run.smithi018.stdout:1974 write 0xd06f247 thru 0xd073a08 (0x47c2 bytes) 2024-09-22T01:35:36.536 INFO:teuthology.orchestra.run.smithi018.stdout:1975 write 0x299c5e7 thru 0x299dc09 (0x1623 bytes) 2024-09-22T01:35:36.541 INFO:teuthology.orchestra.run.smithi018.stdout:1976 read 0xc4804c9 thru 0xc48793b (0x7473 bytes) 2024-09-22T01:35:36.541 INFO:teuthology.orchestra.run.smithi018.stdout:1977 write 0x97616ee thru 0x97669be (0x52d1 bytes) 2024-09-22T01:35:36.547 INFO:teuthology.orchestra.run.smithi018.stdout:1978 writesame 0xc90e213 thru 0xc91b79a data_size 0x4(0xd588 bytes) 2024-09-22T01:35:36.559 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:36.559 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:36.560 INFO:teuthology.orchestra.run.smithi018.stdout:1980 writesame 0xb991686 thru 0xb99a3d8 data_size 0xb(0x8d53 bytes) 2024-09-22T01:35:36.569 INFO:teuthology.orchestra.run.smithi018.stdout:1983 writesame 0x335b847 thru 0x3360ce3 data_size 0x1(0x549d bytes) 2024-09-22T01:35:36.574 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:36.605 INFO:teuthology.orchestra.run.smithi018.stdout:1984 read 0x81b2473 thru 0x81be1cf (0xbd5d bytes) 2024-09-22T01:35:36.606 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:36.601+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:36.616 INFO:teuthology.orchestra.run.smithi018.stdout:1985 write 0xd73bcef thru 0xd74a43c (0xe74e bytes) 2024-09-22T01:35:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:1988 punch from 0x605cc22 to 0x605e42c, (0x180a bytes) 2024-09-22T01:35:36.627 INFO:teuthology.orchestra.run.smithi018.stdout:1989 trunc from 0xd74a43d to 0xbae94a3 2024-09-22T01:35:36.646 INFO:teuthology.orchestra.run.smithi018.stdout:1990 punch from 0x2ccd4a3 to 0x2cd0297, (0x2df4 bytes) 2024-09-22T01:35:36.646 INFO:teuthology.orchestra.run.smithi018.stdout:1991 write 0x7b0b678 thru 0x7b1ae79 (0xf802 bytes) 2024-09-22T01:35:36.666 INFO:teuthology.orchestra.run.smithi018.stdout:1993 write 0xd4bb198 thru 0xd4c3d9e (0x8c07 bytes) 2024-09-22T01:35:36.673 INFO:teuthology.orchestra.run.smithi018.stdout:1994 read 0x3329d11 thru 0x33350d9 (0xb3c9 bytes) 2024-09-22T01:35:36.673 INFO:teuthology.orchestra.run.smithi018.stdout:1995 punch from 0xb82caf8 to 0xb83a4da, (0xd9e2 bytes) 2024-09-22T01:35:36.673 INFO:teuthology.orchestra.run.smithi018.stdout:1997 read 0x868001e thru 0x8689139 (0x911c bytes) 2024-09-22T01:35:36.673 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:36.673 INFO:teuthology.orchestra.run.smithi018.stdout:2000 read 0x30dbdcd thru 0x30df5cb (0x37ff bytes) 2024-09-22T01:35:36.673 INFO:teuthology.orchestra.run.smithi018.stdout:2002 write 0x520a5dc thru 0x521675b (0xc180 bytes) 2024-09-22T01:35:36.680 INFO:teuthology.orchestra.run.smithi018.stdout:2005 writesame 0x2f653e2 thru 0x2f659f7 data_size 0x13(0x616 bytes) 2024-09-22T01:35:36.680 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:36.676+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:36.685 INFO:teuthology.orchestra.run.smithi018.stdout:2006 write 0xc6031f5 thru 0xc604925 (0x1731 bytes) 2024-09-22T01:35:36.688 INFO:teuthology.orchestra.run.smithi018.stdout:2008 writesame 0x9077923 thru 0x9080b8f data_size 0x3f(0x926d bytes) 2024-09-22T01:35:36.705 INFO:teuthology.orchestra.run.smithi018.stdout:2009 trunc from 0xd4c3d9f to 0x66f001d 2024-09-22T01:35:36.731 INFO:teuthology.orchestra.run.smithi018.stdout:2010 read 0x4c2369a thru 0x4c2d798 (0xa0ff bytes) 2024-09-22T01:35:36.731 INFO:teuthology.orchestra.run.smithi018.stdout:2011 write 0x78488b thru 0x788d10 (0x4486 bytes) 2024-09-22T01:35:36.738 INFO:teuthology.orchestra.run.smithi018.stdout:2012 punch from 0x20d021a to 0x20d0d6a, (0xb50 bytes) 2024-09-22T01:35:36.738 INFO:teuthology.orchestra.run.smithi018.stdout:2013 writesame 0x57ac18e thru 0x57ac5a1 data_size 0x6(0x414 bytes) 2024-09-22T01:35:36.745 INFO:teuthology.orchestra.run.smithi018.stdout:2014 punch from 0x645ea77 to 0x6460d35, (0x22be bytes) 2024-09-22T01:35:36.745 INFO:teuthology.orchestra.run.smithi018.stdout:2015 read 0x2cfbecc thru 0x2d0bd92 (0xfec7 bytes) 2024-09-22T01:35:36.749 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:36.749 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:36.757 INFO:teuthology.orchestra.run.smithi018.stdout:2016 write 0x6e753d9 thru 0x6e83154 (0xdd7c bytes) 2024-09-22T01:35:36.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:36.778 INFO:teuthology.orchestra.run.smithi018.stdout:2017 write 0x8bbec51 thru 0x8bccb38 (0xdee8 bytes) 2024-09-22T01:35:36.781 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:36.777+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:36.785 INFO:teuthology.orchestra.run.smithi018.stdout:2018 writesame 0x3cd8838 thru 0x3cdc06d data_size 0x5(0x3836 bytes) 2024-09-22T01:35:36.794 INFO:teuthology.orchestra.run.smithi018.stdout:2019 trunc from 0x8bccb39 to 0x8ce3c1d 2024-09-22T01:35:36.801 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:36.810 INFO:teuthology.orchestra.run.smithi018.stdout:2021 trunc from 0x8ce3c1d to 0x3af0f77 2024-09-22T01:35:36.853 INFO:teuthology.orchestra.run.smithi018.stdout:2023 writesame 0xc102dc1 thru 0xc10a343 data_size 0x1(0x7583 bytes) 2024-09-22T01:35:36.867 INFO:teuthology.orchestra.run.smithi018.stdout:2024 trunc from 0xc10a344 to 0x33b7c00 2024-09-22T01:35:36.881 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:36.877+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:36.887 INFO:teuthology.orchestra.run.smithi018.stdout:2025 trunc from 0x33b7c00 to 0x489957c 2024-09-22T01:35:36.924 INFO:teuthology.orchestra.run.smithi018.stdout:2026 write 0xdf4f27d thru 0xdf51599 (0x231d bytes) 2024-09-22T01:35:36.924 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:36.924 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:36.932 INFO:teuthology.orchestra.run.smithi018.stdout:2027 write 0x987ff3d thru 0x988399a (0x3a5e bytes) 2024-09-22T01:35:36.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:36.950 INFO:teuthology.orchestra.run.smithi018.stdout:2029 trunc from 0xdf5159a to 0x823b716 2024-09-22T01:35:36.966 INFO:teuthology.orchestra.run.smithi018.stdout:2030 read 0x30670a0 thru 0x306820b (0x116c bytes) 2024-09-22T01:35:36.966 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:36.969 INFO:teuthology.orchestra.run.smithi018.stdout:2032 trunc from 0x823b716 to 0x63c6c66 2024-09-22T01:35:36.978 INFO:teuthology.orchestra.run.smithi018.stdout:2035 punch from 0x1c945c to 0x1cb48d, (0x2031 bytes) 2024-09-22T01:35:36.978 INFO:teuthology.orchestra.run.smithi018.stdout:2036 punch from 0x38fa4cc to 0x3909199, (0xeccd bytes) 2024-09-22T01:35:36.982 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:36.977+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:36.985 INFO:teuthology.orchestra.run.smithi018.stdout:2037 trunc from 0x63c6c66 to 0x1bae0dc 2024-09-22T01:35:37.026 INFO:teuthology.orchestra.run.smithi018.stdout:2038 writesame 0x91ff28c thru 0x920e734 data_size 0x1(0xf4a9 bytes) 2024-09-22T01:35:37.026 INFO:teuthology.orchestra.run.smithi018.stdout:2039 read 0x36436 thru 0x3bed3 (0x5a9e bytes) 2024-09-22T01:35:37.028 INFO:teuthology.orchestra.run.smithi018.stdout:2042 read 0x30093fa thru 0x3017548 (0xe14f bytes) 2024-09-22T01:35:37.028 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.028 INFO:teuthology.orchestra.run.smithi018.stdout:2044 write 0x6222c7f thru 0x622a209 (0x758b bytes) 2024-09-22T01:35:37.033 INFO:teuthology.orchestra.run.smithi018.stdout:2045 read 0x8e295cb thru 0x8e2d320 (0x3d56 bytes) 2024-09-22T01:35:37.049 INFO:teuthology.orchestra.run.smithi018.stdout:2046 writesame 0xcd87700 thru 0xcd880df data_size 0x10(0x9e0 bytes) 2024-09-22T01:35:37.050 INFO:teuthology.orchestra.run.smithi018.stdout:2047 punch from 0x8449a6c to 0x84575ef, (0xdb83 bytes) 2024-09-22T01:35:37.050 INFO:teuthology.orchestra.run.smithi018.stdout:2048 write 0x897ec9a thru 0x898e7b9 (0xfb20 bytes) 2024-09-22T01:35:37.057 INFO:teuthology.orchestra.run.smithi018.stdout:2049 punch from 0x5ac69f2 to 0x5acec1c, (0x822a bytes) 2024-09-22T01:35:37.057 INFO:teuthology.orchestra.run.smithi018.stdout:2050 write 0x2999752 thru 0x2999fae (0x85d bytes) 2024-09-22T01:35:37.063 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.063 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.079 INFO:teuthology.orchestra.run.smithi018.stdout:2054 trunc from 0xcd880e0 to 0x2b991d0 2024-09-22T01:35:37.082 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:37.077+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:37.102 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.102 INFO:teuthology.orchestra.run.smithi018.stdout:2057 punch from 0x1995eee to 0x199f1c4, (0x92d6 bytes) 2024-09-22T01:35:37.125 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:37.125 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:37.133 INFO:teuthology.orchestra.run.smithi018.stdout:2058 write 0xed70184 thru 0xed769e7 (0x6864 bytes) 2024-09-22T01:35:37.141 INFO:teuthology.orchestra.run.smithi018.stdout:2059 write 0x51b197a thru 0x51b3bcd (0x2254 bytes) 2024-09-22T01:35:37.142 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:2061 read 0xce4983c thru 0xce597ef (0xffb4 bytes) 2024-09-22T01:35:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:2063 write 0x334f694 thru 0x33530db (0x3a48 bytes) 2024-09-22T01:35:37.154 INFO:teuthology.orchestra.run.smithi018.stdout:2064 punch from 0x1fac476 to 0x1faf5a0, (0x312a bytes) 2024-09-22T01:35:37.154 INFO:teuthology.orchestra.run.smithi018.stdout:2065 punch from 0x5fd3cf6 to 0x5fd4391, (0x69b bytes) 2024-09-22T01:35:37.154 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.154 INFO:teuthology.orchestra.run.smithi018.stdout:2067 write 0xa6a35de thru 0xa6b056b (0xcf8e bytes) 2024-09-22T01:35:37.160 INFO:teuthology.orchestra.run.smithi018.stdout:2068 write 0x8a6bfa thru 0x8a6d47 (0x14e bytes) 2024-09-22T01:35:37.164 INFO:teuthology.orchestra.run.smithi018.stdout:2069 write 0xd998e1b thru 0xd9a0689 (0x786f bytes) 2024-09-22T01:35:37.171 INFO:teuthology.orchestra.run.smithi018.stdout:2071 read 0xd4b534e thru 0xd4b8d5f (0x3a12 bytes) 2024-09-22T01:35:37.171 INFO:teuthology.orchestra.run.smithi018.stdout:2072 write 0x29ca18d thru 0x29cc8a8 (0x271c bytes) 2024-09-22T01:35:37.176 INFO:teuthology.orchestra.run.smithi018.stdout:2073 write 0x2afd83d thru 0x2b0485e (0x7022 bytes) 2024-09-22T01:35:37.183 INFO:teuthology.orchestra.run.smithi018.stdout:2074 read 0xb0bf3a0 thru 0xb0cd3a5 (0xe006 bytes) 2024-09-22T01:35:37.183 INFO:teuthology.orchestra.run.smithi018.stdout:2075 write 0x40b5ea thru 0x40cd85 (0x179c bytes) 2024-09-22T01:35:37.183 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:37.177+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:37.213 INFO:teuthology.orchestra.run.smithi018.stdout:2076 write 0xa6f30bc thru 0xa6fa6be (0x7603 bytes) 2024-09-22T01:35:37.219 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.219 INFO:teuthology.orchestra.run.smithi018.stdout:2081 write 0xe64fbe thru 0xe6fd08 (0xad4b bytes) 2024-09-22T01:35:37.226 INFO:teuthology.orchestra.run.smithi018.stdout:2082 trunc from 0xed769e8 to 0xea81a1d 2024-09-22T01:35:37.266 INFO:teuthology.orchestra.run.smithi018.stdout:2084 trunc from 0xea81a1d to 0x739d163 2024-09-22T01:35:37.280 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:37.280 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:37.284 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:37.281+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:37.294 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:37.296 INFO:teuthology.orchestra.run.smithi018.stdout:2086 trunc from 0x739d163 to 0x6d6ac9d 2024-09-22T01:35:37.347 INFO:teuthology.orchestra.run.smithi018.stdout:2088 writesame 0xec47250 thru 0xec5369e data_size 0x5f(0xc44f bytes) 2024-09-22T01:35:37.347 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.347 INFO:teuthology.orchestra.run.smithi018.stdout:2094 writesame 0x923ad6 thru 0x930cc5 data_size 0x8(0xd1f0 bytes) 2024-09-22T01:35:37.359 INFO:teuthology.orchestra.run.smithi018.stdout:2096 punch from 0x6151c7d to 0x6156ce7, (0x506a bytes) 2024-09-22T01:35:37.359 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.359 INFO:teuthology.orchestra.run.smithi018.stdout:2100 write 0x6f35c81 thru 0x6f3cb46 (0x6ec6 bytes) 2024-09-22T01:35:37.380 INFO:teuthology.orchestra.run.smithi018.stdout:2101 trunc from 0xec5369f to 0x92cc4a5 2024-09-22T01:35:37.386 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:37.381+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:37.393 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.412 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:37.412 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:37.419 INFO:teuthology.orchestra.run.smithi018.stdout:2104 write 0xdbfc643 thru 0xdc0a41d (0xdddb bytes) 2024-09-22T01:35:37.427 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:37.428 INFO:teuthology.orchestra.run.smithi018.stdout:2105 read 0x8c991d3 thru 0x8ca5c7a (0xcaa8 bytes) 2024-09-22T01:35:37.428 INFO:teuthology.orchestra.run.smithi018.stdout:2106 punch from 0x5aff29f to 0x5b0ec3c, (0xf99d bytes) 2024-09-22T01:35:37.428 INFO:teuthology.orchestra.run.smithi018.stdout:2107 writesame 0x8fa494f thru 0x8fb32ac data_size 0x9(0xe95e bytes) 2024-09-22T01:35:37.442 INFO:teuthology.orchestra.run.smithi018.stdout:2108 read 0x5ca2886 thru 0x5cade52 (0xb5cd bytes) 2024-09-22T01:35:37.442 INFO:teuthology.orchestra.run.smithi018.stdout:2109 write 0x20af995 thru 0x20b690c (0x6f78 bytes) 2024-09-22T01:35:37.463 INFO:teuthology.orchestra.run.smithi018.stdout:2111 trunc from 0xdc0a41e to 0x9c2e3ce 2024-09-22T01:35:37.486 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:37.481+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:37.489 INFO:teuthology.orchestra.run.smithi018.stdout:2112 read 0x74beabe thru 0x74cdbf0 (0xf133 bytes) 2024-09-22T01:35:37.489 INFO:teuthology.orchestra.run.smithi018.stdout:2114 writesame 0x239028c thru 0x2398c7e data_size 0x7(0x89f3 bytes) 2024-09-22T01:35:37.519 INFO:teuthology.orchestra.run.smithi018.stdout:2115 write 0xc5db0aa thru 0xc5db5c6 (0x51d bytes) 2024-09-22T01:35:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:2116 punch from 0x7410171 to 0x7416bf3, (0x6a82 bytes) 2024-09-22T01:35:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:2121 write 0x10fb283 thru 0x10fbb8e (0x90c bytes) 2024-09-22T01:35:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:2122 trunc from 0xc5db5c7 to 0xd46566b 2024-09-22T01:35:37.551 INFO:teuthology.orchestra.run.smithi018.stdout:2123 read 0x5d20c1d thru 0x5d28623 (0x7a07 bytes) 2024-09-22T01:35:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:37.563 INFO:teuthology.orchestra.run.smithi018.stdout:2126 trunc from 0xd46566b to 0x90ef125 2024-09-22T01:35:37.566 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:37.609 INFO:teuthology.orchestra.run.smithi018.stdout:2127 writesame 0xb595567 thru 0xb59b488 data_size 0x63(0x5f22 bytes) 2024-09-22T01:35:37.610 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:37.608+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:37.628 INFO:teuthology.orchestra.run.smithi018.stdout:2128 write 0xd3fc252 thru 0xd40a3c4 (0xe173 bytes) 2024-09-22T01:35:37.637 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.637 INFO:teuthology.orchestra.run.smithi018.stdout:2131 writesame 0x6612248 thru 0x6617244 data_size 0x1(0x4ffd bytes) 2024-09-22T01:35:37.670 INFO:teuthology.orchestra.run.smithi018.stdout:2133 read 0xada77d9 thru 0xadab26e (0x3a96 bytes) 2024-09-22T01:35:37.670 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.670 INFO:teuthology.orchestra.run.smithi018.stdout:2135 punch from 0x8a191c5 to 0x8a19873, (0x6ae bytes) 2024-09-22T01:35:37.670 INFO:teuthology.orchestra.run.smithi018.stdout:2136 read 0x6c8376c thru 0x6c8a310 (0x6ba5 bytes) 2024-09-22T01:35:37.670 INFO:teuthology.orchestra.run.smithi018.stdout:2137 write 0x3996186 thru 0x399e562 (0x83dd bytes) 2024-09-22T01:35:37.677 INFO:teuthology.orchestra.run.smithi018.stdout:2138 writesame 0xb5eddd thru 0xb641c4 data_size 0xf(0x53e8 bytes) 2024-09-22T01:35:37.683 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.683 INFO:teuthology.orchestra.run.smithi018.stdout:2140 read 0x3c38041 thru 0x3c426d8 (0xa698 bytes) 2024-09-22T01:35:37.685 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:37.685 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:37.688 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:37.685+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:37.700 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:37.700 INFO:teuthology.orchestra.run.smithi018.stdout:2141 trunc from 0xd40a3c5 to 0x72341b2 2024-09-22T01:35:37.718 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:37.754 INFO:teuthology.orchestra.run.smithi018.stdout:2142 write 0xe8a8e9b thru 0xe8b65c8 (0xd72e bytes) 2024-09-22T01:35:37.760 INFO:teuthology.orchestra.run.smithi018.stdout:2143 punch from 0x473e7a4 to 0x474b10b, (0xc967 bytes) 2024-09-22T01:35:37.777 INFO:teuthology.orchestra.run.smithi018.stdout:2144 trunc from 0xe8b65c9 to 0x3ac7d09 2024-09-22T01:35:37.788 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:37.785+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:37.818 INFO:teuthology.orchestra.run.smithi018.stdout:2145 writesame 0xbbe7bf4 thru 0xbbea8da data_size 0xb(0x2ce7 bytes) 2024-09-22T01:35:37.818 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.818 INFO:teuthology.orchestra.run.smithi018.stdout:2149 read 0x7bb0f6 thru 0x7c905e (0xdf69 bytes) 2024-09-22T01:35:37.818 INFO:teuthology.orchestra.run.smithi018.stdout:2150 read 0x8b21346 thru 0x8b2d51c (0xc1d7 bytes) 2024-09-22T01:35:37.818 INFO:teuthology.orchestra.run.smithi018.stdout:2151 write 0xb6f246 thru 0xb7b80f (0xc5ca bytes) 2024-09-22T01:35:37.826 INFO:teuthology.orchestra.run.smithi018.stdout:2152 trunc from 0xbbea8db to 0xd740663 2024-09-22T01:35:37.835 INFO:teuthology.orchestra.run.smithi018.stdout:2154 write 0x2eb6b96 thru 0x2ec103f (0xa4aa bytes) 2024-09-22T01:35:37.843 INFO:teuthology.orchestra.run.smithi018.stdout:2155 read 0x9e72a96 thru 0x9e7d866 (0xadd1 bytes) 2024-09-22T01:35:37.843 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.843 INFO:teuthology.orchestra.run.smithi018.stdout:2158 punch from 0x5165a82 to 0x516e94c, (0x8eca bytes) 2024-09-22T01:35:37.843 INFO:teuthology.orchestra.run.smithi018.stdout:2159 read 0x884661 thru 0x894227 (0xfbc7 bytes) 2024-09-22T01:35:37.844 INFO:teuthology.orchestra.run.smithi018.stdout:2160 read 0x68252ca thru 0x682fa47 (0xa77e bytes) 2024-09-22T01:35:37.844 INFO:teuthology.orchestra.run.smithi018.stdout:2161 write 0xa3bc847 thru 0xa3c5d3c (0x94f6 bytes) 2024-09-22T01:35:37.851 INFO:teuthology.orchestra.run.smithi018.stdout:2162 write 0x2f7b210 thru 0x2f8a2e6 (0xf0d7 bytes) 2024-09-22T01:35:37.862 INFO:teuthology.orchestra.run.smithi018.stdout:2163 read 0x40023c1 thru 0x4004196 (0x1dd6 bytes) 2024-09-22T01:35:37.862 INFO:teuthology.orchestra.run.smithi018.stdout:2165 write 0x9e78367 thru 0x9e7b76f (0x3409 bytes) 2024-09-22T01:35:37.866 INFO:teuthology.orchestra.run.smithi018.stdout:2167 write 0xc1935e9 thru 0xc19781a (0x4232 bytes) 2024-09-22T01:35:37.871 INFO:teuthology.orchestra.run.smithi018.stdout:2170 read 0xa797b26 thru 0xa79f2ca (0x77a5 bytes) 2024-09-22T01:35:37.876 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:37.876 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:37.878 INFO:teuthology.orchestra.run.smithi018.stdout:2171 write 0xdfb535a thru 0xdfc1497 (0xc13e bytes) 2024-09-22T01:35:37.880 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:35:37.881 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:37.881 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:37.884 INFO:teuthology.orchestra.run.smithi018.stdout:2174 punch from 0x917aba9 to 0x9182302, (0x7759 bytes) 2024-09-22T01:35:37.884 INFO:teuthology.orchestra.run.smithi018.stdout:2175 write 0x85b588c thru 0x85c4a3c (0xf1b1 bytes) 2024-09-22T01:35:37.889 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:37.888+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:37.892 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:37.893 INFO:teuthology.orchestra.run.smithi018.stdout:2176 trunc from 0xdfc1498 to 0xce2611a 2024-09-22T01:35:37.902 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:37.902 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:37.905 INFO:teuthology.orchestra.run.smithi018.stdout:2177 write 0x7acf32 thru 0x7ba1ed (0xd2bc bytes) 2024-09-22T01:35:37.910 INFO:teuthology.orchestra.run.smithi018.stdout:2179 read 0xc964e2e thru 0xc96a022 (0x51f5 bytes) 2024-09-22T01:35:37.910 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.910 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:2182 trunc from 0xce2611a to 0x3e8a474 2024-09-22T01:35:37.937 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:37.949 INFO:teuthology.orchestra.run.smithi018.stdout:2183 trunc from 0x3e8a474 to 0xcb8b70a 2024-09-22T01:35:37.955 INFO:teuthology.orchestra.run.smithi018.stdout:2184 read 0xe3c2e3 thru 0xe4a557 (0xe275 bytes) 2024-09-22T01:35:37.955 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.964 INFO:teuthology.orchestra.run.smithi018.stdout:2186 trunc from 0xcb8b70a to 0x699b1fb 2024-09-22T01:35:37.969 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:37.970 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:37.971 INFO:teuthology.orchestra.run.smithi018.stdout:2187 punch from 0x141ac26 to 0x141fa6e, (0x4e48 bytes) 2024-09-22T01:35:37.985 INFO:teuthology.orchestra.run.smithi018.stdout:2189 writesame 0xb2b52f8 thru 0xb2b8b45 data_size 0x1(0x384e bytes) 2024-09-22T01:35:37.985 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:37.985 INFO:teuthology.orchestra.run.smithi018.stdout:2191 writesame 0x3da1607 thru 0x3da6e53 data_size 0x37(0x584d bytes) 2024-09-22T01:35:37.989 INFO:teuthology.orchestra.run.smithi018.stdout:2192 punch from 0x19a25d0 to 0x19b1743, (0xf173 bytes) 2024-09-22T01:35:37.989 INFO:teuthology.orchestra.run.smithi018.stdout:2193 write 0x4622416 thru 0x462d78a (0xb375 bytes) 2024-09-22T01:35:37.990 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:37.990 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:37.988+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:37.991 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:37.992 INFO:teuthology.orchestra.run.smithi018.stdout:2194 punch from 0x3c2269a to 0x3c2d94c, (0xb2b2 bytes) 2024-09-22T01:35:37.992 INFO:teuthology.orchestra.run.smithi018.stdout:2195 read 0x6a8245f thru 0x6a91d71 (0xf913 bytes) 2024-09-22T01:35:37.993 INFO:teuthology.orchestra.run.smithi018.stdout:2196 read 0x249f045 thru 0x24aea57 (0xfa13 bytes) 2024-09-22T01:35:38.005 INFO:teuthology.orchestra.run.smithi018.stdout:2199 write 0xec6c645 thru 0xec6d884 (0x1240 bytes) 2024-09-22T01:35:38.010 INFO:teuthology.orchestra.run.smithi018.stdout:2200 write 0xdd3e50c thru 0xdd4445e (0x5f53 bytes) 2024-09-22T01:35:38.013 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:38.014 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:38.015 INFO:teuthology.orchestra.run.smithi018.stdout:2201 punch from 0xbbd6ae7 to 0xbbd788f, (0xda8 bytes) 2024-09-22T01:35:38.015 INFO:teuthology.orchestra.run.smithi018.stdout:2202 read 0x413792f thru 0x413dd3b (0x640d bytes) 2024-09-22T01:35:38.015 INFO:teuthology.orchestra.run.smithi018.stdout:2204 read 0x92d066e thru 0x92d3191 (0x2b24 bytes) 2024-09-22T01:35:38.017 INFO:teuthology.orchestra.run.smithi018.stdout:2205 trunc from 0xec6d885 to 0xd71a176 2024-09-22T01:35:38.030 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:38.030 INFO:teuthology.orchestra.run.smithi018.stdout:2208 write 0x8db629d thru 0x8dbb10b (0x4e6f bytes) 2024-09-22T01:35:38.034 INFO:teuthology.orchestra.run.smithi018.stdout:2209 read 0x611e7cc thru 0x612781e (0x9053 bytes) 2024-09-22T01:35:38.034 INFO:teuthology.orchestra.run.smithi018.stdout:2210 write 0x6a814dc thru 0x6a8974d (0x8272 bytes) 2024-09-22T01:35:38.035 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:38.036 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:38.049 INFO:teuthology.orchestra.run.smithi018.stdout:2211 trunc from 0xd71a176 to 0x6fa69e3 2024-09-22T01:35:38.057 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:38.058 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:38.063 INFO:teuthology.orchestra.run.smithi018.stdout:2213 read 0x12253bf thru 0x1228127 (0x2d69 bytes) 2024-09-22T01:35:38.064 INFO:teuthology.orchestra.run.smithi018.stdout:2214 trunc from 0x6fa69e3 to 0x5fbc5b4 2024-09-22T01:35:38.065 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:38.065 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:5372 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:00.125466+0000", 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.937730846000001, 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.060015348000000003, 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.066 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 5372 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125466+0000", 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125466+0000", 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125468+0000", 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9999999999999999e-06 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125481+0000", 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2965e-05 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125512+0000", 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1387999999999998e-05 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125528+0000", 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5875e-05 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125711+0000", 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018251300000000001 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.125849+0000", 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013890199999999999 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.135810+0000", 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.009960989 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185297+0000", 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049486143000000003 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185358+0000", 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0952999999999997e-05 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185423+0000", 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5665000000000002e-05 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:00.185481+0000", 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7955000000000003e-05 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15848 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 802816~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.071 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.739978157000003, 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048543573999999999, 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15848 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:38.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323219+0000", 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2200000000000003e-07 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323225+0000", 2024-09-22T01:35:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2060000000000004e-06 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323233+0000", 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.114e-06 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323238+0000", 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4269999999999999e-06 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371630+0000", 2024-09-22T01:35:38.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048391548 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371685+0000", 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5764999999999999e-05 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371762+0000", 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6792000000000006e-05 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15849 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 813056~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.739951638000001, 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048740787000000001, 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15849 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323245+0000", 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2300000000000002e-07 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323247+0000", 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.996e-06 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323255+0000", 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8189999999999992e-06 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323261+0000", 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2390000000000002e-06 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371802+0000", 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048541859999999999 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371888+0000", 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5841999999999996e-05 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.371986+0000", 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7608000000000005e-05 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.079 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15850 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 987136~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323267+0000", 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.739929289999999, 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048897709999999997, 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15850 2024-09-22T01:35:38.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323267+0000", 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323267+0000", 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323268+0000", 2024-09-22T01:35:38.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7100000000000002e-07 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323270+0000", 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1789999999999998e-06 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323277+0000", 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4869999999999999e-06 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323281+0000", 2024-09-22T01:35:38.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8919999999999999e-06 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372025+0000", 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048743109999999999 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372100+0000", 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5706999999999999e-05 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372165+0000", 2024-09-22T01:35:38.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4863999999999994e-05 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15851 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 997376~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.739908763999999, 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049107096000000003, 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.084 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15851 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323288+0000", 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5499999999999999e-07 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323291+0000", 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.323e-06 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323300+0000", 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7389999999999994e-06 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323306+0000", 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2979999999999999e-06 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372204+0000", 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048898832000000003 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372294+0000", 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9517000000000004e-05 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372395+0000", 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101032 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15856 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 106496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323312+0000", 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.739884519, 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049274633999999998, 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.088 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15856 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323312+0000", 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323312+0000", 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323313+0000", 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1699999999999999e-07 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323315+0000", 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1239999999999999e-06 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323321+0000", 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3470000000000004e-06 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323326+0000", 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0259999999999998e-06 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372436+0000", 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049109450999999998 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372504+0000", 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8499999999999998e-05 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372587+0000", 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2769000000000007e-05 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15857 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 280576~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.323333+0000", 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.739863644000003, 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049491571999999998, 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.092 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15857 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323333+0000", 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.323333+0000", 2024-09-22T01:35:38.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326605+0000", 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032723959999999999 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326610+0000", 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0929999999999996e-06 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326623+0000", 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3885e-05 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326629+0000", 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7069999999999997e-06 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372623+0000", 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.045994150999999997 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372725+0000", 2024-09-22T01:35:38.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000102135 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.372825+0000", 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9204999999999996e-05 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15874 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 485376~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326789+0000", 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.736407225000001, 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048542634000000001, 2024-09-22T01:35:38.096 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15874 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326789+0000", 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326789+0000", 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326790+0000", 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2300000000000002e-07 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326791+0000", 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2500000000000001e-06 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326797+0000", 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3730000000000001e-06 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326801+0000", 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8409999999999999e-06 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375143+0000", 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048341692999999998 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375232+0000", 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8782000000000005e-05 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375332+0000", 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100272 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15875 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 659456~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326808+0000", 2024-09-22T01:35:38.100 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.736388675000001, 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048705257000000002, 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15875 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326808+0000", 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326808+0000", 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326809+0000", 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6199999999999998e-07 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326811+0000", 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.074e-06 2024-09-22T01:35:38.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326817+0000", 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4350000000000002e-06 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326822+0000", 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.938e-06 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375366+0000", 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048543513000000003 2024-09-22T01:35:38.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375444+0000", 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8384e-05 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375513+0000", 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9350999999999994e-05 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.104 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15876 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 669696~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326843+0000", 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.736353573999999, 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048891241000000002, 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15876 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.105 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326843+0000", 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326843+0000", 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326844+0000", 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326846+0000", 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4260000000000002e-06 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326859+0000", 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326865+0000", 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.998e-06 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375553+0000", 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048687268999999998 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375638+0000", 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4851000000000005e-05 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375734+0000", 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6779000000000003e-05 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15877 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 843776~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.736322801, 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049047570999999998, 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15877 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326874+0000", 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5999999999999999e-07 2024-09-22T01:35:38.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326877+0000", 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3700000000000002e-06 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326884+0000", 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2649999999999999e-06 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326891+0000", 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0809999999999996e-06 2024-09-22T01:35:38.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375776+0000", 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048885021000000001 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375840+0000", 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3496000000000003e-05 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375921+0000", 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1878000000000004e-05 2024-09-22T01:35:38.112 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15878 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 1028096~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326898+0000", 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.736298308999999, 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049240253999999997, 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.113 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15878 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326898+0000", 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326898+0000", 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326899+0000", 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2500000000000001e-07 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326901+0000", 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2180000000000002e-06 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326916+0000", 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5294999999999998e-05 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326922+0000", 2024-09-22T01:35:38.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0299999999999999e-06 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.375957+0000", 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049034873999999999 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376044+0000", 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6496999999999995e-05 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376139+0000", 2024-09-22T01:35:38.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4914999999999995e-05 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15879 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 1017856~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.326931+0000", 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.736265953999997, 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049385907, 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15879 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326931+0000", 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.326931+0000", 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.118 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330840+0000", 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039091799999999999 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330847+0000", 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.289e-06 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330859+0000", 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2101e-05 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.330867+0000", 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0180000000000001e-06 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376178+0000", 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.045310797999999999 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376240+0000", 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1863e-05 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.376317+0000", 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6657999999999997e-05 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15903 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 690176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.731956126, 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048413610000000003, 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15903 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.122 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331241+0000", 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331243+0000", 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5059999999999998e-06 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331261+0000", 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7768e-05 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331267+0000", 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0070000000000003e-06 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379464+0000", 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048196992000000001 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379552+0000", 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7756000000000005e-05 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379654+0000", 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010214500000000001 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15904 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 700416~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.731921174, 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048631483000000003, 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.125 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15904 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331276+0000", 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5600000000000001e-07 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331279+0000", 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.717e-06 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331286+0000", 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2099999999999996e-06 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331292+0000", 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6319999999999996e-06 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379689+0000", 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048397554000000002 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379792+0000", 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010319699999999999 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379907+0000", 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011471700000000001 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15905 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 874496~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.731897861, 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048758479, 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.129 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15905 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:38.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331299+0000", 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331302+0000", 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.497e-06 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331315+0000", 2024-09-22T01:35:38.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3684e-05 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331321+0000", 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379946+0000", 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048624779 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.379998+0000", 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2303999999999999e-05 2024-09-22T01:35:38.132 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380057+0000", 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9021000000000003e-05 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15911 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 167936~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331351+0000", 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.731845495999998, 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048937877999999997, 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15911 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331351+0000", 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.134 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331351+0000", 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331352+0000", 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.75e-07 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331355+0000", 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.112e-06 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331363+0000", 2024-09-22T01:35:38.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0930000000000003e-06 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331369+0000", 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7760000000000003e-06 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380104+0000", 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048735140000000003 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380199+0000", 2024-09-22T01:35:38.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4844000000000002e-05 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380289+0000", 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0338000000000001e-05 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15912 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 178176~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.731819897000001, 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049071042000000002, 2024-09-22T01:35:38.137 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15912 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331377+0000", 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1600000000000001e-07 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331380+0000", 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819999999999998e-06 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331394+0000", 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4239e-05 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331399+0000", 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2159999999999997e-06 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380338+0000", 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.048938447000000003 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380389+0000", 2024-09-22T01:35:38.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1635000000000003e-05 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380448+0000", 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8607000000000003e-05 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15913 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 352256~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.731789661999997, 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049229644000000003, 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.141 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15913 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331407+0000", 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8599999999999999e-07 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331410+0000", 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.858e-06 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331418+0000", 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.267e-06 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331423+0000", 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.519e-06 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380485+0000", 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049061912999999999 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380542+0000", 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7522000000000003e-05 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380637+0000", 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4178999999999994e-05 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:15914 3.16 3:6c0a842f:::rbd_data.110f880def8d.000000000000000b:7 [read 526336~2048] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.331430+0000", 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.731766215999997, 2024-09-22T01:35:38.145 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.049386494000000003, 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 15914 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331430+0000", 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.146 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.331430+0000", 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334567+0000", 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031364790000000002 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334573+0000", 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5429999999999999e-06 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334589+0000", 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5488000000000001e-05 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.334598+0000", 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2620000000000004e-06 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380677+0000", 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.046078612999999997 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380728+0000", 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1232e-05 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.380817+0000", 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8876999999999996e-05 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.149 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:38.151 INFO:teuthology.orchestra.run.smithi018.stdout:2215 trunc from 0x5fbc5b4 to 0x152af0 2024-09-22T01:35:38.151 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:38.152 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:38.145+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:38.251 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:38.245+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:38.348 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:38.348 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:38.348 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:38.348 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:38.353 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:38.349+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:38.362 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:38.454 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:38.449+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:38.498 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:38.498 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:38.498 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:38.498 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:38.499 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:38.518 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:38.565 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:38.564+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:38.655 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:38.652+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.592958696, 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.672 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:38.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:35:38.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.592921668000001, 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:35:38.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:35:38.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:35:38.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:35:38.681 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.681 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.681 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.681 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.581371208, 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.581337201, 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.686 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:35:38.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:35:38.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.577469851, 2024-09-22T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:35:38.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:35:38.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:35:38.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:35:38.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:35:38.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.577424303000001, 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.695 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:35:38.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:35:38.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.699 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.577379095, 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:35:38.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:35:38.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.577344502999999, 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.704 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:35:38.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:35:38.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.577310855, 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.573581365000001, 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:35:38.712 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:35:38.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.573544862, 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.716 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.573500223, 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.720 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.573449997000001, 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.724 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.573411555, 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.728 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:35:38.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:35:38.731 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.573367559999999, 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.732 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:35:38.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:35:38.735 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.57332841, 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:35:38.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.569485242000001, 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:35:38.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.743 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.569404916, 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:35:38.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:35:38.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:35:38.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:38.747 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 9.8648516199999996, 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:35:38.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:35:38.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:35:38.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:35:38.752 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.8707100519999997, 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.753 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.755 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:35:38.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.757 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.758 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.758 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:38.758 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:38.758 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:38.760 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:38.760 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:38.756+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:38.760 INFO:teuthology.orchestra.run.smithi018.stdout:2216 trunc from 0x152af0 to 0xab350cc 2024-09-22T01:35:38.760 INFO:teuthology.orchestra.run.smithi018.stdout:2218 read 0xa584412 thru 0xa584448 (0x37 bytes) 2024-09-22T01:35:38.760 INFO:teuthology.orchestra.run.smithi018.stdout:2219 trunc from 0xab350cc to 0xa09af41 2024-09-22T01:35:38.760 INFO:teuthology.orchestra.run.smithi018.stdout:2220 read 0x188dd2d thru 0x1892355 (0x4629 bytes) 2024-09-22T01:35:38.761 INFO:teuthology.orchestra.run.smithi018.stdout:2221 punch from 0x6050805 to 0x605e8f0, (0xe0eb bytes) 2024-09-22T01:35:38.761 INFO:teuthology.orchestra.run.smithi018.stdout:2222 writesame 0x4d335ec thru 0x4d434f1 data_size 0x6(0xff06 bytes) 2024-09-22T01:35:38.761 INFO:teuthology.orchestra.run.smithi018.stdout:2223 write 0x4483007 thru 0x4483474 (0x46e bytes) 2024-09-22T01:35:38.761 INFO:teuthology.orchestra.run.smithi018.stdout:2224 read 0x65070ee thru 0x650f62e (0x8541 bytes) 2024-09-22T01:35:38.782 INFO:teuthology.orchestra.run.smithi018.stdout:2226 trunc from 0xa09af41 to 0x1bcfa54 2024-09-22T01:35:38.808 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:38.808 INFO:teuthology.orchestra.run.smithi018.stdout:2228 read 0xdd58ed thru 0xddb91d (0x6031 bytes) 2024-09-22T01:35:38.836 INFO:teuthology.orchestra.run.smithi018.stdout:2229 write 0x6af1425 thru 0x6afde1f (0xc9fb bytes) 2024-09-22T01:35:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:2230 read 0xdabccb thru 0xdba0c9 (0xe3ff bytes) 2024-09-22T01:35:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:2232 trunc from 0x6afde20 to 0x6a1bc9a 2024-09-22T01:35:38.857 INFO:teuthology.orchestra.run.smithi018.stdout:2233 read 0x46cbb55 thru 0x46d69ed (0xae99 bytes) 2024-09-22T01:35:38.857 INFO:teuthology.orchestra.run.smithi018.stdout:2237 read 0x53809e thru 0x543631 (0xb594 bytes) 2024-09-22T01:35:38.859 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:38.857+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:38.881 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:35:38.889 INFO:teuthology.orchestra.run.smithi018.stdout:2238 writesame 0xaf46298 thru 0xaf55487 data_size 0x1c(0xf1f0 bytes) 2024-09-22T01:35:38.897 INFO:teuthology.orchestra.run.smithi018.stdout:2241 trunc from 0xaf55488 to 0x7456edf 2024-09-22T01:35:38.907 INFO:teuthology.orchestra.run.smithi018.stdout:2242 punch from 0x5331a6a to 0x5341970, (0xff06 bytes) 2024-09-22T01:35:38.907 INFO:teuthology.orchestra.run.smithi018.stdout:2243 punch from 0x4c63405 to 0x4c68773, (0x536e bytes) 2024-09-22T01:35:38.912 INFO:teuthology.orchestra.run.smithi018.stdout:2245 trunc from 0x7456edf to 0x9ba37f1 2024-09-22T01:35:38.921 INFO:teuthology.orchestra.run.smithi018.stdout:2246 punch from 0x266583e to 0x2672069, (0xc82b bytes) 2024-09-22T01:35:38.934 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:38.934 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:38.934 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:38.934 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:38.935 INFO:teuthology.orchestra.run.smithi018.stdout:2247 trunc from 0x9ba37f1 to 0x17bee86 2024-09-22T01:35:38.949 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:38.952 INFO:teuthology.orchestra.run.smithi018.stdout:2248 write 0x14e880 thru 0x156e0c (0x858d bytes) 2024-09-22T01:35:38.954 INFO:teuthology.orchestra.run.smithi018.stdout:2251 read 0x92a09d thru 0x92acc6 (0xc2a bytes) 2024-09-22T01:35:38.954 INFO:teuthology.orchestra.run.smithi018.stdout:2252 punch from 0xa97d28 to 0xaa017f, (0x8457 bytes) 2024-09-22T01:35:38.960 INFO:teuthology.orchestra.run.smithi018.stdout:2253 trunc from 0x17bee86 to 0x42f53e9 2024-09-22T01:35:38.981 INFO:teuthology.orchestra.run.smithi018.stdout:2254 write 0x787bb24 thru 0x7880267 (0x4744 bytes) 2024-09-22T01:35:38.987 INFO:teuthology.orchestra.run.smithi018.stdout:2255 write 0x1c6a42e thru 0x1c7515d (0xad30 bytes) 2024-09-22T01:35:38.993 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:38.992+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:39.007 INFO:teuthology.orchestra.run.smithi018.stdout:2256 trunc from 0x7880268 to 0xeae1f6a 2024-09-22T01:35:39.016 INFO:teuthology.orchestra.run.smithi018.stdout:2257 read 0xd25cb7b thru 0xd26325d (0x66e3 bytes) 2024-09-22T01:35:39.016 INFO:teuthology.orchestra.run.smithi018.stdout:2258 write 0x2e2516d thru 0x2e25c26 (0xaba bytes) 2024-09-22T01:35:39.021 INFO:teuthology.orchestra.run.smithi018.stdout:2259 write 0x69143c thru 0x697da6 (0x696b bytes) 2024-09-22T01:35:39.025 INFO:teuthology.orchestra.run.smithi018.stdout:2261 write 0xaee932f thru 0xaef7d9f (0xea71 bytes) 2024-09-22T01:35:39.060 INFO:teuthology.orchestra.run.smithi018.stdout:2262 trunc from 0xeae1f6a to 0x219b7bd 2024-09-22T01:35:39.061 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:39.057+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:39.076 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:39.076 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:39.082 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:39.090 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:39.098 INFO:teuthology.orchestra.run.smithi018.stdout:2264 write 0x4091e1a thru 0x409996b (0x7b52 bytes) 2024-09-22T01:35:39.104 INFO:teuthology.orchestra.run.smithi018.stdout:2266 write 0x39e99d7 thru 0x39f2522 (0x8b4c bytes) 2024-09-22T01:35:39.135 INFO:teuthology.orchestra.run.smithi018.stdout:2267 write 0x8baba83 thru 0x8bb477a (0x8cf8 bytes) 2024-09-22T01:35:39.145 INFO:teuthology.orchestra.run.smithi018.stdout:2268 writesame 0x84b1b05 thru 0x84be334 data_size 0x8(0xc830 bytes) 2024-09-22T01:35:39.158 INFO:teuthology.orchestra.run.smithi018.stdout:2269 trunc from 0x8bb477b to 0x755b645 2024-09-22T01:35:39.161 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:39.157+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:39.182 INFO:teuthology.orchestra.run.smithi018.stdout:2270 writesame 0x4808888 thru 0x4808a18 data_size 0x1(0x191 bytes) 2024-09-22T01:35:39.202 INFO:teuthology.orchestra.run.smithi018.stdout:2271 writesame 0x7573cb1 thru 0x75768b5 data_size 0x1(0x2c05 bytes) 2024-09-22T01:35:39.227 INFO:teuthology.orchestra.run.smithi018.stdout:2272 write 0xb68ae74 thru 0xb6975e9 (0xc776 bytes) 2024-09-22T01:35:39.237 INFO:teuthology.orchestra.run.smithi018.stdout:2273 punch from 0x406d9a9 to 0x4076860, (0x8eb7 bytes) 2024-09-22T01:35:39.237 INFO:teuthology.orchestra.run.smithi018.stdout:2274 punch from 0x16cbc1f to 0x16cbfc0, (0x3a1 bytes) 2024-09-22T01:35:39.260 INFO:teuthology.orchestra.run.smithi018.stdout:2275 write 0xe963993 thru 0xe9664c4 (0x2b32 bytes) 2024-09-22T01:35:39.262 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:39.257+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:39.268 INFO:teuthology.orchestra.run.smithi018.stdout:2277 clone 17 order 22 su 2097152 sc 12 2024-09-22T01:35:39.269 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:39.269 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:39.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:39.269 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:39.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 65.957606077999998, 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:35:39.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:35:39.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:35:39.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:35:39.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:35:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.426833381999998, 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:35:39.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:35:39.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:35:39.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.279 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.426606102000001, 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.283 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.423437817999996, 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.423353554000002, 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.288 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:39.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.423302057999997, 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.423256737999999, 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:35:39.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:35:39.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.300 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.419776481, 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.301 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.419471669000004, 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:35:39.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:35:39.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:39.308 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.419422224999998, 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:35:39.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.419377670999999, 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.312 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:35:39.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.419334020999997, 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:35:39.316 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.419286800000002, 2024-09-22T01:35:39.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:39.324 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.419091794000003, 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:39.328 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.419042306999998, 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.415891248000001, 2024-09-22T01:35:39.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:35:39.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.336 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.415545620000003, 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.340 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.415450196999998, 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:35:39.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.415397618, 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:35:39.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:35:39.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.415355851000001, 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:39.348 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:39.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:35:39.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.351 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.352 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:39.352 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:39.352 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:39.353 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:39.363 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:39.360+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:39.464 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:39.461+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:39.489 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:39.489 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:39.489 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:39.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:39.592 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:39.589+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:39.666 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:39.664+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:39.675 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:39.675 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:39.675 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:39.675 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:39.675 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:39.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:39.776 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:39.773+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:39.861 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:39.861 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:39.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:39.861 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48565 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 708608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.393579599999999, 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086712429999999993, 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48565 2024-09-22T01:35:39.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466221+0000", 2024-09-22T01:35:39.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9299999999999998e-07 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466224+0000", 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.977e-06 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466233+0000", 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1419999999999999e-06 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466240+0000", 2024-09-22T01:35:39.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6800000000000004e-06 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552634+0000", 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086394356000000005 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552731+0000", 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6681000000000005e-05 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552933+0000", 2024-09-22T01:35:39.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020200099999999999 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48566 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 718848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.393551421000002, 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086846866999999994, 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.866 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48566 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.06e-07 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466252+0000", 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.813e-06 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466261+0000", 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7260000000000008e-06 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466267+0000", 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5400000000000001e-06 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552974+0000", 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086707237000000006 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553025+0000", 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0380000000000002e-05 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553095+0000", 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0564999999999999e-05 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48654 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.389308380999999, 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086747482000000001, 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.870 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48654 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5700000000000001e-07 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470498+0000", 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:39.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470515+0000", 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7742000000000001e-05 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470546+0000", 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0586000000000002e-05 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557000+0000", 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086454002000000002 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557110+0000", 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010961 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557239+0000", 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.874 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48655 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 638976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.389232810999999, 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086840121000000006, 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48655 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470569+0000", 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5400000000000001e-06 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470575+0000", 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1399999999999997e-06 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470597+0000", 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1676e-05 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470614+0000", 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7336000000000001e-05 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557279+0000", 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086664832999999997 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557341+0000", 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2073e-05 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557407+0000", 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6523e-05 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.389129627999999, 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:39.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.883 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.389055217999999, 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.884 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:35:39.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.388998687000001, 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.888 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:39.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.892 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.388941093, 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:35:39.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:35:39.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.896 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.388883754999998, 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.897 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:35:39.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.388826313999999, 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.388790405000002, 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:35:39.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48750 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.383887604000002, 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086758792000000001, 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48750 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475914+0000", 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.263e-06 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475919+0000", 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.84e-06 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475937+0000", 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7689e-05 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475951+0000", 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3439e-05 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562548+0000", 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086597376000000004 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562605+0000", 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7367999999999997e-05 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562671+0000", 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5816999999999997e-05 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.912 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48751 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 641024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.383813274000001, 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086829097999999993, 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48751 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475988+0000", 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.47e-07 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475994+0000", 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1260000000000003e-06 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476019+0000", 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5471999999999999e-05 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476033+0000", 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100000000000001e-05 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562691+0000", 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086657746999999993 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562750+0000", 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9188000000000003e-05 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562816+0000", 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5518000000000005e-05 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.383746707, 2024-09-22T01:35:39.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:39.920 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.383683265999998, 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:35:39.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:39.924 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.383628029, 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.383554714999999, 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:35:39.928 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.383500634000001, 2024-09-22T01:35:39.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:39.936 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.383446196000001, 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:39.940 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 31.383390335000001, 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:39.944 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:39.945 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7] out_osds: [2, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:39.945 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:35:39.945 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-22T01:35:39.945 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-22T01:35:39.945 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-22T01:35:39.945 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-22T01:35:39.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:39.947 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:39.941+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:40.041 INFO:teuthology.orchestra.run.smithi018.stdout:flattening image image_client.0-clone16 2024-09-22T01:35:40.046 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:40.044+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:40.081 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:40.081 INFO:teuthology.orchestra.run.smithi179.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-22T01:35:40.082 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:40.129 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:40.129 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:40.129 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:40.129 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:40.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:40.148 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:40.145+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:40.152 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:40.249 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:40.244+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:40.274 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:40.274 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:40.274 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:40.287 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:40.294 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-22T01:35:40.347 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:40.348 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:40.350 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:40.348+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:40.367 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:40.386 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:40.386 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:40.402 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:40.403 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:40.422 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:40.422 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:40.425 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:40.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:40.451 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:40.448+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:40.552 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:40.549+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:40.576 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:40.577 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:40.601 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:40.601 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:40.602 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:40.603 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:40.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:40.626 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:40.626 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:40.653 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:40.648+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:40.754 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:40.752+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:40.755 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:40.755 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:40.770 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:40.854 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:40.849+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:40.893 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:40.893 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:40.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:40.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:35:40.955 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:40.952+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:41.056 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:41.052+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:41.080 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:41.080 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:41.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:41.156 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:41.153+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:41.220 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:41.221 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:41.235 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:41.257 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:41.252+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:41.358 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:41.356+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:41.407 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:41.407 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:41.422 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:41.466 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:41.464+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:41.515 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:41.515 INFO:teuthology.orchestra.run.smithi018.stdout:2279 write 0x3fa0671 thru 0x3fa8970 (0x8300 bytes) 2024-09-22T01:35:41.530 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:41.530 INFO:teuthology.orchestra.run.smithi018.stdout:2281 read 0x3339bb0 thru 0x3340172 (0x65c3 bytes) 2024-09-22T01:35:41.530 INFO:teuthology.orchestra.run.smithi018.stdout:2282 read 0xc80a15e thru 0xc819772 (0xf615 bytes) 2024-09-22T01:35:41.530 INFO:teuthology.orchestra.run.smithi018.stdout:2284 read 0x804a328 thru 0x804a452 (0x12b bytes) 2024-09-22T01:35:41.530 INFO:teuthology.orchestra.run.smithi018.stdout:2285 write 0x7acab66 thru 0x7ad1e5d (0x72f8 bytes) 2024-09-22T01:35:41.559 INFO:teuthology.orchestra.run.smithi018.stdout:2286 trunc from 0xe9664c5 to 0x3002087 2024-09-22T01:35:41.559 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:41.557+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:41.560 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:41.560 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:41.576 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:41.587 INFO:teuthology.orchestra.run.smithi018.stdout:2287 read 0x113495c thru 0x11404af (0xbb54 bytes) 2024-09-22T01:35:41.587 INFO:teuthology.orchestra.run.smithi018.stdout:2288 punch from 0xb3d701 to 0xb42ca6, (0x55a5 bytes) 2024-09-22T01:35:41.621 INFO:teuthology.orchestra.run.smithi018.stdout:2289 write 0xe835231 thru 0xe83c018 (0x6de8 bytes) 2024-09-22T01:35:41.628 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:41.628 INFO:teuthology.orchestra.run.smithi018.stdout:2291 write 0x25118b1 thru 0x251bad9 (0xa229 bytes) 2024-09-22T01:35:41.636 INFO:teuthology.orchestra.run.smithi018.stdout:2293 writesame 0x844e97e thru 0x845b62a data_size 0x1(0xccad bytes) 2024-09-22T01:35:41.662 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:41.660+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:41.708 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:41.733 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:41.744 INFO:teuthology.orchestra.run.smithi018.stdout:2295 trunc from 0xe83c019 to 0x608c27 2024-09-22T01:35:41.747 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:41.790 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:41.788+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:41.790 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:41.795 INFO:teuthology.orchestra.run.smithi018.stdout:2297 trunc from 0x608c27 to 0x278d95b 2024-09-22T01:35:41.805 INFO:teuthology.orchestra.run.smithi018.stdout:2298 read 0x8b81f7 thru 0x8bd163 (0x4f6d bytes) 2024-09-22T01:35:41.837 INFO:teuthology.orchestra.run.smithi018.stdout:2300 write 0xa7dd245 thru 0xa7eb026 (0xdde2 bytes) 2024-09-22T01:35:41.845 INFO:teuthology.orchestra.run.smithi018.stdout:2301 write 0x3fd84d1 thru 0x3fe3b81 (0xb6b1 bytes) 2024-09-22T01:35:41.852 INFO:teuthology.orchestra.run.smithi018.stdout:2302 writesame 0x9031708 thru 0x903fb4c data_size 0x2b(0xe445 bytes) 2024-09-22T01:35:41.860 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:41.860 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:41.860 INFO:teuthology.orchestra.run.smithi018.stdout:2309 read 0x9fa2baf thru 0x9fad515 (0xa967 bytes) 2024-09-22T01:35:41.860 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:41.860 INFO:teuthology.orchestra.run.smithi018.stdout:2311 punch from 0x676bf37 to 0x676d607, (0x16d0 bytes) 2024-09-22T01:35:41.861 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:41.860+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:41.868 INFO:teuthology.orchestra.run.smithi018.stdout:2312 trunc from 0xa7eb027 to 0x77561fd 2024-09-22T01:35:41.897 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:35:41.903 INFO:teuthology.orchestra.run.smithi018.stdout:2314 writesame 0x618097 thru 0x61d833 data_size 0x1(0x579d bytes) 2024-09-22T01:35:41.922 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:41.922 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:41.924 INFO:teuthology.orchestra.run.smithi018.stdout:2315 read 0x6fa87ab thru 0x6faaeb3 (0x2709 bytes) 2024-09-22T01:35:41.924 INFO:teuthology.orchestra.run.smithi018.stdout:2316 write 0x6d6c95e thru 0x6d713dd (0x4a80 bytes) 2024-09-22T01:35:41.929 INFO:teuthology.orchestra.run.smithi018.stdout:2317 write 0x25e6dc0 thru 0x25f5b39 (0xed7a bytes) 2024-09-22T01:35:41.936 INFO:teuthology.orchestra.run.smithi018.stdout:2318 punch from 0x73d0b61 to 0x73d7238, (0x66d7 bytes) 2024-09-22T01:35:41.937 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:41.951 INFO:teuthology.orchestra.run.smithi018.stdout:2319 write 0xa9720cf thru 0xa981d73 (0xfca5 bytes) 2024-09-22T01:35:41.954 INFO:teuthology.orchestra.run.smithi018.stdout:2321 writesame 0x268e075 thru 0x268e523 data_size 0x1(0x4af bytes) 2024-09-22T01:35:41.959 INFO:teuthology.orchestra.run.smithi018.stdout:2322 read 0x804aaa1 thru 0x804e705 (0x3c65 bytes) 2024-09-22T01:35:41.959 INFO:teuthology.orchestra.run.smithi018.stdout:2323 writesame 0x76f11ab thru 0x76fc67d data_size 0x11(0xb4d3 bytes) 2024-09-22T01:35:41.964 INFO:teuthology.orchestra.run.smithi018.stdout:2327 punch from 0x64ddc97 to 0x64e485d, (0x6bc6 bytes) 2024-09-22T01:35:41.964 INFO:teuthology.orchestra.run.smithi018.stdout:2328 punch from 0x7fc6801 to 0x7fcd852, (0x7051 bytes) 2024-09-22T01:35:41.964 INFO:teuthology.orchestra.run.smithi018.stdout:2329 read 0x9791fd5 thru 0x979788c (0x58b8 bytes) 2024-09-22T01:35:41.964 INFO:teuthology.orchestra.run.smithi018.stdout:2330 punch from 0x95a2ae7 to 0x95a37be, (0xcd7 bytes) 2024-09-22T01:35:41.964 INFO:teuthology.orchestra.run.smithi018.stdout:2332 write 0xa43e548 thru 0xa44b090 (0xcb49 bytes) 2024-09-22T01:35:41.984 INFO:teuthology.orchestra.run.smithi018.stdout:2333 write 0xe7a2e5e thru 0xe7afaad (0xcc50 bytes) 2024-09-22T01:35:41.986 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:41.984+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:41.989 INFO:teuthology.orchestra.run.smithi018.stdout:2335 write 0x90ba873 thru 0x90be7f1 (0x3f7f bytes) 2024-09-22T01:35:41.991 INFO:teuthology.orchestra.run.smithi018.stdout:2337 read 0x50c096d thru 0x50c1a85 (0x1119 bytes) 2024-09-22T01:35:41.991 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:42.003 INFO:teuthology.orchestra.run.smithi018.stdout:2340 trunc from 0xe7afaae to 0xa18b55d 2024-09-22T01:35:42.034 INFO:teuthology.orchestra.run.smithi018.stdout:2343 write 0x29c5db0 thru 0x29ce38c (0x85dd bytes) 2024-09-22T01:35:42.041 INFO:teuthology.orchestra.run.smithi018.stdout:2344 read 0x3fbd7b4 thru 0x3fbddac (0x5f9 bytes) 2024-09-22T01:35:42.042 INFO:teuthology.orchestra.run.smithi018.stdout:2345 punch from 0x44f376e to 0x44fbfa8, (0x883a bytes) 2024-09-22T01:35:42.042 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:42.042 INFO:teuthology.orchestra.run.smithi018.stdout:2347 read 0x726ba85 thru 0x7279ee4 (0xe460 bytes) 2024-09-22T01:35:42.042 INFO:teuthology.orchestra.run.smithi018.stdout:2350 write 0x11c8bab thru 0x11d3786 (0xabdc bytes) 2024-09-22T01:35:42.045 INFO:teuthology.orchestra.run.smithi018.stdout:2352 writesame 0x1500e0 thru 0x15fe3e data_size 0x3(0xfd5f bytes) 2024-09-22T01:35:42.063 INFO:teuthology.orchestra.run.smithi018.stdout:2353 read 0x6eefa5b thru 0x6ef58b6 (0x5e5c bytes) 2024-09-22T01:35:42.063 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:42.057+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:42.063 INFO:teuthology.orchestra.run.smithi018.stdout:2354 read 0x6338e26 thru 0x633d042 (0x421d bytes) 2024-09-22T01:35:42.063 INFO:teuthology.orchestra.run.smithi018.stdout:2355 punch from 0x6fa5df to 0x6ff41f, (0x4e40 bytes) 2024-09-22T01:35:42.064 INFO:teuthology.orchestra.run.smithi018.stdout:2356 read 0x2010d3b thru 0x201e4cb (0xd791 bytes) 2024-09-22T01:35:42.064 INFO:teuthology.orchestra.run.smithi018.stdout:2357 clone 18 order 25 su 262144 sc 13 2024-09-22T01:35:42.111 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:42.111 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:42.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:42.169 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:42.168+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:42.246 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:42.246 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:42.260 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:42.302 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:42.300+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:42.365 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:42.361+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:42.427 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:42.427 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:42.441 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:42.466 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:42.461+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:42.559 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:42.560 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:42.567 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:42.561+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:42.573 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:42.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:42.696 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:42.693+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:42.696 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:42.696 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:42.712 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:42.768 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:42.764+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:42.808 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:42.809 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:42.825 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:42.826 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:42.834 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:42.834 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:42.842 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:42.842 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:42.848 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:42.859 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:42.859 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:42.869 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:42.865+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:42.876 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:42.876 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:42.896 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:42.896 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:42.916 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:42.916 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:42.935 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:42.935 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:42.970 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:42.968+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:42.979 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone17 from 0xa18b55d (overlap 0x608c27) to 0x4d3cec 2024-09-22T01:35:43.022 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:43.022 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:43.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.022 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:88554 3.d 3:b300b61b:::rbd_header.110f4c2e80cb:head [watch unwatch cookie 140215314888784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-22T01:35:43.022 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:43.022012+0000", 2024-09-22T01:35:43.022 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00073036300000000004, 2024-09-22T01:35:43.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00075050500000000005, 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 88554 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022012+0000", 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022012+0000", 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022013+0000", 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.39e-06 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022021+0000", 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2869999999999999e-06 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022043+0000", 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2432000000000001e-05 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022059+0000", 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5639999999999999e-05 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022526+0000", 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00046759500000000001 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022631+0000", 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010504400000000001 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:88555 3.d 3.d86d00cd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:43.022566+0000", 2024-09-22T01:35:43.026 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00017605, 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024069400000000001, 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 88555 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022566+0000", 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022566+0000", 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022568+0000", 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.917e-06 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022580+0000", 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1725999999999999e-05 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022606+0000", 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6279e-05 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:43.022625+0000", 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8533e-05 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.029 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:35:43.030 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 2 2024-09-22T01:35:43.030 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:43.037 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:43.071 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:43.065+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:43.090 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-22T01:35:43.172 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:43.169+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:43.206 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:43.207 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:43.207 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:43.207 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:43.207 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:43.220 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:43.272 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:43.268+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:43.357 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:43.357 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:43.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:43.357 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:43.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.357 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:35:43.357 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:43.357 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.045329686000002, 2024-09-22T01:35:43.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:35:43.357 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:35:43.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:35:43.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.514556990000003, 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:35:43.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:35:43.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:35:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.514329709999998, 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.368 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:35:43.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:35:43.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.511161426000001, 2024-09-22T01:35:43.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:35:43.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.511077161999999, 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.380 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.511025666000002, 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.381 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:35:43.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:35:43.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.384 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.510980345999997, 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.385 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:35:43.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:35:43.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:35:43.388 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.507500088999997, 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.507195277000001, 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.507145833000003, 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.397 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.398 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:35:43.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:35:43.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.507101278999997, 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:35:43.401 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:35:43.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.507057629000002, 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.406 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:35:43.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:35:43.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:35:43.409 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.507010407999999, 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.410 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:35:43.412 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:35:43.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.506815402000001, 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.414 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:35:43.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.418 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.506765915000003, 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.422 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.503614855999999, 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.426 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.503269228000001, 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.427 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.503173805000003, 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:35:43.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:35:43.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:35:43.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.503121225999998, 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:43.438 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 38.503079458999999, 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:43.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:35:43.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:35:43.442 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.442 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.442 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.442 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:43.442 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:43.442 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:43.443 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:43.440+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:43.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:43.544 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:43.540+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:43.576 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:43.576 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:43.576 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:43.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:43.631 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:43.631 INFO:teuthology.orchestra.run.smithi018.stdout:2359 write 0x595e3db thru 0x595fd14 (0x193a bytes) 2024-09-22T01:35:43.645 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:43.644+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:43.651 INFO:teuthology.orchestra.run.smithi018.stdout:2360 read 0x9b24943 thru 0x9b2d5dc (0x8c9a bytes) 2024-09-22T01:35:43.651 INFO:teuthology.orchestra.run.smithi018.stdout:2362 read 0x557ba57 thru 0x5587a5d (0xc007 bytes) 2024-09-22T01:35:43.651 INFO:teuthology.orchestra.run.smithi018.stdout:2364 writesame 0x8e7d7c thru 0x8f45e8 data_size 0x3(0xc86d bytes) 2024-09-22T01:35:43.683 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:43.683 INFO:teuthology.orchestra.run.smithi018.stdout:2366 read 0x5d5e7fe thru 0x5d66d7e (0x8581 bytes) 2024-09-22T01:35:43.684 INFO:teuthology.orchestra.run.smithi018.stdout:2367 punch from 0x71bb7d6 to 0x71be8a8, (0x30d2 bytes) 2024-09-22T01:35:43.684 INFO:teuthology.orchestra.run.smithi018.stdout:2368 write 0x7fd0a4e thru 0x7fd849a (0x7a4d bytes) 2024-09-22T01:35:43.696 INFO:teuthology.orchestra.run.smithi018.stdout:2370 punch from 0x459623 to 0x462e10, (0x97ed bytes) 2024-09-22T01:35:43.697 INFO:teuthology.orchestra.run.smithi018.stdout:2371 writesame 0x2c997af thru 0x2ca1d32 data_size 0xa(0x8584 bytes) 2024-09-22T01:35:43.703 INFO:teuthology.orchestra.run.smithi018.stdout:2372 clone 19 order 25 su 262144 sc 2 2024-09-22T01:35:43.717 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:43.717 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:43.718 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:43.718 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:43.732 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:43.746 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:43.744+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:43.847 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:43.841+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:43.910 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:43.910 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:43.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:43.910 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:43.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.910 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48565 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 708608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.440233651, 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086712429999999993, 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48565 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466221+0000", 2024-09-22T01:35:43.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9299999999999998e-07 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466224+0000", 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.977e-06 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466233+0000", 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1419999999999999e-06 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466240+0000", 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6800000000000004e-06 2024-09-22T01:35:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552634+0000", 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086394356000000005 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552731+0000", 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6681000000000005e-05 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552933+0000", 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020200099999999999 2024-09-22T01:35:43.914 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48566 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 718848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.440205472000002, 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086846866999999994, 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48566 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:43.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.06e-07 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466252+0000", 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.813e-06 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466261+0000", 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7260000000000008e-06 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466267+0000", 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5400000000000001e-06 2024-09-22T01:35:43.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552974+0000", 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086707237000000006 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553025+0000", 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0380000000000002e-05 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553095+0000", 2024-09-22T01:35:43.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0564999999999999e-05 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48654 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.435962431999997, 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086747482000000001, 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.919 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48654 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5700000000000001e-07 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470498+0000", 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470515+0000", 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7742000000000001e-05 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470546+0000", 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0586000000000002e-05 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557000+0000", 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086454002000000002 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557110+0000", 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010961 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557239+0000", 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48655 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 638976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.435886861999997, 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086840121000000006, 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.923 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48655 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470569+0000", 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5400000000000001e-06 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470575+0000", 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1399999999999997e-06 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470597+0000", 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1676e-05 2024-09-22T01:35:43.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470614+0000", 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7336000000000001e-05 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557279+0000", 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086664832999999997 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557341+0000", 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2073e-05 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557407+0000", 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6523e-05 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.927 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.435783678999996, 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:43.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:35:43.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:35:43.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.435709269, 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:35:43.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:35:43.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:35:43.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.435652738000002, 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.435595143999997, 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.940 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:35:43.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:35:43.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.435537805999999, 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:35:43.944 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.948 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.435480364999997, 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:35:43.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:43.952 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.435444455999999, 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:35:43.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48750 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.956 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.430541654999999, 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086758792000000001, 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48750 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:43.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475914+0000", 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.263e-06 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475919+0000", 2024-09-22T01:35:43.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.84e-06 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475937+0000", 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7689e-05 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475951+0000", 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3439e-05 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562548+0000", 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086597376000000004 2024-09-22T01:35:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562605+0000", 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7367999999999997e-05 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562671+0000", 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5816999999999997e-05 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48751 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 641024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.430467325000002, 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086829097999999993, 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48751 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.961 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475988+0000", 2024-09-22T01:35:43.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.47e-07 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475994+0000", 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1260000000000003e-06 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476019+0000", 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5471999999999999e-05 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476033+0000", 2024-09-22T01:35:43.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100000000000001e-05 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562691+0000", 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086657746999999993 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562750+0000", 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9188000000000003e-05 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562816+0000", 2024-09-22T01:35:43.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5518000000000005e-05 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.430400757999998, 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:35:43.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.430337317000003, 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.430282079999998, 2024-09-22T01:35:43.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.430208766, 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:35:43.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.430154684999998, 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.982 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.430100246999999, 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.986 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:35:43.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:35:43.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 35.430044385999999, 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:35:43.990 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:43.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:43.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:43.994 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:43.994 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:35:43.996 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:43.997 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:43.992+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:44.075 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone18 from 0xa18b55d (overlap 0xa18b55d) to 0x813c44a 2024-09-22T01:35:44.097 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:44.092+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:44.180 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:44.180 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:44.180 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:44.180 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:44.195 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:44.196 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:44.193+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:44.298 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:44.296+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:44.315 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:44.315 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:44.330 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:44.399 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:44.393+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:44.462 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:44.462 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:44.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:44.462 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.659838366000001, 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.463 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:44.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.468 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.659783190000001, 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:44.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.659718077000001, 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.474 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:44.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:35:44.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:35:44.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.65965233, 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:35:44.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:35:44.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.65961486, 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:35:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:35:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:35:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:35:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.659564244, 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.491 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.658378904999999, 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:35:44.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.502 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.658317078, 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:35:44.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.658268279, 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:44.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:35:44.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.658194726, 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:35:44.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:35:44.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.658124264, 2024-09-22T01:35:44.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:35:44.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:35:44.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:35:44.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.524 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.658053761, 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:35:44.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:35:44.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:35:44.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:35:44.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:35:44.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.658006529, 2024-09-22T01:35:44.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:35:44.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:35:44.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.657943653, 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:35:44.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.541 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.657902987, 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:44.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:35:44.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:44.547 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.65780812, 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:44.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.657767083, 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.553 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.558 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.657729592000001, 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:35:44.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.657689443000001, 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:35:44.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.657646648, 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:44.570 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:44.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:35:44.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:35:44.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:35:44.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:44.575 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:44.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:44.577 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-22T01:35:44.578 INFO:teuthology.orchestra.run.smithi018.stdout:2373 read 0x2a7a585 thru 0x2a859e9 (0xb465 bytes) 2024-09-22T01:35:44.578 INFO:teuthology.orchestra.run.smithi018.stdout:2374 write 0xa640ac0 thru 0xa64bf2b (0xb46c bytes) 2024-09-22T01:35:44.578 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:44.573+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:44.599 INFO:teuthology.orchestra.run.smithi018.stdout:2375 write 0xbe876ad thru 0xbe8e72f (0x7083 bytes) 2024-09-22T01:35:44.657 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:44.657 INFO:teuthology.orchestra.run.smithi018.stdout:2378 writesame 0x6e37039 thru 0x6e3970c data_size 0x1c(0x26d4 bytes) 2024-09-22T01:35:44.678 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:44.673+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:44.678 INFO:teuthology.orchestra.run.smithi018.stdout:2379 punch from 0x14cdcd to 0x1595fc, (0xc82f bytes) 2024-09-22T01:35:44.692 INFO:teuthology.orchestra.run.smithi018.stdout:2380 write 0xbe9b9ab thru 0xbea75b3 (0xbc09 bytes) 2024-09-22T01:35:44.698 INFO:teuthology.orchestra.run.smithi018.stdout:2381 trunc from 0xbea75b4 to 0xb075334 2024-09-22T01:35:44.714 INFO:teuthology.orchestra.run.smithi018.stdout:2382 read 0x973b738 thru 0x974311d (0x79e6 bytes) 2024-09-22T01:35:44.715 INFO:teuthology.orchestra.run.smithi018.stdout:2383 read 0x8c44141 thru 0x8c52b22 (0xe9e2 bytes) 2024-09-22T01:35:44.716 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:44.735 INFO:teuthology.orchestra.run.smithi018.stdout:2385 write 0xd451e7f thru 0xd451ed9 (0x5b bytes) 2024-09-22T01:35:44.739 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:44.739 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:44.739 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:44.739 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:44.743 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:44.743 INFO:teuthology.orchestra.run.smithi018.stdout:2387 write 0x471da50 thru 0x4727b7a (0xa12b bytes) 2024-09-22T01:35:44.746 INFO:teuthology.orchestra.run.smithi018.stdout:2388 writesame 0x2633391 thru 0x2638681 data_size 0x1(0x52f1 bytes) 2024-09-22T01:35:44.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:44.778 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:44.776+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:44.854 INFO:teuthology.orchestra.run.smithi018.stdout:2389 punch from 0xc97dc46 to 0xc98dbcf, (0xff89 bytes) 2024-09-22T01:35:44.854 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:44.854 INFO:teuthology.orchestra.run.smithi018.stdout:2391 writesame 0x27764e9 thru 0x2785257 data_size 0x1(0xed6f bytes) 2024-09-22T01:35:44.879 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:44.873+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:44.918 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:35:44.950 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:44.950 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:44.950 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:44.951 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:44.951 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:44.955 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:44.955 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:44.958 INFO:teuthology.orchestra.run.smithi018.stdout:2393 trunc from 0xd451eda to 0xb59ab3b 2024-09-22T01:35:44.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:44.980 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:44.976+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:44.989 INFO:teuthology.orchestra.run.smithi018.stdout:2394 read 0x249a3ce thru 0x24a744c (0xd07f bytes) 2024-09-22T01:35:44.991 INFO:teuthology.orchestra.run.smithi018.stdout:2395 read 0x8b4f473 thru 0x8b5d358 (0xdee6 bytes) 2024-09-22T01:35:44.992 INFO:teuthology.orchestra.run.smithi018.stdout:2396 read 0x6f4325e thru 0x6f527de (0xf581 bytes) 2024-09-22T01:35:44.992 INFO:teuthology.orchestra.run.smithi018.stdout:2398 writesame 0x5011bbe thru 0x501592d data_size 0x8(0x3d70 bytes) 2024-09-22T01:35:45.008 INFO:teuthology.orchestra.run.smithi018.stdout:2399 trunc from 0xb59ab3b to 0x3e7d5ba 2024-09-22T01:35:45.053 INFO:teuthology.orchestra.run.smithi018.stdout:2400 trunc from 0x3e7d5ba to 0xbf9e44b 2024-09-22T01:35:45.065 INFO:teuthology.orchestra.run.smithi018.stdout:2402 punch from 0xb1f8960 to 0xb1fb8c4, (0x2f64 bytes) 2024-09-22T01:35:45.065 INFO:teuthology.orchestra.run.smithi018.stdout:2403 write 0xb37f80c thru 0xb38149e (0x1c93 bytes) 2024-09-22T01:35:45.081 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:45.076+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:45.091 INFO:teuthology.orchestra.run.smithi018.stdout:2404 writesame 0xde13651 thru 0xde1e56a data_size 0x5d(0xaf1a bytes) 2024-09-22T01:35:45.091 INFO:teuthology.orchestra.run.smithi018.stdout:2405 write 0x933042 thru 0x941758 (0xe717 bytes) 2024-09-22T01:35:45.095 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:45.095 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:45.095 INFO:teuthology.orchestra.run.smithi018.stdout:2409 punch from 0x6b5f81a to 0x6b6c941, (0xd127 bytes) 2024-09-22T01:35:45.096 INFO:teuthology.orchestra.run.smithi018.stdout:2412 writesame 0xafe7492 thru 0xafed2f9 data_size 0x18(0x5e68 bytes) 2024-09-22T01:35:45.096 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7] out_osds: [2, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:45.096 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:35:45.096 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-22T01:35:45.096 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-22T01:35:45.096 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-22T01:35:45.096 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-22T01:35:45.100 INFO:teuthology.orchestra.run.smithi018.stdout:2413 punch from 0xbc29540 to 0xbc2bd6c, (0x282c bytes) 2024-09-22T01:35:45.100 INFO:teuthology.orchestra.run.smithi018.stdout:2414 read 0xd383d01 thru 0xd38aded (0x70ed bytes) 2024-09-22T01:35:45.100 INFO:teuthology.orchestra.run.smithi018.stdout:2415 read 0xa974315 thru 0xa974869 (0x555 bytes) 2024-09-22T01:35:45.100 INFO:teuthology.orchestra.run.smithi018.stdout:2418 read 0x8cbc738 thru 0x8cc0e52 (0x471b bytes) 2024-09-22T01:35:45.100 INFO:teuthology.orchestra.run.smithi018.stdout:2419 writesame 0x572d5f thru 0x57db87 data_size 0x25(0xae29 bytes) 2024-09-22T01:35:45.103 INFO:teuthology.orchestra.run.smithi018.stdout:2420 read 0x5b78d8f thru 0x5b8158d (0x87ff bytes) 2024-09-22T01:35:45.103 INFO:teuthology.orchestra.run.smithi018.stdout:2422 read 0xd2d5efb thru 0xd2d827f (0x2385 bytes) 2024-09-22T01:35:45.103 INFO:teuthology.orchestra.run.smithi018.stdout:2423 punch from 0x81300f5 to 0x8131683, (0x158e bytes) 2024-09-22T01:35:45.103 INFO:teuthology.orchestra.run.smithi018.stdout:2424 punch from 0x58f619f to 0x58f85ae, (0x240f bytes) 2024-09-22T01:35:45.106 INFO:teuthology.orchestra.run.smithi018.stdout:2426 trunc from 0xde1e56b to 0xbd8754e 2024-09-22T01:35:45.117 INFO:teuthology.orchestra.run.smithi018.stdout:2427 writesame 0x256e8b5 thru 0x2575425 data_size 0x1(0x6b71 bytes) 2024-09-22T01:35:45.121 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:45.121 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:45.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:45.121 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:45.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.121 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:35:45.122 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:45.122 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.119218423, 2024-09-22T01:35:45.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:35:45.122 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:45.123 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:45.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:45.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:35:45.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:35:45.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:35:45.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:35:45.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:35:45.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:35:45.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:35:45.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:35:45.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:35:45.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:35:45.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:35:45.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:35:45.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:45.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:35:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:35:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:35:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:35:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.789568770000002, 2024-09-22T01:35:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:35:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:35:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:35:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 50.789425264999998, 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:35:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:35:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.014105993000001, 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:35:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 40.013040298, 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:35:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.705007807999998, 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:35:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:35:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.704633514000001, 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:35:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:35:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:35:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:35:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:35:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:35:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54465 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.296773666, 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050651180000000004, 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54465 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821068+0000", 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821078+0000", 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0164e-05 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821107+0000", 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8985000000000001e-05 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821121+0000", 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.307e-05 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821387+0000", 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026639200000000001 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821395+0000", 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3040000000000005e-06 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825493+0000", 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040977399999999999 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825630+0000", 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136971 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826131+0000", 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050110499999999995 2024-09-22T01:35:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54466 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.296687136999999, 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052214690000000003, 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54466 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821153+0000", 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7499999999999999e-07 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821158+0000", 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3800000000000004e-06 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821169+0000", 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1124000000000001e-05 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821177+0000", 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1040000000000007e-06 2024-09-22T01:35:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821467+0000", 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029025299999999997 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821474+0000", 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826170+0000", 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046964709999999998 2024-09-22T01:35:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826261+0000", 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0708e-05 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826374+0000", 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113182 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54467 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.296650805999999, 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054437169999999998, 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54467 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1900000000000002e-07 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821193+0000", 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4130000000000002e-06 2024-09-22T01:35:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821202+0000", 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821209+0000", 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8800000000000002e-06 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821504+0000", 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029444600000000002 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821509+0000", 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5500000000000002e-06 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826415+0000", 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004905492 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826527+0000", 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112144 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826633+0000", 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105795 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54510 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.296620873999998, 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057311339999999997, 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54510 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821245+0000", 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5774000000000001e-05 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821257+0000", 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2045000000000001e-05 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821265+0000", 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821538+0000", 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027359599999999997 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821544+0000", 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7450000000000001e-06 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826699+0000", 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051546229999999997 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826815+0000", 2024-09-22T01:35:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011646600000000001 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826950+0000", 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013463700000000001 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54511 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.296562401999999, 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058910409999999996, 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54511 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821278+0000", 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821282+0000", 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821291+0000", 2024-09-22T01:35:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3039999999999994e-06 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821298+0000", 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.041e-06 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821573+0000", 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000274283 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821578+0000", 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0679999999999996e-06 2024-09-22T01:35:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827015+0000", 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054370670000000003 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827070+0000", 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5773999999999998e-05 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827168+0000", 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7814999999999998e-05 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54512 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.2965315, 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061320309999999996, 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54512 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821309+0000", 2024-09-22T01:35:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.51e-07 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821312+0000", 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0419999999999998e-06 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821320+0000", 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.422e-06 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821332+0000", 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1951e-05 2024-09-22T01:35:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821937+0000", 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060522400000000002 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821944+0000", 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.404e-06 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827219+0000", 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052754389999999998 2024-09-22T01:35:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827317+0000", 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7536999999999998e-05 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827440+0000", 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123461 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54555 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.296062469999999, 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059477050000000002, 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54555 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821778+0000", 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0500000000000002e-07 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821783+0000", 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.135e-06 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821798+0000", 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4688000000000001e-05 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821808+0000", 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6690000000000001e-06 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821977+0000", 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169541 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821982+0000", 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-06 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827481+0000", 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054988470000000003 2024-09-22T01:35:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827582+0000", 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100554 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827725+0000", 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014320199999999999 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54556 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.296015650000001, 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00620654, 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54556 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821825+0000", 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821828+0000", 2024-09-22T01:35:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8809999999999998e-06 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821839+0000", 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.027e-05 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821846+0000", 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822011+0000", 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-09-22T01:35:45.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822017+0000", 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6099999999999997e-06 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827802+0000", 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057848509999999997 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827892+0000", 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0880999999999999e-05 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828030+0000", 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013803200000000001 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54557 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.295981356999999, 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064190469999999998, 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54557 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821859+0000", 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.99e-07 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821863+0000", 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6569999999999999e-06 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821871+0000", 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9719999999999998e-06 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821878+0000", 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.917e-06 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822045+0000", 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016703000000000001 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822051+0000", 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.626e-06 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828069+0000", 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060179919999999998 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828161+0000", 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1731999999999995e-05 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828277+0000", 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011652199999999999 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54600 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.295545784000002, 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062310530000000003, 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.249 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54600 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:45.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822295+0000", 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.19e-06 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822301+0000", 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5010000000000004e-06 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822320+0000", 2024-09-22T01:35:45.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9724e-05 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822330+0000", 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3899999999999999e-06 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822464+0000", 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013444100000000001 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822470+0000", 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3690000000000003e-06 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828314+0000", 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058434719999999997 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828405+0000", 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1166000000000001e-05 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828525+0000", 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001198 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54601 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.295488165999998, 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064068470000000002, 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54601 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822352+0000", 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822356+0000", 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6519999999999999e-06 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822366+0000", 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0686000000000001e-05 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822374+0000", 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4200000000000001e-06 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822500+0000", 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012665800000000001 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822505+0000", 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.938e-06 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828560+0000", 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060544969999999998 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828651+0000", 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0758000000000001e-05 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828758+0000", 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010760900000000001 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54602 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.295453773999999, 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066069279999999998, 2024-09-22T01:35:45.259 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54602 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6599999999999996e-07 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822390+0000", 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.377e-06 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822399+0000", 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822406+0000", 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822534+0000", 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012761900000000001 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822539+0000", 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3639999999999998e-06 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828797+0000", 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006257365 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828885+0000", 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8818000000000002e-05 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828993+0000", 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107336 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54688 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 30.291572889000001, 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044478340000000003, 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:45.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54688 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:45.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826268+0000", 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-06 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826274+0000", 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826294+0000", 2024-09-22T01:35:45.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0211999999999999e-05 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826310+0000", 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6039999999999999e-05 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830569+0000", 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004258632 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830641+0000", 2024-09-22T01:35:45.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2064000000000007e-05 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830715+0000", 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3483000000000001e-05 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:45.268 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:45.269 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:45.270 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:45.270 INFO:teuthology.orchestra.run.smithi018.stdout:2428 clone 20 order 24 su 4194304 sc 11 2024-09-22T01:35:45.271 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:45.271 INFO:teuthology.orchestra.run.smithi179.stdout: "success": "" 2024-09-22T01:35:45.271 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:45.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:45.272 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:45.272 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:45.272 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:45.273 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:45.273 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:45.273 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:45.273 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:45.274 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:45.274 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:45.274 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:45.275 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:45.275 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:45.275 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:45.275 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:45.265+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:45.371 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:45.368+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:45.449 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:45.450 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:45.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:45.508 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:45.505+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:45.572 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:45.568+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:45.591 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:45.591 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:45.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:45.692 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:45.689+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:45.769 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:45.769 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:45.773 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:45.772+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:45.783 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:45.875 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:45.869+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:45.916 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:45.916 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:45.935 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:45.975 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:45.969+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:46.062 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:46.062 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:46.076 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:46.072+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:46.078 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:46.088 INFO:teuthology.orchestra.run.smithi018.stdout:flattening image image_client.0-clone19 2024-09-22T01:35:46.177 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:46.176+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:46.240 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:46.240 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:46.254 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:46.302 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:46.300+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:46.346 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-22T01:35:46.379 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:46.373+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:46.422 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:46.423 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:46.437 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:46.482 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:46.480+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:46.555 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:46.555 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:46.569 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:46.614 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:46.612+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:46.660 INFO:teuthology.orchestra.run.smithi018.stdout:2430 punch from 0x2056de0 to 0x2060fa4, (0xa1c4 bytes) 2024-09-22T01:35:46.667 INFO:teuthology.orchestra.run.smithi018.stdout:2431 punch from 0x8a874aa to 0x8a875e6, (0x13c bytes) 2024-09-22T01:35:46.667 INFO:teuthology.orchestra.run.smithi018.stdout:2432 punch from 0xa841057 to 0xa842fdb, (0x1f84 bytes) 2024-09-22T01:35:46.667 INFO:teuthology.orchestra.run.smithi018.stdout:2433 read 0x38e2453 thru 0x38ee64a (0xc1f8 bytes) 2024-09-22T01:35:46.678 INFO:teuthology.orchestra.run.smithi018.stdout:2435 write 0xce4288b thru 0xce48231 (0x59a7 bytes) 2024-09-22T01:35:46.682 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:46.680+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:46.684 INFO:teuthology.orchestra.run.smithi018.stdout:2438 read 0xc3ee169 thru 0xc3fdffd (0xfe95 bytes) 2024-09-22T01:35:46.684 INFO:teuthology.orchestra.run.smithi018.stdout:2439 read 0xaf2457a thru 0xaf314e4 (0xcf6b bytes) 2024-09-22T01:35:46.684 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:46.694 INFO:teuthology.orchestra.run.smithi018.stdout:2443 writesame 0xd1aa552 thru 0xd1ae5c2 data_size 0x2f(0x4071 bytes) 2024-09-22T01:35:46.694 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:46.694 INFO:teuthology.orchestra.run.smithi018.stdout:2445 read 0xc77dc48 thru 0xc7879d5 (0x9d8e bytes) 2024-09-22T01:35:46.695 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:46.695 INFO:teuthology.orchestra.run.smithi018.stdout:2449 read 0xb5e675d thru 0xb5e7160 (0xa04 bytes) 2024-09-22T01:35:46.695 INFO:teuthology.orchestra.run.smithi018.stdout:2450 punch from 0x64697c0 to 0x646d3f4, (0x3c34 bytes) 2024-09-22T01:35:46.706 INFO:teuthology.orchestra.run.smithi018.stdout:2451 trunc from 0xd1ae5c3 to 0x6497691 2024-09-22T01:35:46.761 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:46.761 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:46.775 INFO:teuthology.orchestra.run.smithi018.stdout:2452 write 0x1b96555 thru 0x1b97617 (0x10c3 bytes) 2024-09-22T01:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:46.777 INFO:teuthology.orchestra.run.smithi018.stdout:2459 writesame 0xa51cc3 thru 0xa56824 data_size 0x1(0x4b62 bytes) 2024-09-22T01:35:46.778 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:46.789 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:46.789 INFO:teuthology.orchestra.run.smithi018.stdout:2463 read 0x1ab1712 thru 0x1abcff8 (0xb8e7 bytes) 2024-09-22T01:35:46.819 INFO:teuthology.orchestra.run.smithi018.stdout:2465 writesame 0xe7c6773 thru 0xe7cba29 data_size 0x4d(0x52b7 bytes) 2024-09-22T01:35:46.822 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:46.820+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:2467 write 0xe8e4c22 thru 0xe8e7fe5 (0x33c4 bytes) 2024-09-22T01:35:46.842 INFO:teuthology.orchestra.run.smithi018.stdout:2468 write 0xeb51c7b thru 0xeb5c512 (0xa898 bytes) 2024-09-22T01:35:46.843 INFO:teuthology.orchestra.run.smithi018.stdout:2469 writesame 0x92470d7 thru 0x925301f data_size 0x3(0xbf49 bytes) 2024-09-22T01:35:46.854 INFO:teuthology.orchestra.run.smithi018.stdout:2471 read 0xa3d5d8a thru 0xa3e0dc3 (0xb03a bytes) 2024-09-22T01:35:46.855 INFO:teuthology.orchestra.run.smithi018.stdout:2472 writesame 0x666badd thru 0x6673816 data_size 0x75(0x7d3a bytes) 2024-09-22T01:35:46.857 INFO:teuthology.orchestra.run.smithi018.stdout:2473 read 0x7f3b6e9 thru 0x7f44c55 (0x956d bytes) 2024-09-22T01:35:46.858 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:46.858 INFO:teuthology.orchestra.run.smithi018.stdout:2475 read 0x146f8b thru 0x14cf55 (0x5fcb bytes) 2024-09-22T01:35:46.865 INFO:teuthology.orchestra.run.smithi018.stdout:2476 trunc from 0xeb5c513 to 0xcb934c0 2024-09-22T01:35:46.877 INFO:teuthology.orchestra.run.smithi018.stdout:2480 read 0x744f8e6 thru 0x745aa36 (0xb151 bytes) 2024-09-22T01:35:46.877 INFO:teuthology.orchestra.run.smithi018.stdout:2481 writesame 0x9c71594 thru 0x9c7f099 data_size 0x7e(0xdb06 bytes) 2024-09-22T01:35:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:2482 write 0xca4ed45 thru 0xca5d71d (0xe9d9 bytes) 2024-09-22T01:35:46.883 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:46.880+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:2483 read 0x20720d3 thru 0x2080258 (0xe186 bytes) 2024-09-22T01:35:46.900 INFO:teuthology.orchestra.run.smithi018.stdout:2486 trunc from 0xcb934c0 to 0x7d1f2e5 2024-09-22T01:35:46.922 INFO:teuthology.orchestra.run.smithi018.stdout:2487 write 0x1e04106 thru 0x1e0d036 (0x8f31 bytes) 2024-09-22T01:35:46.924 INFO:teuthology.orchestra.run.smithi018.stdout:2488 write 0x531406a thru 0x531b16f (0x7106 bytes) 2024-09-22T01:35:46.926 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:2490 trunc from 0x7d1f2e5 to 0x4d9bba1 2024-09-22T01:35:46.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:35:46.952 INFO:teuthology.orchestra.run.smithi018.stdout:2491 write 0x3a3af89 thru 0x3a42b18 (0x7b90 bytes) 2024-09-22T01:35:46.957 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:46.958 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:46.971 INFO:teuthology.orchestra.run.smithi018.stdout:2492 write 0x809d0d9 thru 0x80a765e (0xa586 bytes) 2024-09-22T01:35:46.973 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:46.984 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:46.981+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:46.996 INFO:teuthology.orchestra.run.smithi018.stdout:2493 writesame 0xd3e797c thru 0xd3f1082 data_size 0x17(0x9707 bytes) 2024-09-22T01:35:46.996 INFO:teuthology.orchestra.run.smithi018.stdout:2494 write 0x709201c thru 0x709df8b (0xbf70 bytes) 2024-09-22T01:35:46.998 INFO:teuthology.orchestra.run.smithi018.stdout:2495 write 0xad0b7fa thru 0xad19384 (0xdb8b bytes) 2024-09-22T01:35:47.001 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.003 INFO:teuthology.orchestra.run.smithi018.stdout:2498 trunc from 0xd3f1083 to 0xc1fa9dd 2024-09-22T01:35:47.012 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.012 INFO:teuthology.orchestra.run.smithi018.stdout:2501 punch from 0x19442f4 to 0x1946d35, (0x2a41 bytes) 2024-09-22T01:35:47.030 INFO:teuthology.orchestra.run.smithi018.stdout:2502 trunc from 0xc1fa9dd to 0x4b00c12 2024-09-22T01:35:47.045 INFO:teuthology.orchestra.run.smithi018.stdout:2503 read 0xfde4c thru 0x1007be (0x2973 bytes) 2024-09-22T01:35:47.064 INFO:teuthology.orchestra.run.smithi018.stdout:2504 write 0x8807d8f thru 0x880c671 (0x48e3 bytes) 2024-09-22T01:35:47.066 INFO:teuthology.orchestra.run.smithi018.stdout:2505 write 0xced9f3 thru 0xcf72bb (0x98c9 bytes) 2024-09-22T01:35:47.080 INFO:teuthology.orchestra.run.smithi018.stdout:2506 write 0xa432c23 thru 0xa4335c9 (0x9a7 bytes) 2024-09-22T01:35:47.083 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.083 INFO:teuthology.orchestra.run.smithi018.stdout:2508 write 0x1d523b1 thru 0x1d556a6 (0x32f6 bytes) 2024-09-22T01:35:47.085 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.085 INFO:teuthology.orchestra.run.smithi018.stdout:2511 punch from 0x54a300a to 0x54a7260, (0x4256 bytes) 2024-09-22T01:35:47.086 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:47.084+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:47.094 INFO:teuthology.orchestra.run.smithi018.stdout:2512 write 0xc0b215a thru 0xc0b34ab (0x1352 bytes) 2024-09-22T01:35:47.099 INFO:teuthology.orchestra.run.smithi018.stdout:2513 read 0xa1cf7d thru 0xa24ba6 (0x7c2a bytes) 2024-09-22T01:35:47.104 INFO:teuthology.orchestra.run.smithi018.stdout:2514 trunc from 0xc0b34ac to 0x9004efc 2024-09-22T01:35:47.120 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.125 INFO:teuthology.orchestra.run.smithi018.stdout:2516 trunc from 0x9004efc to 0x5421c84 2024-09-22T01:35:47.138 INFO:teuthology.orchestra.run.smithi018.stdout:2517 read 0x41d7af2 thru 0x41d8015 (0x524 bytes) 2024-09-22T01:35:47.139 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.139 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.151 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:47.151 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:47.159 INFO:teuthology.orchestra.run.smithi018.stdout:2523 write 0xbe79b3f thru 0xbe81d30 (0x81f2 bytes) 2024-09-22T01:35:47.167 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:47.172 INFO:teuthology.orchestra.run.smithi018.stdout:2524 trunc from 0xbe81d31 to 0x7c2ad50 2024-09-22T01:35:47.194 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.194 INFO:teuthology.orchestra.run.smithi018.stdout:2528 read 0x42fac64 thru 0x42fc6a2 (0x1a3f bytes) 2024-09-22T01:35:47.199 INFO:teuthology.orchestra.run.smithi018.stdout:2531 trunc from 0x7c2ad50 to 0xa189298 2024-09-22T01:35:47.210 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.210 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:47.208+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:47.222 INFO:teuthology.orchestra.run.smithi018.stdout:2534 trunc from 0xa189298 to 0x46e61e6 2024-09-22T01:35:47.237 INFO:teuthology.orchestra.run.smithi018.stdout:2535 read 0x34dcf99 thru 0x34ec5a0 (0xf608 bytes) 2024-09-22T01:35:47.269 INFO:teuthology.orchestra.run.smithi018.stdout:2536 writesame 0xdfc1194 thru 0xdfc5192 data_size 0x2b(0x3fff bytes) 2024-09-22T01:35:47.269 INFO:teuthology.orchestra.run.smithi018.stdout:2538 read 0x504c0bc thru 0x50506db (0x4620 bytes) 2024-09-22T01:35:47.278 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:47.287 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:47.284+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:47.291 INFO:teuthology.orchestra.run.smithi018.stdout:2539 trunc from 0xdfc5193 to 0x439aac2 2024-09-22T01:35:47.308 INFO:teuthology.orchestra.run.smithi018.stdout:2540 read 0x5ecf7c thru 0x5fb62b (0xe6b0 bytes) 2024-09-22T01:35:47.309 INFO:teuthology.orchestra.run.smithi018.stdout:2541 punch from 0x4369e29 to 0x436cfab, (0x3182 bytes) 2024-09-22T01:35:47.338 INFO:teuthology.orchestra.run.smithi018.stdout:2544 writesame 0xd00173e thru 0xd001fcb data_size 0xf(0x88e bytes) 2024-09-22T01:35:47.339 INFO:teuthology.orchestra.run.smithi018.stdout:2546 writesame 0x133b6ee thru 0x13420a4 data_size 0x1f(0x69b7 bytes) 2024-09-22T01:35:47.341 INFO:teuthology.orchestra.run.smithi018.stdout:2547 writesame 0xc0c397a thru 0xc0cde15 data_size 0xac(0xa49c bytes) 2024-09-22T01:35:47.341 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:47.341 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:47.347 INFO:teuthology.orchestra.run.smithi018.stdout:2548 write 0x7c34888 thru 0x7c3e26b (0x99e4 bytes) 2024-09-22T01:35:47.349 INFO:teuthology.orchestra.run.smithi018.stdout:2549 punch from 0x9f62069 to 0x9f6fbd6, (0xdb6d bytes) 2024-09-22T01:35:47.349 INFO:teuthology.orchestra.run.smithi018.stdout:2550 write 0x9b2df15 thru 0x9b3db90 (0xfc7c bytes) 2024-09-22T01:35:47.352 INFO:teuthology.orchestra.run.smithi018.stdout:2551 read 0x63fbabd thru 0x64014e9 (0x5a2d bytes) 2024-09-22T01:35:47.353 INFO:teuthology.orchestra.run.smithi018.stdout:2552 writesame 0xa571c0 thru 0xa64b78 data_size 0xb(0xd9b9 bytes) 2024-09-22T01:35:47.358 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:47.361 INFO:teuthology.orchestra.run.smithi018.stdout:2553 write 0x51acb01 thru 0x51b9d59 (0xd259 bytes) 2024-09-22T01:35:47.363 INFO:teuthology.orchestra.run.smithi018.stdout:2555 read 0x22eb8cc thru 0x22facd8 (0xf40d bytes) 2024-09-22T01:35:47.364 INFO:teuthology.orchestra.run.smithi018.stdout:2556 writesame 0x364cce5 thru 0x36532dc data_size 0x34(0x65f8 bytes) 2024-09-22T01:35:47.367 INFO:teuthology.orchestra.run.smithi018.stdout:2557 read 0xa5b1f0c thru 0xa5c1c65 (0xfd5a bytes) 2024-09-22T01:35:47.367 INFO:teuthology.orchestra.run.smithi018.stdout:2559 read 0x5949afb thru 0x594bce9 (0x21ef bytes) 2024-09-22T01:35:47.373 INFO:teuthology.orchestra.run.smithi018.stdout:2560 trunc from 0xd001fcc to 0xaf65a1f 2024-09-22T01:35:47.393 INFO:teuthology.orchestra.run.smithi018.stdout:2562 write 0x7d31d82 thru 0x7d408c0 (0xeb3f bytes) 2024-09-22T01:35:47.395 INFO:teuthology.orchestra.run.smithi018.stdout:2563 punch from 0x63e0cc0 to 0x63e26a6, (0x19e6 bytes) 2024-09-22T01:35:47.395 INFO:teuthology.orchestra.run.smithi018.stdout:2564 punch from 0x304c07e to 0x3058092, (0xc014 bytes) 2024-09-22T01:35:47.395 INFO:teuthology.orchestra.run.smithi018.stdout:2565 write 0x2011483 thru 0x201ed94 (0xd912 bytes) 2024-09-22T01:35:47.398 INFO:teuthology.orchestra.run.smithi018.stdout:2566 write 0x7221654 thru 0x7227753 (0x6100 bytes) 2024-09-22T01:35:47.400 INFO:teuthology.orchestra.run.smithi018.stdout:2567 read 0x24b14c9 thru 0x24b67c1 (0x52f9 bytes) 2024-09-22T01:35:47.400 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.401 INFO:teuthology.orchestra.run.smithi018.stdout:2569 read 0x481fa19 thru 0x4826823 (0x6e0b bytes) 2024-09-22T01:35:47.401 INFO:teuthology.orchestra.run.smithi018.stdout:2572 write 0x668bd59 thru 0x66926c1 (0x6969 bytes) 2024-09-22T01:35:47.402 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:47.400+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:47.403 INFO:teuthology.orchestra.run.smithi018.stdout:2574 punch from 0x3b1c59 to 0x3bb49e, (0x9845 bytes) 2024-09-22T01:35:47.403 INFO:teuthology.orchestra.run.smithi018.stdout:2576 write 0x84d8613 thru 0x84daa88 (0x2476 bytes) 2024-09-22T01:35:47.405 INFO:teuthology.orchestra.run.smithi018.stdout:2578 write 0xccd1ee thru 0xcd08a6 (0x36b9 bytes) 2024-09-22T01:35:47.408 INFO:teuthology.orchestra.run.smithi018.stdout:2579 writesame 0x9095d9 thru 0x913f4d data_size 0xd(0xa975 bytes) 2024-09-22T01:35:47.413 INFO:teuthology.orchestra.run.smithi018.stdout:2581 write 0x263d485 thru 0x263d4f5 (0x71 bytes) 2024-09-22T01:35:47.415 INFO:teuthology.orchestra.run.smithi018.stdout:2582 punch from 0x3ae467 to 0x3b3692, (0x522b bytes) 2024-09-22T01:35:47.415 INFO:teuthology.orchestra.run.smithi018.stdout:2584 punch from 0x28bd18c to 0x28c7ecb, (0xad3f bytes) 2024-09-22T01:35:47.428 INFO:teuthology.orchestra.run.smithi018.stdout:2585 writesame 0xdba934f thru 0xdbb4395 data_size 0x1(0xb047 bytes) 2024-09-22T01:35:47.428 INFO:teuthology.orchestra.run.smithi018.stdout:2586 read 0x3c5d518 thru 0x3c5feeb (0x29d4 bytes) 2024-09-22T01:35:47.428 INFO:teuthology.orchestra.run.smithi018.stdout:2588 read 0xd0f6adb thru 0xd0fa603 (0x3b29 bytes) 2024-09-22T01:35:47.428 INFO:teuthology.orchestra.run.smithi018.stdout:2589 read 0x328f3ec thru 0x328f569 (0x17e bytes) 2024-09-22T01:35:47.429 INFO:teuthology.orchestra.run.smithi018.stdout:2591 write 0x1dff264 thru 0x1e06ea0 (0x7c3d bytes) 2024-09-22T01:35:47.430 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:47.430 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:47.431 INFO:teuthology.orchestra.run.smithi018.stdout:2592 writesame 0x2945cf3 thru 0x2948791 data_size 0x1(0x2a9f bytes) 2024-09-22T01:35:47.448 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:47.448 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:47.453 INFO:teuthology.orchestra.run.smithi018.stdout:2593 trunc from 0xdbb4396 to 0x61f0c5c 2024-09-22T01:35:47.466 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:47.467 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:47.477 INFO:teuthology.orchestra.run.smithi018.stdout:2594 write 0x6766d3b thru 0x6767a1a (0xce0 bytes) 2024-09-22T01:35:47.485 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:47.485 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:47.489 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:47.485+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:47.495 INFO:teuthology.orchestra.run.smithi018.stdout:2595 write 0xa293919 thru 0xa2a34b3 (0xfb9b bytes) 2024-09-22T01:35:47.505 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:47.505 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:47.510 INFO:teuthology.orchestra.run.smithi018.stdout:2600 writesame 0xa8dec0c thru 0xa8ed889 data_size 0x1(0xec7e bytes) 2024-09-22T01:35:47.513 INFO:teuthology.orchestra.run.smithi018.stdout:2601 read 0x369704b thru 0x369b905 (0x48bb bytes) 2024-09-22T01:35:47.514 INFO:teuthology.orchestra.run.smithi018.stdout:2602 punch from 0x5ec7e90 to 0x5ecfa0a, (0x7b7a bytes) 2024-09-22T01:35:47.514 INFO:teuthology.orchestra.run.smithi018.stdout:2604 read 0x88bd19c thru 0x88c37a8 (0x660d bytes) 2024-09-22T01:35:47.514 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.515 INFO:teuthology.orchestra.run.smithi018.stdout:2606 write 0x8947c05 thru 0x895333d (0xb739 bytes) 2024-09-22T01:35:47.527 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:47.527 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:47.530 INFO:teuthology.orchestra.run.smithi018.stdout:2609 write 0xc9fbc4b thru 0xca07fd5 (0xc38b bytes) 2024-09-22T01:35:47.537 INFO:teuthology.orchestra.run.smithi018.stdout:2610 write 0xf405c9 thru 0xf4ad25 (0xa75d bytes) 2024-09-22T01:35:47.540 INFO:teuthology.orchestra.run.smithi018.stdout:2611 read 0x9d43d40 thru 0x9d4ecbe (0xaf7f bytes) 2024-09-22T01:35:47.540 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:47.540 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:47.540 INFO:teuthology.orchestra.run.smithi018.stdout:2612 read 0x8ff6817 thru 0x8ff8fc0 (0x27aa bytes) 2024-09-22T01:35:47.541 INFO:teuthology.orchestra.run.smithi018.stdout:2613 read 0x19d260 thru 0x1a94f8 (0xc299 bytes) 2024-09-22T01:35:47.542 INFO:teuthology.orchestra.run.smithi018.stdout:2614 write 0x8830708 thru 0x883b565 (0xae5e bytes) 2024-09-22T01:35:47.545 INFO:teuthology.orchestra.run.smithi018.stdout:2615 write 0xb5d2982 thru 0xb5dfd4e (0xd3cd bytes) 2024-09-22T01:35:47.549 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:47.550 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:47.553 INFO:teuthology.orchestra.run.smithi018.stdout:2618 writesame 0x82402c3 thru 0x8247e88 data_size 0x3(0x7bc6 bytes) 2024-09-22T01:35:47.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:47.571 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:47.572 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:47.580 INFO:teuthology.orchestra.run.smithi018.stdout:2619 trunc from 0xca07fd6 to 0x142c94d 2024-09-22T01:35:47.590 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:47.585+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:47.612 INFO:teuthology.orchestra.run.smithi018.stdout:2621 read 0x349230 thru 0x351a19 (0x87ea bytes) 2024-09-22T01:35:47.613 INFO:teuthology.orchestra.run.smithi018.stdout:2622 read 0x6d44d7 thru 0x6d8a7a (0x45a4 bytes) 2024-09-22T01:35:47.634 INFO:teuthology.orchestra.run.smithi018.stdout:2623 writesame 0x6b369bb thru 0x6b3cfe0 data_size 0x19(0x6626 bytes) 2024-09-22T01:35:47.636 INFO:teuthology.orchestra.run.smithi018.stdout:2625 write 0x5396ea8 thru 0x53a265f (0xb7b8 bytes) 2024-09-22T01:35:47.641 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.641 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.672 INFO:teuthology.orchestra.run.smithi018.stdout:2631 writesame 0xe2884bf thru 0xe2944f8 data_size 0x85(0xc03a bytes) 2024-09-22T01:35:47.686 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:47.686 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:47.687 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:35:47.687 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:35:47.687 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:47.691 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:47.685+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:47.696 INFO:teuthology.orchestra.run.smithi018.stdout:2633 trunc from 0xe2944f9 to 0x46cd180 2024-09-22T01:35:47.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:47.714 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.714 INFO:teuthology.orchestra.run.smithi018.stdout:2635 read 0xa8da4 thru 0xb59ce (0xcc2b bytes) 2024-09-22T01:35:47.715 INFO:teuthology.orchestra.run.smithi018.stdout:2637 punch from 0x10d7bc7 to 0x10ddcec, (0x6125 bytes) 2024-09-22T01:35:47.715 INFO:teuthology.orchestra.run.smithi018.stdout:2638 read 0x427c8f9 thru 0x4280df8 (0x4500 bytes) 2024-09-22T01:35:47.737 INFO:teuthology.orchestra.run.smithi018.stdout:2639 trunc from 0x46cd180 to 0xd7e8abd 2024-09-22T01:35:47.747 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.747 INFO:teuthology.orchestra.run.smithi018.stdout:2641 read 0x649f082 thru 0x64a0913 (0x1892 bytes) 2024-09-22T01:35:47.747 INFO:teuthology.orchestra.run.smithi018.stdout:2643 punch from 0xbcfbace to 0xbd0771a, (0xbc4c bytes) 2024-09-22T01:35:47.748 INFO:teuthology.orchestra.run.smithi018.stdout:2644 write 0x273c3a3 thru 0x274168f (0x52ed bytes) 2024-09-22T01:35:47.760 INFO:teuthology.orchestra.run.smithi018.stdout:2646 write 0xe1bf04e thru 0xe1c835b (0x930e bytes) 2024-09-22T01:35:47.765 INFO:teuthology.orchestra.run.smithi018.stdout:2647 read 0xbea8e36 thru 0xbeae375 (0x5540 bytes) 2024-09-22T01:35:47.765 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.766 INFO:teuthology.orchestra.run.smithi018.stdout:2649 read 0xc0bc8f1 thru 0xc0c668f (0x9d9f bytes) 2024-09-22T01:35:47.772 INFO:teuthology.orchestra.run.smithi018.stdout:2650 trunc from 0xe1c835c to 0xb667c8b 2024-09-22T01:35:47.785 INFO:teuthology.orchestra.run.smithi018.stdout:2651 writesame 0xb274d2a thru 0xb280328 data_size 0x1(0xb5ff bytes) 2024-09-22T01:35:47.791 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:47.789+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:47.829 INFO:teuthology.orchestra.run.smithi018.stdout:2652 writesame 0xe2cc60c thru 0xe2d178a data_size 0x1(0x517f bytes) 2024-09-22T01:35:47.832 INFO:teuthology.orchestra.run.smithi018.stdout:2654 read 0x6416aa1 thru 0x641b2d2 (0x4832 bytes) 2024-09-22T01:35:47.833 INFO:teuthology.orchestra.run.smithi018.stdout:2655 write 0x546bec0 thru 0x5470980 (0x4ac1 bytes) 2024-09-22T01:35:47.834 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 74.522923947999999, 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.835 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:35:47.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:35:47.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:35:47.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:35:47.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.992151251999999, 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:35:47.841 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:35:47.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:35:47.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.845 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.991923972000002, 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:47.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:35:47.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:35:47.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.988755687999998, 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.850 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:35:47.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:35:47.853 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.988671424000003, 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.854 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:35:47.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:35:47.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.988619927999999, 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.858 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.988574608, 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.862 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:35:47.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:35:47.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:35:47.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.867 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.985094351000001, 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.868 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.984789538999998, 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:35:47.872 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.984740094999999, 2024-09-22T01:35:47.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:35:47.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:35:47.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:35:47.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.880 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.984695541000001, 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:35:47.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.984651890999999, 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.885 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:35:47.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:35:47.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:35:47.889 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.889 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.889 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.889 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.889 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.984604670000003, 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.890 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:35:47.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:35:47.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.893 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.984409663999998, 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.894 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:35:47.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.984360176999999, 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.898 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.899 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.900 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:35:47.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.902 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.981209118000002, 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.903 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:35:47.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:35:47.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.980863489999997, 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.907 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:35:47.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.980768067, 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.911 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.912 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.914 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.980715488000001, 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.915 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:35:47.918 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.980673721000002, 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:47.919 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:35:47.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:35:47.922 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:35:47.923 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:47.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:47.925 INFO:teuthology.orchestra.run.smithi018.stdout:2656 write 0x1b7ce38 thru 0x1b7fd0f (0x2ed8 bytes) 2024-09-22T01:35:47.925 INFO:teuthology.orchestra.run.smithi018.stdout:2657 read 0x7f23cf4 thru 0x7f285e2 (0x48ef bytes) 2024-09-22T01:35:47.925 INFO:teuthology.orchestra.run.smithi018.stdout:2658 write 0xd76529 thru 0xd79020 (0x2af8 bytes) 2024-09-22T01:35:47.925 INFO:teuthology.orchestra.run.smithi018.stdout:2659 write 0x2567152 thru 0x256cd25 (0x5bd4 bytes) 2024-09-22T01:35:47.925 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:47.926 INFO:teuthology.orchestra.run.smithi018.stdout:2661 write 0x63824d4 thru 0x63837bd (0x12ea bytes) 2024-09-22T01:35:47.926 INFO:teuthology.orchestra.run.smithi018.stdout:2662 writesame 0x5a19e31 thru 0x5a249a9 data_size 0x1(0xab79 bytes) 2024-09-22T01:35:47.926 INFO:teuthology.orchestra.run.smithi018.stdout:2663 write 0xcdc5082 thru 0xcdd234f (0xd2ce bytes) 2024-09-22T01:35:47.926 INFO:teuthology.orchestra.run.smithi018.stdout:2664 trunc from 0xe2d178b to 0x4538ff8 2024-09-22T01:35:47.926 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:35:47.927 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:47.920+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:47.969 INFO:teuthology.orchestra.run.smithi018.stdout:2665 write 0x7c3cd7a thru 0x7c400e6 (0x336d bytes) 2024-09-22T01:35:47.981 INFO:teuthology.orchestra.run.smithi018.stdout:2666 trunc from 0x7c400e7 to 0xe77aa2c 2024-09-22T01:35:47.995 INFO:teuthology.orchestra.run.smithi018.stdout:2670 punch from 0x1057ffb to 0x106427a, (0xc27f bytes) 2024-09-22T01:35:47.996 INFO:teuthology.orchestra.run.smithi018.stdout:2671 writesame 0x7bb3e63 thru 0x7bb5f8f data_size 0x13(0x212d bytes) 2024-09-22T01:35:48.002 INFO:teuthology.orchestra.run.smithi018.stdout:2673 punch from 0xe557394 to 0xe560fed, (0x9c59 bytes) 2024-09-22T01:35:48.002 INFO:teuthology.orchestra.run.smithi018.stdout:2674 punch from 0xba1ab29 to 0xba1efcb, (0x44a2 bytes) 2024-09-22T01:35:48.002 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:48.002 INFO:teuthology.orchestra.run.smithi018.stdout:2677 writesame 0x3ecc31b thru 0x3ed7e82 data_size 0xc(0xbb68 bytes) 2024-09-22T01:35:48.005 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:48.005 INFO:teuthology.orchestra.run.smithi018.stdout:2679 trunc from 0xe77aa2c to 0xe2e6ea5 2024-09-22T01:35:48.017 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:48.025 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:48.021+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:48.030 INFO:teuthology.orchestra.run.smithi018.stdout:2683 write 0xe51eae7 thru 0xe52d996 (0xeeb0 bytes) 2024-09-22T01:35:48.037 INFO:teuthology.orchestra.run.smithi018.stdout:2684 punch from 0x25a74eb to 0x25b60d9, (0xebee bytes) 2024-09-22T01:35:48.037 INFO:teuthology.orchestra.run.smithi018.stdout:2685 read 0xcf7457a thru 0xcf81d78 (0xd7ff bytes) 2024-09-22T01:35:48.037 INFO:teuthology.orchestra.run.smithi018.stdout:2686 writesame 0x84550c8 thru 0x8458fd4 data_size 0x1(0x3f0d bytes) 2024-09-22T01:35:48.050 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:48.051 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:48.051 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:48.057 INFO:teuthology.orchestra.run.smithi018.stdout:2687 read 0x3092d3a thru 0x30a2948 (0xfc0f bytes) 2024-09-22T01:35:48.058 INFO:teuthology.orchestra.run.smithi018.stdout:2688 write 0x772e0ef thru 0x7738798 (0xa6aa bytes) 2024-09-22T01:35:48.066 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:48.067 INFO:teuthology.orchestra.run.smithi018.stdout:2689 punch from 0xb580d7f to 0xb5835b0, (0x2831 bytes) 2024-09-22T01:35:48.067 INFO:teuthology.orchestra.run.smithi018.stdout:2690 read 0x7b64848 thru 0x7b72c3e (0xe3f7 bytes) 2024-09-22T01:35:48.067 INFO:teuthology.orchestra.run.smithi018.stdout:2691 read 0x72f0e6f thru 0x72fe2b7 (0xd449 bytes) 2024-09-22T01:35:48.069 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:48.069 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:48.077 INFO:teuthology.orchestra.run.smithi018.stdout:2697 trunc from 0xe52d997 to 0xa282521 2024-09-22T01:35:48.122 INFO:teuthology.orchestra.run.smithi018.stdout:2699 write 0xbba3c05 thru 0xbbae9be (0xadba bytes) 2024-09-22T01:35:48.126 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:48.121+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:48.129 INFO:teuthology.orchestra.run.smithi018.stdout:2700 write 0x10fa988 thru 0x1100996 (0x600f bytes) 2024-09-22T01:35:48.133 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:48.133 INFO:teuthology.orchestra.run.smithi018.stdout:2703 write 0xb3433fa thru 0xb34b73f (0x8346 bytes) 2024-09-22T01:35:48.139 INFO:teuthology.orchestra.run.smithi018.stdout:2704 writesame 0xa596ba1 thru 0xa599b53 data_size 0x1(0x2fb3 bytes) 2024-09-22T01:35:48.149 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:48.150 INFO:teuthology.orchestra.run.smithi018.stdout:2706 writesame 0x7a18a8a thru 0x7a213b3 data_size 0x2(0x892a bytes) 2024-09-22T01:35:48.163 INFO:teuthology.orchestra.run.smithi018.stdout:2708 writesame 0x958ea2d thru 0x959020a data_size 0xd(0x17de bytes) 2024-09-22T01:35:48.167 INFO:teuthology.orchestra.run.smithi018.stdout:2709 read 0x2e8499a thru 0x2e86289 (0x18f0 bytes) 2024-09-22T01:35:48.185 INFO:teuthology.orchestra.run.smithi018.stdout:2710 writesame 0xd71b250 thru 0xd7244df data_size 0x86(0x9290 bytes) 2024-09-22T01:35:48.185 INFO:teuthology.orchestra.run.smithi018.stdout:2711 write 0xd38028d thru 0xd387eda (0x7c4e bytes) 2024-09-22T01:35:48.193 INFO:teuthology.orchestra.run.smithi018.stdout:2713 write 0x2a3af8a thru 0x2a47a30 (0xcaa7 bytes) 2024-09-22T01:35:48.199 INFO:teuthology.orchestra.run.smithi018.stdout:2714 trunc from 0xd7244e0 to 0xc7c8f31 2024-09-22T01:35:48.201 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:48.201 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:48.201 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:48.201 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:48.201 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:48.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:48.222 INFO:teuthology.orchestra.run.smithi018.stdout:2715 write 0xbb56985 thru 0xbb5d5fa (0x6c76 bytes) 2024-09-22T01:35:48.225 INFO:teuthology.orchestra.run.smithi018.stdout:2716 clone 21 order 22 su 262144 sc 3 2024-09-22T01:35:48.226 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:48.221+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:48.327 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:48.321+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48565 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 708608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.881330069000001, 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086712429999999993, 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.351 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48565 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466221+0000", 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9299999999999998e-07 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466224+0000", 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.977e-06 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466233+0000", 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1419999999999999e-06 2024-09-22T01:35:48.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466240+0000", 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6800000000000004e-06 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552634+0000", 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086394356000000005 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552731+0000", 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6681000000000005e-05 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552933+0000", 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020200099999999999 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48566 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 718848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.881301890000003, 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086846866999999994, 2024-09-22T01:35:48.355 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48566 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.06e-07 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466252+0000", 2024-09-22T01:35:48.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.813e-06 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466261+0000", 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7260000000000008e-06 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466267+0000", 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5400000000000001e-06 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552974+0000", 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086707237000000006 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553025+0000", 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0380000000000002e-05 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553095+0000", 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0564999999999999e-05 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.359 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48654 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.877058849999997, 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086747482000000001, 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.360 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48654 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5700000000000001e-07 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470498+0000", 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470515+0000", 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7742000000000001e-05 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470546+0000", 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0586000000000002e-05 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557000+0000", 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086454002000000002 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557110+0000", 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010961 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557239+0000", 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48655 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 638976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.876983279999997, 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086840121000000006, 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48655 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470569+0000", 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5400000000000001e-06 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470575+0000", 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1399999999999997e-06 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470597+0000", 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1676e-05 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470614+0000", 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7336000000000001e-05 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557279+0000", 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086664832999999997 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557341+0000", 2024-09-22T01:35:48.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2073e-05 2024-09-22T01:35:48.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557407+0000", 2024-09-22T01:35:48.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6523e-05 2024-09-22T01:35:48.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.368 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.876880096999997, 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.369 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.876805687000001, 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.373 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.876749156000002, 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.377 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.378 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:35:48.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.378 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:48.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.876691561999998, 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:35:48.381 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.876634224, 2024-09-22T01:35:48.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:48.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:35:48.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.876576782999997, 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.390 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:35:48.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:35:48.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.876540874, 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:35:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48750 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.871638073, 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086758792000000001, 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48750 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:48.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475914+0000", 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.263e-06 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475919+0000", 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.84e-06 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475937+0000", 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7689e-05 2024-09-22T01:35:48.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475951+0000", 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3439e-05 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562548+0000", 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086597376000000004 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562605+0000", 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7367999999999997e-05 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562671+0000", 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5816999999999997e-05 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48751 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 641024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.871563743000003, 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086829097999999993, 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48751 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475988+0000", 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.47e-07 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475994+0000", 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1260000000000003e-06 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476019+0000", 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5471999999999999e-05 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476033+0000", 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100000000000001e-05 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562691+0000", 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086657746999999993 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562750+0000", 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9188000000000003e-05 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562816+0000", 2024-09-22T01:35:48.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5518000000000005e-05 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.871497175999998, 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.406 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:35:48.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.871433734999997, 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.410 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.413 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.871378497999999, 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:48.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:35:48.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:35:48.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:35:48.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.871305184000001, 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.418 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.871251102999999, 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.422 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:35:48.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:35:48.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:48.426 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.871196664999999, 2024-09-22T01:35:48.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:35:48.427 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.427 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.427 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.427 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.427 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.427 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:35:48.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.427 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:35:48.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.871140803999999, 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:35:48.431 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:35:48.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.435 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.436 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.436 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.436 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.436 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:48.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:48.438 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:48.433+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:48.538 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:48.533+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:48.610 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:48.610 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:48.610 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:48.610 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:48.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:48.639 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:48.636+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:48.739 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:48.733+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:48.801 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:48.801 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:48.801 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:48.801 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:48.801 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:48.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:48.841 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:48.836+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:48.942 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:48.940+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:48.983 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:48.983 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.178980418999998, 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.984 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:35:48.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.178925242999998, 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:35:48.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:35:48.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:35:48.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:35:48.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.17886013, 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:48.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:48.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:48.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.178794383, 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:35:49.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.005 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.178756913000001, 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:35:49.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.178706297000002, 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:35:49.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:35:49.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.177520957999999, 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:35:49.016 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:35:49.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:35:49.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.177459130999999, 2024-09-22T01:35:49.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.177410332000001, 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:35:49.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.177336779000001, 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.032 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:35:49.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:35:49.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:35:49.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.177266317000001, 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:35:49.037 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:35:49.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:35:49.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.177195814000001, 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.043 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:35:49.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:35:49.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.177148582000001, 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.049 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:35:49.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.054 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.177085706, 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:49.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:35:49.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:35:49.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.177045039999999, 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:35:49.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:35:49.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:35:49.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.176950173000002, 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.066 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:49.071 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.176909135999999, 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:35:49.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.176871644999999, 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.176831495999998, 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.082 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:49.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:35:49.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:35:49.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:49.087 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.176788701, 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:35:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:35:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.093 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.093 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:49.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:49.095 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone20 from 0xc7c8f31 (overlap 0x142c94d) to 0x0 2024-09-22T01:35:49.095 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:49.089+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:49.196 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:49.192+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:49.216 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-22T01:35:49.279 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:49.279 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:49.279 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:49.279 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:49.296 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:49.297 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:49.293+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:49.397 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:49.392+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:49.476 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:49.477 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:49.477 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:49.477 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:49.477 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:49.492 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:49.498 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:49.496+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:49.594 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:49.599 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:49.596+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:49.624 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:49.624 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:49.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:49.624 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:49.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.624 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:35:49.624 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.623403115999999, 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:49.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.293753463000002, 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:35:49.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:35:49.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:35:49.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:35:49.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:35:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.293609957999998, 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:35:49.634 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.518290686, 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:35:49.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:35:49.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:35:49.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:35:49.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:35:49.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.517224990999999, 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:35:49.645 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:35:49.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:35:49.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.209192500999997, 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.651 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:35:49.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:35:49.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:35:49.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:35:49.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.208818207, 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:49.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:35:49.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:35:49.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54465 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.661 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.800958358999999, 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050651180000000004, 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54465 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821068+0000", 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821078+0000", 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0164e-05 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821107+0000", 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8985000000000001e-05 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821121+0000", 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.307e-05 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821387+0000", 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026639200000000001 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821395+0000", 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3040000000000005e-06 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825493+0000", 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040977399999999999 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825630+0000", 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136971 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826131+0000", 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050110499999999995 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54466 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.800871829999998, 2024-09-22T01:35:49.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052214690000000003, 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54466 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821153+0000", 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7499999999999999e-07 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821158+0000", 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3800000000000004e-06 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821169+0000", 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1124000000000001e-05 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821177+0000", 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1040000000000007e-06 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821467+0000", 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029025299999999997 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821474+0000", 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826170+0000", 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046964709999999998 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826261+0000", 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0708e-05 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826374+0000", 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113182 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54467 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:49.671 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.800835499000002, 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054437169999999998, 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54467 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1900000000000002e-07 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821193+0000", 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4130000000000002e-06 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821202+0000", 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821209+0000", 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8800000000000002e-06 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821504+0000", 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029444600000000002 2024-09-22T01:35:49.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821509+0000", 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5500000000000002e-06 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826415+0000", 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004905492 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826527+0000", 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112144 2024-09-22T01:35:49.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826633+0000", 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105795 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54510 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.800805566999998, 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057311339999999997, 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54510 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821245+0000", 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5774000000000001e-05 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821257+0000", 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2045000000000001e-05 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821265+0000", 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821538+0000", 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027359599999999997 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821544+0000", 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7450000000000001e-06 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826699+0000", 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051546229999999997 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826815+0000", 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011646600000000001 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826950+0000", 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013463700000000001 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54511 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.800747094999998, 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058910409999999996, 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54511 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821278+0000", 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821282+0000", 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821291+0000", 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3039999999999994e-06 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821298+0000", 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.041e-06 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821573+0000", 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000274283 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821578+0000", 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0679999999999996e-06 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827015+0000", 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054370670000000003 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827070+0000", 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5773999999999998e-05 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827168+0000", 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7814999999999998e-05 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.685 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54512 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.800716193, 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061320309999999996, 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54512 2024-09-22T01:35:49.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821309+0000", 2024-09-22T01:35:49.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.51e-07 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821312+0000", 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0419999999999998e-06 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821320+0000", 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.422e-06 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821332+0000", 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1951e-05 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821937+0000", 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060522400000000002 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821944+0000", 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.404e-06 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827219+0000", 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052754389999999998 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827317+0000", 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7536999999999998e-05 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827440+0000", 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123461 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54555 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.800247163000002, 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059477050000000002, 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54555 2024-09-22T01:35:49.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821778+0000", 2024-09-22T01:35:49.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0500000000000002e-07 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821783+0000", 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.135e-06 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821798+0000", 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4688000000000001e-05 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821808+0000", 2024-09-22T01:35:49.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6690000000000001e-06 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821977+0000", 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169541 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821982+0000", 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-06 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827481+0000", 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054988470000000003 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827582+0000", 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100554 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827725+0000", 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014320199999999999 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.695 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54556 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.800200343, 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00620654, 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54556 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821825+0000", 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821828+0000", 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8809999999999998e-06 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821839+0000", 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.027e-05 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821846+0000", 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822011+0000", 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822017+0000", 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6099999999999997e-06 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827802+0000", 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057848509999999997 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827892+0000", 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0880999999999999e-05 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828030+0000", 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013803200000000001 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.700 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54557 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.800166050000001, 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064190469999999998, 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54557 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821859+0000", 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.99e-07 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821863+0000", 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6569999999999999e-06 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821871+0000", 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9719999999999998e-06 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821878+0000", 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.917e-06 2024-09-22T01:35:49.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822045+0000", 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016703000000000001 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822051+0000", 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.626e-06 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828069+0000", 2024-09-22T01:35:49.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060179919999999998 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828161+0000", 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1731999999999995e-05 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828277+0000", 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011652199999999999 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54600 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.799730476999997, 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062310530000000003, 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54600 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822295+0000", 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.19e-06 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822301+0000", 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5010000000000004e-06 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822320+0000", 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9724e-05 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822330+0000", 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3899999999999999e-06 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822464+0000", 2024-09-22T01:35:49.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013444100000000001 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822470+0000", 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3690000000000003e-06 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828314+0000", 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058434719999999997 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828405+0000", 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1166000000000001e-05 2024-09-22T01:35:49.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828525+0000", 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001198 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54601 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.799672858999998, 2024-09-22T01:35:49.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064068470000000002, 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54601 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822352+0000", 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822356+0000", 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6519999999999999e-06 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822366+0000", 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0686000000000001e-05 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822374+0000", 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4200000000000001e-06 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822500+0000", 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012665800000000001 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822505+0000", 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.938e-06 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828560+0000", 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060544969999999998 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828651+0000", 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0758000000000001e-05 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828758+0000", 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010760900000000001 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54602 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.799638467000001, 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066069279999999998, 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.715 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54602 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:49.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6599999999999996e-07 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822390+0000", 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.377e-06 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822399+0000", 2024-09-22T01:35:49.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822406+0000", 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822534+0000", 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012761900000000001 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822539+0000", 2024-09-22T01:35:49.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3639999999999998e-06 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828797+0000", 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006257365 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828885+0000", 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8818000000000002e-05 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828993+0000", 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107336 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54688 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.795757582, 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044478340000000003, 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:49.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54688 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:49.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826268+0000", 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-06 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826274+0000", 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:49.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826294+0000", 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0211999999999999e-05 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826310+0000", 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6039999999999999e-05 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830569+0000", 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004258632 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830641+0000", 2024-09-22T01:35:49.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2064000000000007e-05 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830715+0000", 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3483000000000001e-05 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:49.724 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:49.725 INFO:teuthology.orchestra.run.smithi018.stdout:2717 writesame 0x786b4e1 thru 0x78710e6 data_size 0x1(0x5c06 bytes) 2024-09-22T01:35:49.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:49.727 INFO:teuthology.orchestra.run.smithi018.stdout:2719 write 0x3646ba3 thru 0x36494ac (0x290a bytes) 2024-09-22T01:35:49.727 INFO:teuthology.orchestra.run.smithi018.stdout:2722 write 0x13b8043 thru 0x13bf975 (0x7933 bytes) 2024-09-22T01:35:49.727 INFO:teuthology.orchestra.run.smithi018.stdout:2724 read 0x74294e3 thru 0x742f77d (0x629b bytes) 2024-09-22T01:35:49.727 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:49.727 INFO:teuthology.orchestra.run.smithi018.stdout:2726 read 0x6322b3a thru 0x632db4b (0xb012 bytes) 2024-09-22T01:35:49.727 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:49.727 INFO:teuthology.orchestra.run.smithi018.stdout:2728 write 0x269e7f3 thru 0x26a7adc (0x92ea bytes) 2024-09-22T01:35:49.727 INFO:teuthology.orchestra.run.smithi018.stdout:2729 punch from 0x53c6b65 to 0x53d56f9, (0xeb94 bytes) 2024-09-22T01:35:49.727 INFO:teuthology.orchestra.run.smithi018.stdout:2730 writesame 0x8ea47dd thru 0x8eaf7c4 data_size 0x34(0xafe8 bytes) 2024-09-22T01:35:49.728 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:49.721+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:49.728 INFO:teuthology.orchestra.run.smithi018.stdout:2731 read 0x133749 thru 0x133fb0 (0x868 bytes) 2024-09-22T01:35:49.730 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:49.730 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:49.747 INFO:teuthology.orchestra.run.smithi018.stdout:2734 trunc from 0xc7c8f31 to 0x1e2e39a 2024-09-22T01:35:49.747 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:49.781 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:49.781 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:49.785 INFO:teuthology.orchestra.run.smithi018.stdout:2735 punch from 0x1abacb1 to 0x1ac53bb, (0xa70a bytes) 2024-09-22T01:35:49.807 INFO:teuthology.orchestra.run.smithi018.stdout:2737 write 0x7def7be thru 0x7df4466 (0x4ca9 bytes) 2024-09-22T01:35:49.814 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:49.814 INFO:teuthology.orchestra.run.smithi018.stdout:2739 write 0x36d4400 thru 0x36db08e (0x6c8f bytes) 2024-09-22T01:35:49.816 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:49.816 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:49.827 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:49.824+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:49.840 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:49.841 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:49.841 INFO:teuthology.orchestra.run.smithi018.stdout:2740 write 0xce989fd thru 0xce9b596 (0x2b9a bytes) 2024-09-22T01:35:49.849 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:49.849 INFO:teuthology.orchestra.run.smithi018.stdout:2743 write 0x91ec345 thru 0x91f77b8 (0xb474 bytes) 2024-09-22T01:35:49.855 INFO:teuthology.orchestra.run.smithi018.stdout:2744 read 0x5050009 thru 0x5051ef0 (0x1ee8 bytes) 2024-09-22T01:35:49.855 INFO:teuthology.orchestra.run.smithi018.stdout:2747 writesame 0xb0118a4 thru 0xb01e661 data_size 0x73(0xcdbe bytes) 2024-09-22T01:35:49.863 INFO:teuthology.orchestra.run.smithi018.stdout:2750 punch from 0x6a618d9 to 0x6a63b5a, (0x2281 bytes) 2024-09-22T01:35:49.863 INFO:teuthology.orchestra.run.smithi018.stdout:2753 punch from 0x4260255 to 0x4269bfa, (0x99a5 bytes) 2024-09-22T01:35:49.863 INFO:teuthology.orchestra.run.smithi018.stdout:2755 writesame 0xa775221 thru 0xa77f0da data_size 0xb(0x9eba bytes) 2024-09-22T01:35:49.872 INFO:teuthology.orchestra.run.smithi018.stdout:2756 read 0x1fcb417 thru 0x1fd6872 (0xb45c bytes) 2024-09-22T01:35:49.873 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:49.874 INFO:teuthology.orchestra.run.smithi018.stdout:2760 read 0x403f396 thru 0x40474ba (0x8125 bytes) 2024-09-22T01:35:49.874 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:49.874 INFO:teuthology.orchestra.run.smithi018.stdout:2762 write 0x8c0ad51 thru 0x8c15493 (0xa743 bytes) 2024-09-22T01:35:49.876 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:49.876 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:49.892 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:49.893 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:49.897 INFO:teuthology.orchestra.run.smithi018.stdout:2763 trunc from 0xce9b597 to 0x2b53730 2024-09-22T01:35:49.898 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:49.913 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:49.921 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:49.921 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:49.927 INFO:teuthology.orchestra.run.smithi018.stdout:2765 write 0x15ccdfc thru 0x15d93b9 (0xc5be bytes) 2024-09-22T01:35:49.927 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:49.924+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:49.943 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:49.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:35:49.949 INFO:teuthology.orchestra.run.smithi018.stdout:2767 writesame 0x5fa34d5 thru 0x5faa771 data_size 0xd(0x729d bytes) 2024-09-22T01:35:49.949 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:49.954 INFO:teuthology.orchestra.run.smithi018.stdout:2769 trunc from 0x5faa772 to 0x92c0857 2024-09-22T01:35:49.966 INFO:teuthology.orchestra.run.smithi018.stdout:2770 read 0x5290bfd thru 0x529d5ce (0xc9d2 bytes) 2024-09-22T01:35:49.978 INFO:teuthology.orchestra.run.smithi018.stdout:2771 trunc from 0x92c0857 to 0x19dec45 2024-09-22T01:35:49.993 INFO:teuthology.orchestra.run.smithi018.stdout:2772 writesame 0x191cde9 thru 0x192789c data_size 0x73(0xaab4 bytes) 2024-09-22T01:35:49.996 INFO:teuthology.orchestra.run.smithi018.stdout:2774 punch from 0xc56d07 to 0xc6610c, (0xf405 bytes) 2024-09-22T01:35:49.997 INFO:teuthology.orchestra.run.smithi018.stdout:2776 punch from 0x59a37c to 0x5aa2eb, (0xff6f bytes) 2024-09-22T01:35:50.025 INFO:teuthology.orchestra.run.smithi018.stdout:2777 write 0xb85be08 thru 0xb860597 (0x4790 bytes) 2024-09-22T01:35:50.027 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:50.025+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:50.045 INFO:teuthology.orchestra.run.smithi018.stdout:2778 trunc from 0xb860598 to 0x2547f3c 2024-09-22T01:35:50.058 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:50.059 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:50.076 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:50.085 INFO:teuthology.orchestra.run.smithi018.stdout:2779 trunc from 0x2547f3c to 0xe19457f 2024-09-22T01:35:50.096 INFO:teuthology.orchestra.run.smithi018.stdout:2780 read 0x1cb9726 thru 0x1cc3832 (0xa10d bytes) 2024-09-22T01:35:50.097 INFO:teuthology.orchestra.run.smithi018.stdout:2781 read 0x48391ee thru 0x483adff (0x1c12 bytes) 2024-09-22T01:35:50.097 INFO:teuthology.orchestra.run.smithi018.stdout:2783 read 0x77cab3f thru 0x77d0df7 (0x62b9 bytes) 2024-09-22T01:35:50.097 INFO:teuthology.orchestra.run.smithi018.stdout:2785 writesame 0x9192ec0 thru 0x919757d data_size 0x5(0x46be bytes) 2024-09-22T01:35:50.107 INFO:teuthology.orchestra.run.smithi018.stdout:2787 write 0x236774d thru 0x2376d5e (0xf612 bytes) 2024-09-22T01:35:50.109 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:50.110 INFO:teuthology.orchestra.run.smithi018.stdout:2790 writesame 0x787daf6 thru 0x7889047 data_size 0x1(0xb552 bytes) 2024-09-22T01:35:50.130 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:50.125+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:50.145 INFO:teuthology.orchestra.run.smithi018.stdout:2791 write 0x5235e81 thru 0x5242a16 (0xcb96 bytes) 2024-09-22T01:35:50.154 INFO:teuthology.orchestra.run.smithi018.stdout:2792 punch from 0xa676072 to 0xa677e7c, (0x1e0a bytes) 2024-09-22T01:35:50.154 INFO:teuthology.orchestra.run.smithi018.stdout:2793 write 0xb77a0ac thru 0xb78068c (0x65e1 bytes) 2024-09-22T01:35:50.161 INFO:teuthology.orchestra.run.smithi018.stdout:2795 clone 22 order 21 su 524288 sc 3 2024-09-22T01:35:50.199 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:50.199 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:50.212 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:50.258 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:50.256+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:50.272 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7] out_osds: [2, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:50.272 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:35:50.272 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [1, 3, 4, 5, 6, 7] 2024-09-22T01:35:50.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 7 2024-09-22T01:35:50.329 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:50.325+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:50.336 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:50.336 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:50.350 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:50.438 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:50.436+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:50.509 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:50.509 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:50.523 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:50.566 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:50.564+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:50.574 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-22T01:35:50.569+0000 7fb667fae640 -1 mon.a@0(leader).osd e67 definitely_dead 0 2024-09-22T01:35:50.632 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:50.629+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:50.694 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:50.694 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:50.708 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:50.733 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:50.729+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:50.829 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:50.830 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:50.833 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:50.828+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:50.843 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:50.933 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:50.928+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:50.940 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:35:50.947 INFO:teuthology.orchestra.run.smithi018.stderr:marked out osd.7. 2024-09-22T01:35:51.019 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:51.019 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:51.034 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:51.034 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:51.032+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:51.134 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:51.129+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:51.204 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:51.205 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:51.219 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:51.266 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:51.264+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:51.337 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:51.332+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:51.342 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:51.342 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:51.358 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:51.438 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:51.433+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:51.524 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:51.524 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:51.538 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:51.536+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:51.538 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:51.639 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:51.633+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:51.709 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:51.709 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:51.723 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:51.739 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:51.733+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:51.840 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:51.837+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:51.845 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:51.845 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:51.860 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:51.941 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:51.937+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:51.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:51.988 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:51.988 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:52.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:52.046 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:52.044+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:52.123 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:52.123 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:52.124 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:52.124 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:52.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:52.140 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:52.141 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:52.142 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:52.137+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:52.161 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:52.161 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:52.179 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:52.179 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:52.197 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:52.197 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:52.218 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:52.239 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:52.239 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:52.242 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:52.240+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:52.258 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:52.258 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:52.258 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:52.258 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:52.260 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:52.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:52.343 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:52.340+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:52.443 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:52.437+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:52.447 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:52.448 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:52.448 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:52.448 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:52.448 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:52.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:52.544 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:52.540+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:52.635 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:52.635 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48565 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 708608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.165993061000002, 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086712429999999993, 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48565 2024-09-22T01:35:52.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466221+0000", 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9299999999999998e-07 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466224+0000", 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.977e-06 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466233+0000", 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1419999999999999e-06 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466240+0000", 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6800000000000004e-06 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552634+0000", 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086394356000000005 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552731+0000", 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6681000000000005e-05 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552933+0000", 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020200099999999999 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48566 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 718848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.165964881999997, 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086846866999999994, 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48566 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.06e-07 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466252+0000", 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.813e-06 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466261+0000", 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7260000000000008e-06 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466267+0000", 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5400000000000001e-06 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552974+0000", 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086707237000000006 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553025+0000", 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0380000000000002e-05 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553095+0000", 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0564999999999999e-05 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48654 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.161721841999999, 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086747482000000001, 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48654 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5700000000000001e-07 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470498+0000", 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470515+0000", 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7742000000000001e-05 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470546+0000", 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0586000000000002e-05 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557000+0000", 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086454002000000002 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557110+0000", 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010961 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557239+0000", 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48655 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 638976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.161646271999999, 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086840121000000006, 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48655 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470569+0000", 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5400000000000001e-06 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470575+0000", 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1399999999999997e-06 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470597+0000", 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1676e-05 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470614+0000", 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7336000000000001e-05 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557279+0000", 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086664832999999997 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557341+0000", 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2073e-05 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557407+0000", 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6523e-05 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.651 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.161543088999998, 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.652 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.161468679000002, 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.161412147999997, 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:35:52.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.161354553999999, 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:52.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:35:52.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.161297216000001, 2024-09-22T01:35:52.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:35:52.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:35:52.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.161239774999999, 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.671 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.161203866000001, 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.675 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:52.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48750 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.156301065000001, 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086758792000000001, 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48750 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475914+0000", 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.263e-06 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475919+0000", 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.84e-06 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475937+0000", 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7689e-05 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475951+0000", 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3439e-05 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562548+0000", 2024-09-22T01:35:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086597376000000004 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562605+0000", 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7367999999999997e-05 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562671+0000", 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5816999999999997e-05 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48751 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 641024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.156226734999997, 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086829097999999993, 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48751 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475988+0000", 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.47e-07 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475994+0000", 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1260000000000003e-06 2024-09-22T01:35:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476019+0000", 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5471999999999999e-05 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476033+0000", 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100000000000001e-05 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562691+0000", 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086657746999999993 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562750+0000", 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9188000000000003e-05 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562816+0000", 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5518000000000005e-05 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.156160168, 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:35:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:35:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:35:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.156096726999998, 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:35:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:35:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.15604149, 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.155968176000002, 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.155914095, 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:35:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:35:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.155859657000001, 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:35:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 44.155803796000001, 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:35:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:35:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:52.715 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:52.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:52.717 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:52.712+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:52.817 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:52.813+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:52.846 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:52.846 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:52.846 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:52.847 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:52.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:52.953 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:52.949+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:52.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:35:53.019 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:53.013+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:53.053 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone21 from 0xe19457f (overlap 0x19dec45) to 0x0 2024-09-22T01:35:53.062 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:53.062 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:53.062 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:53.062 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:53.062 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:53.086 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:53.119 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:53.116+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:53.192 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-22T01:35:53.196 INFO:teuthology.orchestra.run.smithi018.stdout:2796 trunc from 0xe19457f to 0xd0b8106 2024-09-22T01:35:53.218 INFO:teuthology.orchestra.run.smithi018.stdout:2797 punch from 0xc2fbe58 to 0xc305dfc, (0x9fa4 bytes) 2024-09-22T01:35:53.218 INFO:teuthology.orchestra.run.smithi018.stdout:2798 writesame 0xab7758a thru 0xab79bac data_size 0x1(0x2623 bytes) 2024-09-22T01:35:53.220 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:53.217+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:53.226 INFO:teuthology.orchestra.run.smithi018.stdout:2800 read 0x5ea802c thru 0x5eb7a6d (0xfa42 bytes) 2024-09-22T01:35:53.226 INFO:teuthology.orchestra.run.smithi018.stdout:2801 read 0x333c36a thru 0x333f0a5 (0x2d3c bytes) 2024-09-22T01:35:53.226 INFO:teuthology.orchestra.run.smithi018.stdout:2802 punch from 0xb6c498b to 0xb6c5300, (0x975 bytes) 2024-09-22T01:35:53.226 INFO:teuthology.orchestra.run.smithi018.stdout:2803 writesame 0x3a10b81 thru 0x3a14230 data_size 0x10(0x36b0 bytes) 2024-09-22T01:35:53.244 INFO:teuthology.orchestra.run.smithi018.stdout:2804 trunc from 0xd0b8106 to 0x3cae3f2 2024-09-22T01:35:53.268 INFO:teuthology.orchestra.run.smithi018.stdout:2809 read 0x21c1e9 thru 0x227c2f (0xba47 bytes) 2024-09-22T01:35:53.268 INFO:teuthology.orchestra.run.smithi018.stdout:2811 read 0x16b4e17 thru 0x16c37d1 (0xe9bb bytes) 2024-09-22T01:35:53.269 INFO:teuthology.orchestra.run.smithi018.stdout:2812 writesame 0x1f2e5f thru 0x1fd4a9 data_size 0x1(0xa64b bytes) 2024-09-22T01:35:53.273 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:53.273 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.470880268999998, 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.274 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:35:53.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:35:53.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:35:53.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.470825092999998, 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:53.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:35:53.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:35:53.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:35:53.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.284 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.47075998, 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:35:53.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.470694233, 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:35:53.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:35:53.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:35:53.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.470656763000001, 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:35:53.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:35:53.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:35:53.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.470606147000002, 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.300 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:53.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:35:53.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.469420807999999, 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:53.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:35:53.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:35:53.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.310 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.469358980999999, 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:35:53.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:35:53.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:35:53.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.469310182000001, 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:53.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:35:53.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:35:53.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:53.321 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.469236629000001, 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:35:53.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:53.326 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.469166167000001, 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.469095664000001, 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:35:53.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:35:53.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.336 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.469048432000001, 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.337 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:35:53.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:35:53.341 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.468985556, 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.342 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.46894489, 2024-09-22T01:35:53.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:35:53.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:35:53.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.352 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.468850023000002, 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:35:53.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:35:53.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:35:53.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.468808985999999, 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.358 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:53.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:35:53.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:35:53.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:35:53.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.363 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.468771494999999, 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:35:53.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:35:53.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.468731345999998, 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.369 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:35:53.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.468688551, 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:53.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:35:53.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.379 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:53.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:53.382 INFO:teuthology.orchestra.run.smithi018.stdout:2813 write 0x80c473d thru 0x80c4f93 (0x857 bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2814 read 0x39dd42b thru 0x39ec8fc (0xf4d2 bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2815 read 0x7833f64 thru 0x78369c7 (0x2a64 bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2816 read 0x1e9aa8e thru 0x1ea600d (0xb580 bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2817 punch from 0x5350585 to 0x535c7a5, (0xc220 bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2818 read 0x43449a4 thru 0x4348b15 (0x4172 bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2820 read 0x480d45a thru 0x48194d2 (0xc079 bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2822 write 0xe82c21a thru 0xe830007 (0x3dee bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2824 read 0x4ff9182 thru 0x4ffe82f (0x56ae bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2825 read 0x98b0b96 thru 0x98b49e5 (0x3e50 bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2827 read 0x1bd2961 thru 0x1bdff9e (0xd63e bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:2828 read 0x6fdeb28 thru 0x6fe3a43 (0x4f1c bytes) 2024-09-22T01:35:53.383 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:53.384 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:53.384 INFO:teuthology.orchestra.run.smithi018.stdout:2832 read 0x54cbc4f thru 0x54d8873 (0xcc25 bytes) 2024-09-22T01:35:53.384 INFO:teuthology.orchestra.run.smithi018.stdout:2833 write 0x1a8ddd2 thru 0x1a999a4 (0xbbd3 bytes) 2024-09-22T01:35:53.384 INFO:teuthology.orchestra.run.smithi018.stdout:2835 read 0xdd05ca0 thru 0xdd0b32a (0x568b bytes) 2024-09-22T01:35:53.384 INFO:teuthology.orchestra.run.smithi018.stdout:2836 write 0x825b05b thru 0x825d971 (0x2917 bytes) 2024-09-22T01:35:53.384 INFO:teuthology.orchestra.run.smithi018.stdout:2837 read 0x9c37766 thru 0x9c37af9 (0x394 bytes) 2024-09-22T01:35:53.384 INFO:teuthology.orchestra.run.smithi018.stdout:2838 trunc from 0xe830008 to 0x6209ee8 2024-09-22T01:35:53.384 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:53.376+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:53.419 INFO:teuthology.orchestra.run.smithi018.stdout:2839 writesame 0xbbb37dd thru 0xbbbb887 data_size 0x1(0x80ab bytes) 2024-09-22T01:35:53.419 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:53.419 INFO:teuthology.orchestra.run.smithi018.stdout:2844 writesame 0x7681ee2 thru 0x768bde1 data_size 0x6a(0x9f00 bytes) 2024-09-22T01:35:53.436 INFO:teuthology.orchestra.run.smithi018.stdout:2845 write 0xc593aba thru 0xc59a1df (0x6726 bytes) 2024-09-22T01:35:53.441 INFO:teuthology.orchestra.run.smithi018.stdout:2846 read 0x1c11ff8 thru 0x1c1fcae (0xdcb7 bytes) 2024-09-22T01:35:53.442 INFO:teuthology.orchestra.run.smithi018.stdout:2847 read 0xbd0efdb thru 0xbd14c0b (0x5c31 bytes) 2024-09-22T01:35:53.442 INFO:teuthology.orchestra.run.smithi018.stdout:2848 writesame 0xc11801b thru 0xc124d07 data_size 0x57(0xcced bytes) 2024-09-22T01:35:53.445 INFO:teuthology.orchestra.run.smithi018.stdout:2851 read 0x6fb356b thru 0x6fb64df (0x2f75 bytes) 2024-09-22T01:35:53.445 INFO:teuthology.orchestra.run.smithi018.stdout:2852 read 0x750b4d6 thru 0x7515d03 (0xa82e bytes) 2024-09-22T01:35:53.446 INFO:teuthology.orchestra.run.smithi018.stdout:2853 write 0xab56269 thru 0xab5a6a9 (0x4441 bytes) 2024-09-22T01:35:53.450 INFO:teuthology.orchestra.run.smithi018.stdout:2854 read 0x15251a4 thru 0x15329f4 (0xd851 bytes) 2024-09-22T01:35:53.451 INFO:teuthology.orchestra.run.smithi018.stdout:2855 write 0x4f963ab thru 0x4f99b83 (0x37d9 bytes) 2024-09-22T01:35:53.456 INFO:teuthology.orchestra.run.smithi018.stdout:2856 writesame 0x955b3c8 thru 0x9561c8d data_size 0x1(0x68c6 bytes) 2024-09-22T01:35:53.474 INFO:teuthology.orchestra.run.smithi018.stdout:2857 write 0x4669659 thru 0x466aa5e (0x1406 bytes) 2024-09-22T01:35:53.481 INFO:teuthology.orchestra.run.smithi018.stdout:2859 trunc from 0xc59a1e0 to 0xbc64085 2024-09-22T01:35:53.481 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:53.476+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:53.497 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:35:53.501 INFO:teuthology.orchestra.run.smithi018.stdout:2862 write 0x55e173 thru 0x56d372 (0xf200 bytes) 2024-09-22T01:35:53.570 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:53.570 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:53.570 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:53.570 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:53.582 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:53.577+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:53.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:53.683 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:53.681+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:53.761 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:53.762 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:53.762 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:53.762 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:53.762 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:53.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:53.824 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:53.821+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:53.885 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:53.880+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:53.956 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.954296630999998, 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:35:53.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:35:53.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.624646978000001, 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:35:53.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 59.624503472999997, 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.849184201, 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.972 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:53.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:35:53.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:35:53.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:35:53.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:53.977 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.848118505999999, 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:53.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:35:53.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:35:53.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:35:53.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:35:53.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.540086015999997, 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:53.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:53.988 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.539711722, 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:35:53.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:35:53.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:35:53.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:35:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54465 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.131851873999999, 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050651180000000004, 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54465 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821068+0000", 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821078+0000", 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0164e-05 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821107+0000", 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8985000000000001e-05 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821121+0000", 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.307e-05 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821387+0000", 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026639200000000001 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821395+0000", 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3040000000000005e-06 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:53.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825493+0000", 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040977399999999999 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825630+0000", 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136971 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826131+0000", 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050110499999999995 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:53.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54466 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.131765344999998, 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052214690000000003, 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54466 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:53.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821153+0000", 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7499999999999999e-07 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821158+0000", 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3800000000000004e-06 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821169+0000", 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1124000000000001e-05 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821177+0000", 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1040000000000007e-06 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821467+0000", 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029025299999999997 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821474+0000", 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826170+0000", 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046964709999999998 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826261+0000", 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0708e-05 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826374+0000", 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113182 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54467 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:54.003 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.131729014000001, 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054437169999999998, 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54467 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:54.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1900000000000002e-07 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821193+0000", 2024-09-22T01:35:54.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4130000000000002e-06 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821202+0000", 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821209+0000", 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8800000000000002e-06 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821504+0000", 2024-09-22T01:35:54.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029444600000000002 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821509+0000", 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5500000000000002e-06 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826415+0000", 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004905492 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826527+0000", 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112144 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826633+0000", 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105795 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54510 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:54.008 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.131699081999997, 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057311339999999997, 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54510 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821245+0000", 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5774000000000001e-05 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821257+0000", 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2045000000000001e-05 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821265+0000", 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821538+0000", 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027359599999999997 2024-09-22T01:35:54.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821544+0000", 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7450000000000001e-06 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826699+0000", 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051546229999999997 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826815+0000", 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011646600000000001 2024-09-22T01:35:54.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826950+0000", 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013463700000000001 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54511 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.131640609999998, 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058910409999999996, 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.013 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54511 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:54.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821278+0000", 2024-09-22T01:35:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:35:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821282+0000", 2024-09-22T01:35:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-09-22T01:35:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821291+0000", 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3039999999999994e-06 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821298+0000", 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.041e-06 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821573+0000", 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000274283 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821578+0000", 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0679999999999996e-06 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827015+0000", 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054370670000000003 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827070+0000", 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5773999999999998e-05 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827168+0000", 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7814999999999998e-05 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54512 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.131609707999999, 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061320309999999996, 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54512 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821309+0000", 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.51e-07 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821312+0000", 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0419999999999998e-06 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821320+0000", 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.422e-06 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821332+0000", 2024-09-22T01:35:54.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1951e-05 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821937+0000", 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060522400000000002 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821944+0000", 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.404e-06 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827219+0000", 2024-09-22T01:35:54.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052754389999999998 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827317+0000", 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7536999999999998e-05 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827440+0000", 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123461 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54555 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.131140678000001, 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059477050000000002, 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54555 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821778+0000", 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0500000000000002e-07 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821783+0000", 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.135e-06 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821798+0000", 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4688000000000001e-05 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821808+0000", 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6690000000000001e-06 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821977+0000", 2024-09-22T01:35:54.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169541 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821982+0000", 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-06 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827481+0000", 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054988470000000003 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827582+0000", 2024-09-22T01:35:54.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100554 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827725+0000", 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014320199999999999 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54556 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.131093858, 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00620654, 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54556 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821825+0000", 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821828+0000", 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8809999999999998e-06 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821839+0000", 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.027e-05 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821846+0000", 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822011+0000", 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822017+0000", 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6099999999999997e-06 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827802+0000", 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057848509999999997 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827892+0000", 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0880999999999999e-05 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828030+0000", 2024-09-22T01:35:54.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013803200000000001 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54557 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.131059565000001, 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064190469999999998, 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54557 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821859+0000", 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.99e-07 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821863+0000", 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6569999999999999e-06 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821871+0000", 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9719999999999998e-06 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821878+0000", 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.917e-06 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822045+0000", 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016703000000000001 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822051+0000", 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.626e-06 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828069+0000", 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060179919999999998 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828161+0000", 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1731999999999995e-05 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828277+0000", 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011652199999999999 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54600 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.130623991999997, 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062310530000000003, 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54600 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822295+0000", 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.19e-06 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822301+0000", 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5010000000000004e-06 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822320+0000", 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9724e-05 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822330+0000", 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3899999999999999e-06 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822464+0000", 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013444100000000001 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822470+0000", 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3690000000000003e-06 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828314+0000", 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058434719999999997 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828405+0000", 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1166000000000001e-05 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828525+0000", 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001198 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54601 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:54.043 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.130566373999997, 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064068470000000002, 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54601 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822352+0000", 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822356+0000", 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6519999999999999e-06 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822366+0000", 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0686000000000001e-05 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822374+0000", 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4200000000000001e-06 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822500+0000", 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012665800000000001 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822505+0000", 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.938e-06 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828560+0000", 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060544969999999998 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828651+0000", 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0758000000000001e-05 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828758+0000", 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010760900000000001 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54602 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.130531982000001, 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066069279999999998, 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.048 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54602 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6599999999999996e-07 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822390+0000", 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.377e-06 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822399+0000", 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822406+0000", 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822534+0000", 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012761900000000001 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822539+0000", 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3639999999999998e-06 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828797+0000", 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006257365 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828885+0000", 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8818000000000002e-05 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828993+0000", 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107336 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.052 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54688 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 39.126651097, 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044478340000000003, 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54688 2024-09-22T01:35:54.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826268+0000", 2024-09-22T01:35:54.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-06 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826274+0000", 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826294+0000", 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0211999999999999e-05 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826310+0000", 2024-09-22T01:35:54.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6039999999999999e-05 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830569+0000", 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004258632 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830641+0000", 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2064000000000007e-05 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830715+0000", 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3483000000000001e-05 2024-09-22T01:35:54.056 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.057 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.057 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.057 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.057 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.057 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:54.058 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:54.059 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:54.057+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:54.159 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:54.156+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:54.244 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:54.244 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:54.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.244 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:92499 3.15 3.af1c30d5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-22T01:35:54.244 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:53.516221+0000", 2024-09-22T01:35:54.244 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.72758237299999995, 2024-09-22T01:35:54.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.72762675499999996, 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for peered", 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 92499 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:53.516221+0000", 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:53.516221+0000", 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:53.516223+0000", 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9120000000000001e-06 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:53.516412+0000", 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000188612 2024-09-22T01:35:54.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:53.516428+0000", 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6875999999999999e-05 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:53.516437+0000", 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:53.516513+0000", 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6329999999999996e-05 2024-09-22T01:35:54.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:53.516523+0000", 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1169999999999993e-06 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 1 2024-09-22T01:35:54.248 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:54.260 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:54.261 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:54.256+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:54.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:54.361 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:54.357+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:54.389 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:54.390 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:54.390 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:54.390 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:54.390 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:54.411 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:54.454 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:54.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:54.461 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:54.460+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:54.471 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:54.488 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:54.488 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:54.509 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:54.509 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:54.541 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:54.541 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:54.541 INFO:teuthology.orchestra.run.smithi018.stdout:2864 trunc from 0xbc64085 to 0x675ed76 2024-09-22T01:35:54.561 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:54.557+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:54.563 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:54.563 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:54.576 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:54.576 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:54.586 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:54.590 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:54.607 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:54.663 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:54.660+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:54.719 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:54.719 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:54.733 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:54.763 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:54.757+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:54.865 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:54.861+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:54.898 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:54.898 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:54.912 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:54.965 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:54.961+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:55.033 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:55.033 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:55.047 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:55.066 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:55.061+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:55.167 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:55.164+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:55.168 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:55.168 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:55.182 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:55.274 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:55.272+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:55.346 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:55.346 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:55.360 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:55.368 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:55.365+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:55.469 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:55.468+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:55.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:35:55.529 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:55.530 INFO:teuthology.orchestra.run.smithi018.stdout:2867 write 0x8c35ef thru 0x8d24d8 (0xeeea bytes) 2024-09-22T01:35:55.533 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:55.533 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:55.545 INFO:teuthology.orchestra.run.smithi018.stdout:2869 write 0x25a4010 thru 0x25afbc8 (0xbbb9 bytes) 2024-09-22T01:35:55.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:55.576 INFO:teuthology.orchestra.run.smithi018.stdout:2870 write 0xa2a7931 thru 0xa2b551d (0xdbed bytes) 2024-09-22T01:35:55.581 INFO:teuthology.orchestra.run.smithi018.stdout:2871 read 0x4deb25c thru 0x4debc4b (0x9f0 bytes) 2024-09-22T01:35:55.581 INFO:teuthology.orchestra.run.smithi018.stdout:2873 write 0x160f34d thru 0x16100d9 (0xd8d bytes) 2024-09-22T01:35:55.590 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:55.588+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:55.591 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:55.591 INFO:teuthology.orchestra.run.smithi018.stdout:2875 read 0x47f6f38 thru 0x47f8687 (0x1750 bytes) 2024-09-22T01:35:55.592 INFO:teuthology.orchestra.run.smithi018.stdout:2877 write 0x96d3d72 thru 0x96df09c (0xb32b bytes) 2024-09-22T01:35:55.607 INFO:teuthology.orchestra.run.smithi018.stdout:2878 trunc from 0xa2b551e to 0x4fbe97e 2024-09-22T01:35:55.627 INFO:teuthology.orchestra.run.smithi018.stdout:2879 punch from 0x1e99d88 to 0x1e9f524, (0x579c bytes) 2024-09-22T01:35:55.627 INFO:teuthology.orchestra.run.smithi018.stdout:2880 read 0x2d66f4 thru 0x2e5d2f (0xf63c bytes) 2024-09-22T01:35:55.628 INFO:teuthology.orchestra.run.smithi018.stdout:2881 punch from 0xb802e to 0xc1269, (0x923b bytes) 2024-09-22T01:35:55.638 INFO:teuthology.orchestra.run.smithi018.stdout:2882 trunc from 0x4fbe97e to 0x714ce1 2024-09-22T01:35:55.668 INFO:teuthology.orchestra.run.smithi018.stdout:2885 punch from 0x66e488 to 0x677bed, (0x9765 bytes) 2024-09-22T01:35:55.668 INFO:teuthology.orchestra.run.smithi018.stdout:2886 read 0x28763a thru 0x296677 (0xf03e bytes) 2024-09-22T01:35:55.669 INFO:teuthology.orchestra.run.smithi018.stdout:2888 read 0x358791 thru 0x35eda2 (0x6612 bytes) 2024-09-22T01:35:55.671 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:55.668+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:55.691 INFO:teuthology.orchestra.run.smithi018.stdout:2890 trunc from 0x714ce1 to 0xd9e2b75 2024-09-22T01:35:55.701 INFO:teuthology.orchestra.run.smithi018.stdout:2891 write 0xcf80e33 thru 0xcf8131e (0x4ec bytes) 2024-09-22T01:35:55.706 INFO:teuthology.orchestra.run.smithi018.stdout:2892 write 0x383e193 thru 0x3843042 (0x4eb0 bytes) 2024-09-22T01:35:55.710 INFO:teuthology.orchestra.run.smithi018.stdout:2893 read 0x453f217 thru 0x4545059 (0x5e43 bytes) 2024-09-22T01:35:55.715 INFO:teuthology.orchestra.run.smithi018.stdout:2894 trunc from 0xd9e2b75 to 0xa4e77e8 2024-09-22T01:35:55.717 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:55.717 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:55.730 INFO:teuthology.orchestra.run.smithi018.stdout:2897 trunc from 0xa4e77e8 to 0x9b44bd2 2024-09-22T01:35:55.733 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:35:55.738 INFO:teuthology.orchestra.run.smithi018.stdout:2898 read 0x6a375fc thru 0x6a399b0 (0x23b5 bytes) 2024-09-22T01:35:55.743 INFO:teuthology.orchestra.run.smithi018.stdout:2900 trunc from 0x9b44bd2 to 0x6cfb2c8 2024-09-22T01:35:55.762 INFO:teuthology.orchestra.run.smithi018.stdout:2902 writesame 0x982a239 thru 0x982a38d data_size 0x1(0x155 bytes) 2024-09-22T01:35:55.762 INFO:teuthology.orchestra.run.smithi018.stdout:2903 write 0x890063a thru 0x8909098 (0x8a5f bytes) 2024-09-22T01:35:55.767 INFO:teuthology.orchestra.run.smithi018.stdout:2905 write 0x82b5169 thru 0x82c1d9e (0xcc36 bytes) 2024-09-22T01:35:55.771 INFO:teuthology.orchestra.run.smithi018.stdout:2906 writesame 0x8e89b27 thru 0x8e9263a data_size 0x24(0x8b14 bytes) 2024-09-22T01:35:55.777 INFO:teuthology.orchestra.run.smithi018.stdout:2907 write 0x584271a thru 0x5846f3a (0x4821 bytes) 2024-09-22T01:35:55.778 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:55.776+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:55.793 INFO:teuthology.orchestra.run.smithi018.stdout:2908 write 0xb8da772 thru 0xb8e5c3c (0xb4cb bytes) 2024-09-22T01:35:55.797 INFO:teuthology.orchestra.run.smithi018.stdout:2909 writesame 0x2abc31f thru 0x2abec2f data_size 0x1(0x2911 bytes) 2024-09-22T01:35:55.811 INFO:teuthology.orchestra.run.smithi018.stdout:2910 trunc from 0xb8e5c3d to 0x73c0ccb 2024-09-22T01:35:55.828 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:55.830 INFO:teuthology.orchestra.run.smithi018.stdout:2912 trunc from 0x73c0ccb to 0x8c909c6 2024-09-22T01:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:2913 read 0x498e02b thru 0x499943a (0xb410 bytes) 2024-09-22T01:35:55.840 INFO:teuthology.orchestra.run.smithi018.stdout:2915 punch from 0x536286f to 0x536bbd5, (0x9366 bytes) 2024-09-22T01:35:55.858 INFO:teuthology.orchestra.run.smithi018.stdout:2917 write 0xc2772a8 thru 0xc2866e4 (0xf43d bytes) 2024-09-22T01:35:55.869 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:55.869 INFO:teuthology.orchestra.run.smithi018.stdout:2920 read 0x29111a2 thru 0x292056c (0xf3cb bytes) 2024-09-22T01:35:55.872 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:55.868+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:55.874 INFO:teuthology.orchestra.run.smithi018.stdout:2921 trunc from 0xc2866e5 to 0xed578f9 2024-09-22T01:35:55.885 INFO:teuthology.orchestra.run.smithi018.stdout:2923 read 0x5e12d97 thru 0x5e1a103 (0x736d bytes) 2024-09-22T01:35:55.885 INFO:teuthology.orchestra.run.smithi018.stdout:2925 write 0x57ab0ed thru 0x57b89f7 (0xd90b bytes) 2024-09-22T01:35:55.890 INFO:teuthology.orchestra.run.smithi018.stdout:2926 read 0xea550f3 thru 0xea5f4cb (0xa3d9 bytes) 2024-09-22T01:35:55.890 INFO:teuthology.orchestra.run.smithi018.stdout:2927 writesame 0x793d3b3 thru 0x793e4b7 data_size 0x1(0x1105 bytes) 2024-09-22T01:35:55.896 INFO:teuthology.orchestra.run.smithi018.stdout:2928 clone 23 order 20 su 65536 sc 13 2024-09-22T01:35:55.917 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:55.917 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:55.931 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:35:55.973 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:55.969+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:55.977 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6] out_osds: [2, 0, 7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:35:55.977 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:35:55.977 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-09-22T01:35:55.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 7 2024-09-22T01:35:56.074 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:56.069+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:56.095 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:56.095 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:56.108 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:35:56.175 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:56.169+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:56.224 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:56.225 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:56.239 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:35:56.276 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:56.273+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:56.295 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-22T01:35:56.289+0000 7fb667fae640 -1 mon.a@0(leader).osd e73 definitely_dead 0 2024-09-22T01:35:56.356 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:56.356 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:56.370 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:35:56.414 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:56.412+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:56.477 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:56.472+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:56.488 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:56.488 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:56.502 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:35:56.506 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:35:56.512 INFO:teuthology.orchestra.run.smithi018.stderr:marked in osd.7. 2024-09-22T01:35:56.542 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-09-22T01:35:56.578 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:56.576+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:56.625 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:35:56.634 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:56.634 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:56.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:35:56.696 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:56.693+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:56.773 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:56.773 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:56.780 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:56.777+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:56.790 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:56.790 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:56.808 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:56.808 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:56.815 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:56.816 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:56.817 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:56.825 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:56.825 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:56.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:35:56.847 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:56.847 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:56.868 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:56.868 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:56.881 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:56.876+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:56.888 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:56.889 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:56.911 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:56.911 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:56.966 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:56.966 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:56.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:56.967 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:56.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.967 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48565 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 708608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:56.967 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:56.967 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.498023891000003, 2024-09-22T01:35:56.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086712429999999993, 2024-09-22T01:35:56.967 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:56.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:56.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:56.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:56.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:56.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:56.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48565 2024-09-22T01:35:56.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.968 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:56.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:56.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:56.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:56.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:56.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:35:56.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:56.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:56.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466221+0000", 2024-09-22T01:35:56.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9299999999999998e-07 2024-09-22T01:35:56.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:56.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466224+0000", 2024-09-22T01:35:56.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.977e-06 2024-09-22T01:35:56.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:56.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466233+0000", 2024-09-22T01:35:56.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1419999999999999e-06 2024-09-22T01:35:56.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:56.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466240+0000", 2024-09-22T01:35:56.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6800000000000004e-06 2024-09-22T01:35:56.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:56.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552634+0000", 2024-09-22T01:35:56.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086394356000000005 2024-09-22T01:35:56.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:56.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552731+0000", 2024-09-22T01:35:56.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6681000000000005e-05 2024-09-22T01:35:56.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:56.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552933+0000", 2024-09-22T01:35:56.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020200099999999999 2024-09-22T01:35:56.975 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:56.976 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:56.976 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:56.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.976 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48566 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 718848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:56.976 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:56.976 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.497995711999998, 2024-09-22T01:35:56.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086846866999999994, 2024-09-22T01:35:56.977 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:56.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:56.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:56.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:56.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:56.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:56.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48566 2024-09-22T01:35:56.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.978 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:56.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:56.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:56.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:56.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:56.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:56.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:56.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:56.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:35:56.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.06e-07 2024-09-22T01:35:56.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:56.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466252+0000", 2024-09-22T01:35:56.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.813e-06 2024-09-22T01:35:56.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:56.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466261+0000", 2024-09-22T01:35:56.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7260000000000008e-06 2024-09-22T01:35:56.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:56.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466267+0000", 2024-09-22T01:35:56.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5400000000000001e-06 2024-09-22T01:35:56.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:56.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552974+0000", 2024-09-22T01:35:56.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086707237000000006 2024-09-22T01:35:56.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:56.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553025+0000", 2024-09-22T01:35:56.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0380000000000002e-05 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553095+0000", 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0564999999999999e-05 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48654 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.493752671999999, 2024-09-22T01:35:56.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086747482000000001, 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48654 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5700000000000001e-07 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470498+0000", 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470515+0000", 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7742000000000001e-05 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470546+0000", 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0586000000000002e-05 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:56.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557000+0000", 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086454002000000002 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557110+0000", 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010961 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557239+0000", 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:56.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48655 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 638976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.493677101999999, 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086840121000000006, 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48655 2024-09-22T01:35:56.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:56.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470569+0000", 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5400000000000001e-06 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470575+0000", 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1399999999999997e-06 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470597+0000", 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1676e-05 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:56.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470614+0000", 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7336000000000001e-05 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557279+0000", 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086664832999999997 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557341+0000", 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2073e-05 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:56.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557407+0000", 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6523e-05 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.493573918999999, 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:56.993 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:56.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.998 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:56.998 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:56.998 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.493499509000003, 2024-09-22T01:35:56.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:35:56.998 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:56.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:56.998 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:56.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:56.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:56.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:56.999 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:35:56.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:56.999 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:56.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:56.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.493442977999997, 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:35:57.003 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:35:57.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:35:57.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.493385384, 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:35:57.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:35:57.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:35:57.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:35:57.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:35:57.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.493328046000002, 2024-09-22T01:35:57.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:35:57.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:35:57.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:35:57.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:35:57.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.016 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.493270604999999, 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:57.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:35:57.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.493234696000002, 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.021 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:57.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:35:57.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:35:57.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:35:57.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:35:57.025 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48750 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.488331895000002, 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086758792000000001, 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.026 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48750 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475914+0000", 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.263e-06 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475919+0000", 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.84e-06 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475937+0000", 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7689e-05 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475951+0000", 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3439e-05 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562548+0000", 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086597376000000004 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562605+0000", 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7367999999999997e-05 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562671+0000", 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5816999999999997e-05 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48751 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 641024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.031 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:57.031 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.488257564999998, 2024-09-22T01:35:57.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086829097999999993, 2024-09-22T01:35:57.031 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.031 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.031 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.031 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.031 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.031 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48751 2024-09-22T01:35:57.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.032 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:57.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475988+0000", 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.47e-07 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475994+0000", 2024-09-22T01:35:57.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1260000000000003e-06 2024-09-22T01:35:57.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476019+0000", 2024-09-22T01:35:57.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5471999999999999e-05 2024-09-22T01:35:57.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476033+0000", 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100000000000001e-05 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562691+0000", 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086657746999999993 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562750+0000", 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9188000000000003e-05 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562816+0000", 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5518000000000005e-05 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.488190998, 2024-09-22T01:35:57.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:35:57.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:35:57.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.488127556999999, 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:35:57.040 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:35:57.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.488072320000001, 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:35:57.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:35:57.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:35:57.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:35:57.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.487999006000003, 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.050 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:35:57.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:35:57.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:35:57.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:35:57.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:35:57.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.487944925000001, 2024-09-22T01:35:57.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:57.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:35:57.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.059 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.487890487000001, 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.060 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:35:57.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:35:57.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:35:57.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:35:57.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:35:57.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 48.487834626000001, 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:57.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:35:57.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:35:57.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:35:57.068 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.068 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.068 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.068 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.068 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.068 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:57.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:35:57.070 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:57.065+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:57.170 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:57.168+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:35:57.241 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:57.241 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:57.241 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:57.242 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:57.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:35:57.300 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:57.297+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:57.371 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:57.368+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:57.373 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:57.373 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:57.374 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:57.374 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:57.374 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:57.388 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:35:57.476 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:35:57.473+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:35:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:57.563 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:57.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:57.563 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:57.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.564 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.564 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:57.564 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.758253278000002, 2024-09-22T01:35:57.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:35:57.564 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.564 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.564 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.565 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.565 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:35:57.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.565 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:57.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:57.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:35:57.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:35:57.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:35:57.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:35:57.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:35:57.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:35:57.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:35:57.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:35:57.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:35:57.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:35:57.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:35:57.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:35:57.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:35:57.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:35:57.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:35:57.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:35:57.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:35:57.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:35:57.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:35:57.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:35:57.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.758198102000001, 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.572 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:35:57.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.758132989, 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:35:57.577 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:35:57.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.758067241999999, 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:35:57.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.758029772, 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.588 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:35:57.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.757979156000001, 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.593 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:35:57.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:35:57.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.598 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756793816999998, 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:35:57.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:35:57.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.603 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756731989999999, 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756683191, 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:57.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:57.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:35:57.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756609638, 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:35:57.614 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:35:57.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:35:57.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756539176, 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:35:57.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:35:57.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.625 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756468673000001, 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:35:57.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756421441000001, 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:35:57.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756358564999999, 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.636 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:35:57.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:35:57.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:35:57.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756317898999999, 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:57.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756223032000001, 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.647 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:35:57.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:35:57.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756181994999999, 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:35:57.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:35:57.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:35:57.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756144504000002, 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:35:57.657 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:35:57.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:35:57.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:35:57.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756104355000002, 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:35:57.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.756061559999999, 2024-09-22T01:35:57.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:57.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:35:57.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:57.673 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:57.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:35:57.675 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:57.669+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:57.776 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:57.772+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:57.846 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:57.846 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:57.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:35:57.877 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:57.872+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:57.978 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:57.973+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:57.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:35:58.079 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:58.076+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:58.163 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:35:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 64.162505034999995, 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:35:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:35:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:35:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.832855381999998, 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 63.832711877000001, 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:35:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.057392604999997, 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:35:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:35:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.056326910000003, 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:35:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:35:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.748294420000001, 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.747920125999997, 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:35:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:35:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54465 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.340060278000003, 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050651180000000004, 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54465 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821068+0000", 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821078+0000", 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0164e-05 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821107+0000", 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8985000000000001e-05 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821121+0000", 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.307e-05 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821387+0000", 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026639200000000001 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821395+0000", 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3040000000000005e-06 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825493+0000", 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040977399999999999 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825630+0000", 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136971 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826131+0000", 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050110499999999995 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54466 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.339973749000002, 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052214690000000003, 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54466 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821153+0000", 2024-09-22T01:35:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7499999999999999e-07 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821158+0000", 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3800000000000004e-06 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821169+0000", 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1124000000000001e-05 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821177+0000", 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1040000000000007e-06 2024-09-22T01:35:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821467+0000", 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029025299999999997 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821474+0000", 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826170+0000", 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046964709999999998 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826261+0000", 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0708e-05 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826374+0000", 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113182 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54467 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.339937417999998, 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054437169999999998, 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54467 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1900000000000002e-07 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821193+0000", 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4130000000000002e-06 2024-09-22T01:35:58.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821202+0000", 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821209+0000", 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8800000000000002e-06 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821504+0000", 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029444600000000002 2024-09-22T01:35:58.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821509+0000", 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5500000000000002e-06 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826415+0000", 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004905492 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826527+0000", 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112144 2024-09-22T01:35:58.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826633+0000", 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105795 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54510 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.339907486000001, 2024-09-22T01:35:58.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057311339999999997, 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54510 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821245+0000", 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5774000000000001e-05 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821257+0000", 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2045000000000001e-05 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821265+0000", 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821538+0000", 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027359599999999997 2024-09-22T01:35:58.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821544+0000", 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7450000000000001e-06 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826699+0000", 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051546229999999997 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826815+0000", 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011646600000000001 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826950+0000", 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013463700000000001 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54511 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.339849014000002, 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058910409999999996, 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.218 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54511 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:35:58.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821278+0000", 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821282+0000", 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821291+0000", 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3039999999999994e-06 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821298+0000", 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.041e-06 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821573+0000", 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000274283 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821578+0000", 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0679999999999996e-06 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827015+0000", 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054370670000000003 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827070+0000", 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5773999999999998e-05 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827168+0000", 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7814999999999998e-05 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54512 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.339818112000003, 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061320309999999996, 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.223 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54512 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821309+0000", 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.51e-07 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821312+0000", 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0419999999999998e-06 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821320+0000", 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.422e-06 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821332+0000", 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1951e-05 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821937+0000", 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060522400000000002 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821944+0000", 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.404e-06 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827219+0000", 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052754389999999998 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827317+0000", 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7536999999999998e-05 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827440+0000", 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123461 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54555 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.339349081999998, 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059477050000000002, 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54555 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821778+0000", 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0500000000000002e-07 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821783+0000", 2024-09-22T01:35:58.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.135e-06 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821798+0000", 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4688000000000001e-05 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821808+0000", 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6690000000000001e-06 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821977+0000", 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169541 2024-09-22T01:35:58.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821982+0000", 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-06 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827481+0000", 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054988470000000003 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827582+0000", 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100554 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827725+0000", 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014320199999999999 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54556 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.339302261999997, 2024-09-22T01:35:58.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00620654, 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54556 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821825+0000", 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821828+0000", 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8809999999999998e-06 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821839+0000", 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.027e-05 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821846+0000", 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822011+0000", 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822017+0000", 2024-09-22T01:35:58.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6099999999999997e-06 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827802+0000", 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057848509999999997 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827892+0000", 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0880999999999999e-05 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828030+0000", 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013803200000000001 2024-09-22T01:35:58.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54557 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.339267968999998, 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064190469999999998, 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54557 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.237 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821859+0000", 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.99e-07 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821863+0000", 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6569999999999999e-06 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821871+0000", 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9719999999999998e-06 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821878+0000", 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.917e-06 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822045+0000", 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016703000000000001 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822051+0000", 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.626e-06 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828069+0000", 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060179919999999998 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828161+0000", 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1731999999999995e-05 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828277+0000", 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011652199999999999 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54600 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.338832396000001, 2024-09-22T01:35:58.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062310530000000003, 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54600 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822295+0000", 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.19e-06 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822301+0000", 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5010000000000004e-06 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822320+0000", 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9724e-05 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822330+0000", 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3899999999999999e-06 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822464+0000", 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013444100000000001 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822470+0000", 2024-09-22T01:35:58.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3690000000000003e-06 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828314+0000", 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058434719999999997 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828405+0000", 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1166000000000001e-05 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828525+0000", 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001198 2024-09-22T01:35:58.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54601 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.338774778000001, 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064068470000000002, 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.246 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54601 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822352+0000", 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822356+0000", 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6519999999999999e-06 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822366+0000", 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0686000000000001e-05 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822374+0000", 2024-09-22T01:35:58.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4200000000000001e-06 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822500+0000", 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012665800000000001 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822505+0000", 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.938e-06 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828560+0000", 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060544969999999998 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828651+0000", 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0758000000000001e-05 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828758+0000", 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010760900000000001 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54602 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.250 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.338740385999998, 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066069279999999998, 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54602 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:58.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6599999999999996e-07 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822390+0000", 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.377e-06 2024-09-22T01:35:58.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822399+0000", 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822406+0000", 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822534+0000", 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012761900000000001 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822539+0000", 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3639999999999998e-06 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828797+0000", 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006257365 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828885+0000", 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8818000000000002e-05 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828993+0000", 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107336 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54688 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 43.334859500999997, 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044478340000000003, 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54688 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826268+0000", 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-06 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826274+0000", 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826294+0000", 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0211999999999999e-05 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826310+0000", 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6039999999999999e-05 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830569+0000", 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004258632 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830641+0000", 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2064000000000007e-05 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830715+0000", 2024-09-22T01:35:58.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3483000000000001e-05 2024-09-22T01:35:58.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.259 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:58.260 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:35:58.261 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:58.257+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:58.361 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:58.356+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:58.436 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:58.436 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:58.436 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:35:58.436 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:58.450 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:35:58.461 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:58.456+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:58.543 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:35:58.562 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:58.560+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:58.575 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:35:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:35:58.575 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:35:58.575 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:58.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:35:58.680 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:58.677+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:58.763 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:58.760+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:58.771 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:35:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:35:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:35:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:35:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.644025712000001, 2024-09-22T01:35:58.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:35:58.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643999976000003, 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.776 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:35:58.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643974194000002, 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.780 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:35:58.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:35:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:35:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643929274999998, 2024-09-22T01:35:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:35:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:35:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:35:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:35:58.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:35:58.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643897119000002, 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:35:58.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643869387000002, 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:35:58.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:35:58.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643833563000001, 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:35:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:35:58.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.801 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643797419000002, 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:35:58.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:35:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:35:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:35:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:35:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:35:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:35:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:35:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:35:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:35:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:35:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:35:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.807 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643761214000001, 2024-09-22T01:35:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:35:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.808 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:35:58.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:35:58.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643733861999998, 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:35:58.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:35:58.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:35:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:35:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:35:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:35:58.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643696783999999, 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.816 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643673247000002, 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12683 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643183248, 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058771337, 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.824 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12683 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126558+0000", 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6399999999999998e-07 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126559+0000", 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8360000000000001e-06 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126567+0000", 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4189999999999996e-06 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126578+0000", 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1439e-05 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185320+0000", 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058741987000000002 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185329+0000", 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2919999999999996e-06 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643126047000003, 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.828 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.831 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643098289999998, 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.835 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643076223999998, 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.643046064000004, 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.840 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:35:58.843 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.642625574, 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.844 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.847 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.642599793000002, 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.848 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.851 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 53.642578524999998, 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:35:58.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:35:58.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:35:58.855 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:35:58.856 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:35:58.857 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone22 from 0xed578f9 (overlap 0x714ce1) to 0x38a670 2024-09-22T01:35:58.900 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:58.897+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:58.931 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:35:58.953 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-22T01:35:58.955 INFO:teuthology.orchestra.run.smithi018.stdout:2929 punch from 0x846d247 to 0x84772ec, (0xa0a5 bytes) 2024-09-22T01:35:58.960 INFO:teuthology.orchestra.run.smithi018.stdout:2930 read 0x4cc3df6 thru 0x4cd2c79 (0xee84 bytes) 2024-09-22T01:35:58.960 INFO:teuthology.orchestra.run.smithi018.stdout:2932 write 0x93500df thru 0x935a50e (0xa430 bytes) 2024-09-22T01:35:58.965 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:35:58.960+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:35:58.965 INFO:teuthology.orchestra.run.smithi018.stdout:2934 writesame 0xc26cdb7 thru 0xc27b39b data_size 0x1(0xe5e5 bytes) 2024-09-22T01:35:59.002 INFO:teuthology.orchestra.run.smithi018.stdout:2935 writesame 0xb263618 thru 0xb265528 data_size 0xb(0x1f11 bytes) 2024-09-22T01:35:59.005 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:35:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:35:59.005 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:35:59.005 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:35:59.007 INFO:teuthology.orchestra.run.smithi018.stdout:2937 write 0xc11d749 thru 0xc12a599 (0xce51 bytes) 2024-09-22T01:35:59.015 INFO:teuthology.orchestra.run.smithi018.stdout:2940 writesame 0x177740c thru 0x177a9ee data_size 0x5(0x35e3 bytes) 2024-09-22T01:35:59.020 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:35:59.022 INFO:teuthology.orchestra.run.smithi018.stdout:2941 read 0xd71c580 thru 0xd7256f4 (0x9175 bytes) 2024-09-22T01:35:59.022 INFO:teuthology.orchestra.run.smithi018.stdout:2943 write 0x3846715 thru 0x384915b (0x2a47 bytes) 2024-09-22T01:35:59.029 INFO:teuthology.orchestra.run.smithi018.stdout:2944 write 0x2f6dfec thru 0x2f7718a (0x919f bytes) 2024-09-22T01:35:59.036 INFO:teuthology.orchestra.run.smithi018.stdout:2946 punch from 0x8baccf3 to 0x8bbbf3f, (0xf24c bytes) 2024-09-22T01:35:59.037 INFO:teuthology.orchestra.run.smithi018.stdout:2948 read 0x4935a1f thru 0x49457d0 (0xfdb2 bytes) 2024-09-22T01:35:59.037 INFO:teuthology.orchestra.run.smithi018.stdout:2951 write 0xe3cdb95 thru 0xe3d1e29 (0x4295 bytes) 2024-09-22T01:35:59.066 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:59.064+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:59.087 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:35:59.087 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:35:59.104 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:35:59.105 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:35:59.121 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:35:59.121 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:35:59.140 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:35:59.140 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:35:59.160 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:35:59.161 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:35:59.167 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:59.161+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:59.180 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:35:59.180 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:35:59.187 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:59.187 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:59.189 INFO:teuthology.orchestra.run.smithi018.stdout:2952 write 0x7eff67f thru 0x7f07fd0 (0x8952 bytes) 2024-09-22T01:35:59.200 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:59.200 INFO:teuthology.orchestra.run.smithi018.stdout:2955 read 0x2ff7baa thru 0x2ffcea7 (0x52fe bytes) 2024-09-22T01:35:59.201 INFO:teuthology.orchestra.run.smithi018.stdout:2956 write 0xdbe793b thru 0xdbf4ce8 (0xd3ae bytes) 2024-09-22T01:35:59.204 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:35:59.204 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:35:59.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:35:59.211 INFO:teuthology.orchestra.run.smithi018.stdout:2957 read 0x490c984 thru 0x490dbab (0x1228 bytes) 2024-09-22T01:35:59.211 INFO:teuthology.orchestra.run.smithi018.stdout:2958 punch from 0x51f66d8 to 0x5204afb, (0xe423 bytes) 2024-09-22T01:35:59.211 INFO:teuthology.orchestra.run.smithi018.stdout:2959 punch from 0xafad2d1 to 0xafbaf76, (0xdca5 bytes) 2024-09-22T01:35:59.211 INFO:teuthology.orchestra.run.smithi018.stdout:2962 write 0xc2bcc93 thru 0xc2c8e7a (0xc1e8 bytes) 2024-09-22T01:35:59.213 INFO:teuthology.orchestra.run.smithi018.stdout:2964 read 0xab0d2b thru 0xabe3ec (0xd6c2 bytes) 2024-09-22T01:35:59.225 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:35:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:35:59.250 INFO:teuthology.orchestra.run.smithi018.stdout:2965 trunc from 0xed578f9 to 0x80b0c7 2024-09-22T01:35:59.267 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:35:59.264+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:35:59.330 INFO:teuthology.orchestra.run.smithi018.stdout:2966 write 0xca3dda0 thru 0xca4ceeb (0xf14c bytes) 2024-09-22T01:35:59.335 INFO:teuthology.orchestra.run.smithi018.stdout:2969 write 0x4fda15a thru 0x4fdc379 (0x2220 bytes) 2024-09-22T01:35:59.338 INFO:teuthology.orchestra.run.smithi018.stdout:2970 write 0x1ad987a thru 0x1adb089 (0x1810 bytes) 2024-09-22T01:35:59.341 INFO:teuthology.orchestra.run.smithi018.stdout:2972 writesame 0x4176bdc thru 0x41852e2 data_size 0x47(0xe707 bytes) 2024-09-22T01:35:59.350 INFO:teuthology.orchestra.run.smithi018.stdout:2973 writesame 0xbacab9a thru 0xbad0e50 data_size 0x1(0x62b7 bytes) 2024-09-22T01:35:59.353 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:59.353 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:59.367 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:35:59.368 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:59.365+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:59.369 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:35:59.382 INFO:teuthology.orchestra.run.smithi018.stdout:2977 trunc from 0xca4ceec to 0x2d49dbb 2024-09-22T01:35:59.395 INFO:teuthology.orchestra.run.smithi018.stdout:2978 read 0x831e3d thru 0x83b54a (0x970e bytes) 2024-09-22T01:35:59.396 INFO:teuthology.orchestra.run.smithi018.stdout:2981 trunc from 0x2d49dbb to 0x34fc397 2024-09-22T01:35:59.435 INFO:teuthology.orchestra.run.smithi018.stdout:2983 writesame 0xe0a48ab thru 0xe0ada12 data_size 0x8d(0x9168 bytes) 2024-09-22T01:35:59.435 INFO:teuthology.orchestra.run.smithi018.stdout:2984 write 0x4ff2ea8 thru 0x4ff74ce (0x4627 bytes) 2024-09-22T01:35:59.441 INFO:teuthology.orchestra.run.smithi018.stdout:2985 read 0xc87990a thru 0xc885ee1 (0xc5d8 bytes) 2024-09-22T01:35:59.441 INFO:teuthology.orchestra.run.smithi018.stdout:2987 writesame 0xbf96944 thru 0xbf9c5ac data_size 0x1(0x5c69 bytes) 2024-09-22T01:35:59.468 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:59.465+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:59.473 INFO:teuthology.orchestra.run.smithi018.stdout:2988 writesame 0x87fda81 thru 0x8800a7f data_size 0x1(0x2fff bytes) 2024-09-22T01:35:59.484 INFO:teuthology.orchestra.run.smithi018.stdout:2989 writesame 0x441ae98 thru 0x441c96e data_size 0x1(0x1ad7 bytes) 2024-09-22T01:35:59.492 INFO:teuthology.orchestra.run.smithi018.stdout:2990 punch from 0x8550e36 to 0x85545b9, (0x3783 bytes) 2024-09-22T01:35:59.492 INFO:teuthology.orchestra.run.smithi018.stdout:2991 punch from 0x15d61df to 0x15e1465, (0xb286 bytes) 2024-09-22T01:35:59.492 INFO:teuthology.orchestra.run.smithi018.stdout:2992 write 0xd2c82de thru 0xd2d1df2 (0x9b15 bytes) 2024-09-22T01:35:59.500 INFO:teuthology.orchestra.run.smithi018.stdout:2994 read 0x8e1cb2f thru 0x8e27deb (0xb2bd bytes) 2024-09-22T01:35:59.500 INFO:teuthology.orchestra.run.smithi018.stdout:2995 write 0xaf7f8b0 thru 0xaf87b44 (0x8295 bytes) 2024-09-22T01:35:59.507 INFO:teuthology.orchestra.run.smithi018.stdout:2996 read 0x3d6cff7 thru 0x3d77f14 (0xaf1e bytes) 2024-09-22T01:35:59.507 INFO:teuthology.orchestra.run.smithi018.stdout:2998 read 0x2a6533d thru 0x2a70f89 (0xbc4d bytes) 2024-09-22T01:35:59.539 INFO:teuthology.orchestra.run.smithi018.stdout:2999 trunc from 0xe0ada13 to 0x2238eab 2024-09-22T01:35:59.549 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:59.549 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:35:59.570 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:35:59.565+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:35:59.571 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:35:59.598 INFO:teuthology.orchestra.run.smithi018.stdout:3000 write 0xe641bb0 thru 0xe646496 (0x48e7 bytes) 2024-09-22T01:35:59.671 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:35:59.665+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:35:59.702 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:59.702 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:59.719 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:35:59.773 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:35:59.769+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:35:59.858 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:35:59.858 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:35:59.872 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:35:59.874 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:35:59.872+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:35:59.975 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:35:59.972+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:00.015 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:00.015 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:00.031 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:00.075 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:00.073+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:00.176 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:00.172+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:00.195 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:00.195 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:00.210 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:00.298 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:00.296+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:00.375 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:00.375 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:00.378 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:00.376+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:00.389 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:00.478 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:00.476+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:00.552 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:00.552 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:00.576 INFO:teuthology.orchestra.run.smithi018.stdout:3001 punch from 0x91da111 to 0x91da238, (0x127 bytes) 2024-09-22T01:36:00.578 INFO:teuthology.orchestra.run.smithi018.stdout:3002 write 0x3cec790 thru 0x3cf04e7 (0x3d58 bytes) 2024-09-22T01:36:00.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:00.580 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:00.577+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:00.584 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:00.584 INFO:teuthology.orchestra.run.smithi018.stdout:3004 read 0x63a2a20 thru 0x63af8a7 (0xce88 bytes) 2024-09-22T01:36:00.585 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:00.585 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:00.585 INFO:teuthology.orchestra.run.smithi018.stdout:3007 write 0x62f17ea thru 0x62f3c3f (0x2456 bytes) 2024-09-22T01:36:00.589 INFO:teuthology.orchestra.run.smithi018.stdout:3008 write 0x3df4c35 thru 0x3dff1af (0xa57b bytes) 2024-09-22T01:36:00.594 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:00.595 INFO:teuthology.orchestra.run.smithi018.stdout:3010 write 0x2783c5d thru 0x278d06c (0x9410 bytes) 2024-09-22T01:36:00.600 INFO:teuthology.orchestra.run.smithi018.stdout:3012 write 0x8b56ccf thru 0x8b604ec (0x981e bytes) 2024-09-22T01:36:00.605 INFO:teuthology.orchestra.run.smithi018.stdout:3013 read 0x3d58b75 thru 0x3d66ce6 (0xe172 bytes) 2024-09-22T01:36:00.606 INFO:teuthology.orchestra.run.smithi018.stdout:3014 read 0xaa0d13f thru 0xaa11220 (0x40e2 bytes) 2024-09-22T01:36:00.606 INFO:teuthology.orchestra.run.smithi018.stdout:3015 writesame 0x440040f thru 0x4401afb data_size 0x1(0x16ed bytes) 2024-09-22T01:36:00.614 INFO:teuthology.orchestra.run.smithi018.stdout:3016 read 0x7395edf thru 0x7398f4f (0x3071 bytes) 2024-09-22T01:36:00.615 INFO:teuthology.orchestra.run.smithi018.stdout:3017 writesame 0xb9d77b2 thru 0xb9e466f data_size 0x3(0xcebe bytes) 2024-09-22T01:36:00.637 INFO:teuthology.orchestra.run.smithi018.stdout:3018 punch from 0x61e2750 to 0x61e37ba, (0x106a bytes) 2024-09-22T01:36:00.637 INFO:teuthology.orchestra.run.smithi018.stdout:3019 read 0xcfac66d thru 0xcfaca29 (0x3bd bytes) 2024-09-22T01:36:00.637 INFO:teuthology.orchestra.run.smithi018.stdout:3024 writesame 0x571766b thru 0x571c42e data_size 0x4f(0x4dc4 bytes) 2024-09-22T01:36:00.645 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:00.645 INFO:teuthology.orchestra.run.smithi018.stdout:3029 write 0xb0c305 thru 0xb1956a (0xd266 bytes) 2024-09-22T01:36:00.680 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:00.676+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:00.742 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:00.742 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:00.756 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:00.798 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:00.796+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:00.884 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:00.881+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:00.919 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:00.919 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:00.933 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:00.984 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:00.981+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:01.069 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:01.069 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:01.084 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:01.128 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:01.125+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:01.186 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:01.184+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:01.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:01.255 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:01.256 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:01.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:01.286 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:01.284+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:01.387 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:01.381+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:01.394 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:01.394 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:01.411 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:01.429 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:01.429 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:01.438 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:01.438 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:01.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:01.438 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:01.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.438 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48565 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 708608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.438 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:36:01.438 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.969902765999997, 2024-09-22T01:36:01.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086712429999999993, 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48565 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466220+0000", 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466221+0000", 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9299999999999998e-07 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466224+0000", 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.977e-06 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466233+0000", 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1419999999999999e-06 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466240+0000", 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6800000000000004e-06 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552634+0000", 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086394356000000005 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552731+0000", 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6681000000000005e-05 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552933+0000", 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00020200099999999999 2024-09-22T01:36:01.442 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48566 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 718848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.969874587, 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086846866999999994, 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.443 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48566 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466249+0000", 2024-09-22T01:36:01.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.06e-07 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466252+0000", 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.813e-06 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466261+0000", 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7260000000000008e-06 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.466267+0000", 2024-09-22T01:36:01.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5400000000000001e-06 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.552974+0000", 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086707237000000006 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553025+0000", 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0380000000000002e-05 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.553095+0000", 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0564999999999999e-05 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48654 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 628736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.965631547000001, 2024-09-22T01:36:01.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086747482000000001, 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48654 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470492+0000", 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5700000000000001e-07 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470498+0000", 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3000000000000001e-06 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470515+0000", 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7742000000000001e-05 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470546+0000", 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0586000000000002e-05 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557000+0000", 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086454002000000002 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557110+0000", 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010961 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557239+0000", 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012938500000000001 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.451 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48655 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 638976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.965555977000001, 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086840121000000006, 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48655 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470567+0000", 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470569+0000", 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5400000000000001e-06 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470575+0000", 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1399999999999997e-06 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470597+0000", 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1676e-05 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470614+0000", 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7336000000000001e-05 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557279+0000", 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086664832999999997 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557341+0000", 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2073e-05 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557407+0000", 2024-09-22T01:36:01.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6523e-05 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.965452794000001, 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:36:01.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:36:01.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.459 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.965378383999997, 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.460 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:36:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:36:01.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.463 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.965321852999999, 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:36:01.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:36:01.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.965264259000001, 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.468 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:01.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:36:01.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:36:01.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.965206921000004, 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:36:01.472 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:36:01.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:36:01.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.965149480000001, 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:36:01.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.965113571000003, 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.481 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:36:01.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48750 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 630784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.960210770000003, 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086758792000000001, 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48750 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475912+0000", 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475914+0000", 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.263e-06 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475919+0000", 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.84e-06 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475937+0000", 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7689e-05 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475951+0000", 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3439e-05 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562548+0000", 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086597376000000004 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562605+0000", 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7367999999999997e-05 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562671+0000", 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5816999999999997e-05 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48751 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 641024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.960136439999999, 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086829097999999993, 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.490 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48751 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475987+0000", 2024-09-22T01:36:01.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475988+0000", 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.47e-07 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.475994+0000", 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1260000000000003e-06 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476019+0000", 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5471999999999999e-05 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476033+0000", 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4100000000000001e-05 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562691+0000", 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086657746999999993 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562750+0000", 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9188000000000003e-05 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562816+0000", 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5518000000000005e-05 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:01.494 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.960069873000002, 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:36:01.498 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.960006432, 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.499 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:36:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.959951195000002, 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:01.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:36:01.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:36:01.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.959877880999997, 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:36:01.507 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:01.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:36:01.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:36:01.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:36:01.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:36:01.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:36:01.511 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.959823800000002, 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.512 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:36:01.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:36:01.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.959769362000003, 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.516 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:36:01.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:36:01.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.519 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.959713501000003, 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.520 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:01.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:01.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:01.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:36:01.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:36:01.524 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.524 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.524 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.524 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:01.524 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:01.524 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:01.525 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:01.525 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:01.526 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:01.526 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:01.527 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:01.527 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:01.527 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:01.527 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:01.527 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:01.528 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:01.520+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:01.534 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:01.534 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:01.544 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7] out_osds: [2, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:36:01.544 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:36:01.544 INFO:tasks.thrashosds.thrasher:Adding osd 0 2024-09-22T01:36:01.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 0 2024-09-22T01:36:01.574 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:01.574 INFO:teuthology.orchestra.run.smithi018.stdout:3031 writesame 0x156a912 thru 0x156fff9 data_size 0x48(0x56e8 bytes) 2024-09-22T01:36:01.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:36:01.588 INFO:teuthology.orchestra.run.smithi018.stdout:3032 write 0xd3c7051 thru 0xd3d54dc (0xe48c bytes) 2024-09-22T01:36:01.600 INFO:teuthology.orchestra.run.smithi018.stdout:3034 read 0xd634358 thru 0xd640b46 (0xc7ef bytes) 2024-09-22T01:36:01.601 INFO:teuthology.orchestra.run.smithi018.stdout:3035 read 0xf93d64 thru 0xf97eb4 (0x4151 bytes) 2024-09-22T01:36:01.602 INFO:teuthology.orchestra.run.smithi018.stdout:3037 punch from 0x7ba815a to 0x7bb7653, (0xf4f9 bytes) 2024-09-22T01:36:01.602 INFO:teuthology.orchestra.run.smithi018.stdout:3039 read 0xaf0ae4b thru 0xaf10598 (0x574e bytes) 2024-09-22T01:36:01.602 INFO:teuthology.orchestra.run.smithi018.stdout:3040 punch from 0x1f3f4f0 to 0x1f44bd7, (0x56e7 bytes) 2024-09-22T01:36:01.607 INFO:teuthology.orchestra.run.smithi018.stdout:3042 trunc from 0xe646497 to 0xb4efb9d 2024-09-22T01:36:01.626 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:01.624+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:01.645 INFO:teuthology.orchestra.run.smithi018.stdout:3044 write 0xc8fcf75 thru 0xc8febfe (0x1c8a bytes) 2024-09-22T01:36:01.652 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:01.652 INFO:teuthology.orchestra.run.smithi018.stdout:3048 read 0x92da16b thru 0x92e0f9d (0x6e33 bytes) 2024-09-22T01:36:01.652 INFO:teuthology.orchestra.run.smithi018.stdout:3049 write 0x7423e7a thru 0x7431345 (0xd4cc bytes) 2024-09-22T01:36:01.661 INFO:teuthology.orchestra.run.smithi018.stdout:3050 punch from 0xa101f53 to 0xa10a3ff, (0x84ac bytes) 2024-09-22T01:36:01.661 INFO:teuthology.orchestra.run.smithi018.stdout:3051 write 0x2e6822e thru 0x2e75063 (0xce36 bytes) 2024-09-22T01:36:01.669 INFO:teuthology.orchestra.run.smithi018.stdout:3054 write 0xa9624dd thru 0xa96a956 (0x847a bytes) 2024-09-22T01:36:01.675 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:01.675 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:01.676 INFO:teuthology.orchestra.run.smithi018.stdout:3055 write 0x2b5474e thru 0x2b56984 (0x2237 bytes) 2024-09-22T01:36:01.683 INFO:teuthology.orchestra.run.smithi018.stdout:3056 trunc from 0xc8febff to 0xd02b104 2024-09-22T01:36:01.694 INFO:teuthology.orchestra.run.smithi018.stdout:3057 read 0x7fbbc1f thru 0x7fc48a0 (0x8c82 bytes) 2024-09-22T01:36:01.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:01.705 INFO:teuthology.orchestra.run.smithi018.stdout:3058 trunc from 0xd02b104 to 0x65f7d06 2024-09-22T01:36:01.732 INFO:teuthology.orchestra.run.smithi018.stdout:3059 writesame 0x4215cb3 thru 0x4216afd data_size 0x1(0xe4b bytes) 2024-09-22T01:36:01.733 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:01.729+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:01.739 INFO:teuthology.orchestra.run.smithi018.stdout:3060 read 0x2bedcf3 thru 0x2bf7e81 (0xa18f bytes) 2024-09-22T01:36:01.740 INFO:teuthology.orchestra.run.smithi018.stdout:3062 write 0x1209141 thru 0x120c352 (0x3212 bytes) 2024-09-22T01:36:01.746 INFO:teuthology.orchestra.run.smithi018.stdout:3064 clone 24 order 24 su 524288 sc 10 2024-09-22T01:36:01.825 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:01.826 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:01.826 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:01.826 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:01.826 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:01.828 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:01.825+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:01.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:01.910 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-22T01:36:01.905+0000 7fb667fae640 -1 mon.a@0(leader).osd e79 definitely_dead 0 2024-09-22T01:36:01.928 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:01.925+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:02.005 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.200903058000002, 2024-09-22T01:36:02.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:36:02.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:36:02.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:36:02.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:36:02.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.200847881999998, 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:36:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:36:02.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:36:02.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.200782769, 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:36:02.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:36:02.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.200717021999999, 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:36:02.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:36:02.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:36:02.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.026 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.200679551999997, 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:02.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.200628936000001, 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:36:02.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.036 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.199443596999998, 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:36:02.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:02.041 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.199381770000002, 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:36:02.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.046 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.199332970999997, 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:02.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.199259417999997, 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:36:02.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:36:02.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:36:02.056 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.199188956, 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.057 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:36:02.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:36:02.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.199118452999997, 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:36:02.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:36:02.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.199071220999997, 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.067 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.199008345000003, 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:36:02.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:36:02.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:36:02.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.077 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.198967678999999, 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:36:02.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:36:02.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:36:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.198872811999998, 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:36:02.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.198831775000002, 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:36:02.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.093 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.198794284000002, 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:36:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.198754135000001, 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.099 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.198711340000003, 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.104 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.109 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:02.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:02.111 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:02.108+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:02.212 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:02.212+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:02.284 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:02.284 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:02.284 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:02.298 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:02.313 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:02.308+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:02.414 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:02.409+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:02.422 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:02.422 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:02.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:02.515 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:02.512+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:02.573 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:36:02.583 INFO:teuthology.orchestra.run.smithi018.stderr:marked in osd.0. 2024-09-22T01:36:02.615 INFO:tasks.thrashosds.thrasher:Added osd 0 2024-09-22T01:36:02.615 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:02.612+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:02.624 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 68.621990670000002, 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:36:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:36:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:36:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 68.292341016999998, 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:36:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 68.292197512000001, 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:36:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:36:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:36:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.516878239999997, 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:02.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:36:02.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.515812545000003, 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:02.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:36:02.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:36:02.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:36:02.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.207780055000001, 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:02.649 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:02.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:36:02.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 57.207405760999997, 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:36:02.654 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:02.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54465 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.799545913000003, 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050651180000000004, 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54465 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821068+0000", 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821078+0000", 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0164e-05 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821107+0000", 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8985000000000001e-05 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821121+0000", 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.307e-05 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821387+0000", 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026639200000000001 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821395+0000", 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3040000000000005e-06 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825493+0000", 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040977399999999999 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825630+0000", 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136971 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826131+0000", 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050110499999999995 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54466 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.799459384000002, 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052214690000000003, 2024-09-22T01:36:02.664 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54466 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821153+0000", 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7499999999999999e-07 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821158+0000", 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3800000000000004e-06 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821169+0000", 2024-09-22T01:36:02.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1124000000000001e-05 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821177+0000", 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1040000000000007e-06 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821467+0000", 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029025299999999997 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821474+0000", 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826170+0000", 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046964709999999998 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826261+0000", 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0708e-05 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826374+0000", 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113182 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54467 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.799423052999998, 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054437169999999998, 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54467 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1900000000000002e-07 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821193+0000", 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4130000000000002e-06 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821202+0000", 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821209+0000", 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8800000000000002e-06 2024-09-22T01:36:02.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821504+0000", 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029444600000000002 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821509+0000", 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5500000000000002e-06 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826415+0000", 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004905492 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826527+0000", 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112144 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826633+0000", 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105795 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54510 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.799393121000001, 2024-09-22T01:36:02.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057311339999999997, 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54510 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821245+0000", 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5774000000000001e-05 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821257+0000", 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2045000000000001e-05 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821265+0000", 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821538+0000", 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027359599999999997 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821544+0000", 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7450000000000001e-06 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826699+0000", 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051546229999999997 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826815+0000", 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011646600000000001 2024-09-22T01:36:02.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826950+0000", 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013463700000000001 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54511 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.799334649000002, 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058910409999999996, 2024-09-22T01:36:02.678 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54511 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821278+0000", 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821282+0000", 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821291+0000", 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3039999999999994e-06 2024-09-22T01:36:02.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821298+0000", 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.041e-06 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821573+0000", 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000274283 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821578+0000", 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0679999999999996e-06 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827015+0000", 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054370670000000003 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827070+0000", 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5773999999999998e-05 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827168+0000", 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7814999999999998e-05 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54512 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.799303747000003, 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061320309999999996, 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54512 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821309+0000", 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.51e-07 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821312+0000", 2024-09-22T01:36:02.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0419999999999998e-06 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821320+0000", 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.422e-06 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821332+0000", 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1951e-05 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821937+0000", 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060522400000000002 2024-09-22T01:36:02.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821944+0000", 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.404e-06 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827219+0000", 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052754389999999998 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827317+0000", 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7536999999999998e-05 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827440+0000", 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123461 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54555 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.798834716999998, 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059477050000000002, 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54555 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821778+0000", 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0500000000000002e-07 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821783+0000", 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.135e-06 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821798+0000", 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4688000000000001e-05 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821808+0000", 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6690000000000001e-06 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821977+0000", 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169541 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821982+0000", 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-06 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827481+0000", 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054988470000000003 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827582+0000", 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100554 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827725+0000", 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014320199999999999 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54556 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.798787896999997, 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00620654, 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54556 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821825+0000", 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821828+0000", 2024-09-22T01:36:02.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8809999999999998e-06 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821839+0000", 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.027e-05 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821846+0000", 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822011+0000", 2024-09-22T01:36:02.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822017+0000", 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6099999999999997e-06 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827802+0000", 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057848509999999997 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827892+0000", 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0880999999999999e-05 2024-09-22T01:36:02.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828030+0000", 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013803200000000001 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54557 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.798753603999998, 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064190469999999998, 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54557 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821859+0000", 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.99e-07 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821863+0000", 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6569999999999999e-06 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821871+0000", 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9719999999999998e-06 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821878+0000", 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.917e-06 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822045+0000", 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016703000000000001 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822051+0000", 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.626e-06 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828069+0000", 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060179919999999998 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828161+0000", 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1731999999999995e-05 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828277+0000", 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011652199999999999 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54600 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.798318031000001, 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062310530000000003, 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54600 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:36:02.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822295+0000", 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.19e-06 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822301+0000", 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5010000000000004e-06 2024-09-22T01:36:02.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822320+0000", 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9724e-05 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822330+0000", 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3899999999999999e-06 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822464+0000", 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013444100000000001 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822470+0000", 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3690000000000003e-06 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828314+0000", 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058434719999999997 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828405+0000", 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1166000000000001e-05 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828525+0000", 2024-09-22T01:36:02.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001198 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54601 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.798260413000001, 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064068470000000002, 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54601 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822352+0000", 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822356+0000", 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6519999999999999e-06 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822366+0000", 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0686000000000001e-05 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822374+0000", 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4200000000000001e-06 2024-09-22T01:36:02.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822500+0000", 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012665800000000001 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822505+0000", 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.938e-06 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828560+0000", 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060544969999999998 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828651+0000", 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0758000000000001e-05 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828758+0000", 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010760900000000001 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54602 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:02.709 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.798226020999998, 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066069279999999998, 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54602 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6599999999999996e-07 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822390+0000", 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.377e-06 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822399+0000", 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822406+0000", 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822534+0000", 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012761900000000001 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:02.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822539+0000", 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3639999999999998e-06 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828797+0000", 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006257365 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828885+0000", 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8818000000000002e-05 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828993+0000", 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107336 2024-09-22T01:36:02.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54688 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 47.794345135999997, 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044478340000000003, 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54688 2024-09-22T01:36:02.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826268+0000", 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-06 2024-09-22T01:36:02.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826274+0000", 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826294+0000", 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0211999999999999e-05 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826310+0000", 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6039999999999999e-05 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:02.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830569+0000", 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004258632 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830641+0000", 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2064000000000007e-05 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830715+0000", 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3483000000000001e-05 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:02.717 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:02.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:02.719 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:02.716+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:02.820 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:02.815+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:02.888 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:02.888 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:02.888 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:02.888 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:02.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:02.920 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:02.915+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:03.021 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:03.019+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:03.023 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:03.023 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:03.023 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:03.023 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:03.023 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:03.037 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:03.122 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:03.119+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037764691, 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.165 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037738955000002, 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.169 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:03.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037713173, 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:36:03.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037668254000003, 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.176 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.179 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037636098, 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.180 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037608366000001, 2024-09-22T01:36:03.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037572541999999, 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:36:03.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037536398, 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.190 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:36:03.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.193 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037500193, 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:36:03.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037472841000003, 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:36:03.197 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:36:03.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:36:03.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:36:03.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:36:03.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.201 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.202 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.202 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:03.202 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037435762999998, 2024-09-22T01:36:03.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:36:03.202 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:36:03.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.203 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:03.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:03.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:03.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:36:03.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:36:03.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:36:03.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:36:03.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:36:03.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:36:03.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:36:03.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:36:03.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:36:03.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:36:03.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:36:03.209 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.209 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.209 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.210 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.210 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:03.210 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.037412226000001, 2024-09-22T01:36:03.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:36:03.211 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.211 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.211 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.211 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.211 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:36:03.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.212 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:03.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:03.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:36:03.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:36:03.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:36:03.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:36:03.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12683 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.036922226999998, 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058771337, 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12683 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126558+0000", 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6399999999999998e-07 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126559+0000", 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8360000000000001e-06 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126567+0000", 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4189999999999996e-06 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126578+0000", 2024-09-22T01:36:03.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1439e-05 2024-09-22T01:36:03.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185320+0000", 2024-09-22T01:36:03.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058741987000000002 2024-09-22T01:36:03.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185329+0000", 2024-09-22T01:36:03.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2919999999999996e-06 2024-09-22T01:36:03.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.220 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.221 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.221 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:03.221 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.036865026000001, 2024-09-22T01:36:03.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:36:03.222 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.222 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:36:03.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.036837269000003, 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:36:03.225 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.036815203000003, 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.229 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.036785043000002, 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:36:03.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.036364552999999, 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.036338772000001, 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.036317504000003, 2024-09-22T01:36:03.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:03.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:03.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:36:03.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:36:03.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:03.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:03.247 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:03.248 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:03.249 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:03.243+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:03.349 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:03.349+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:03.379 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:03.379 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:03.379 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:03.379 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:03.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:03.450 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:03.445+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:03.520 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:03.520 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:03.536 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:03.551 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:03.545+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:03.558 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:03.652 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:03.647+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19458 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1417216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.202030250999996, 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.056428816, 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19458 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:03.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:03.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7700000000000005e-07 2024-09-22T01:36:03.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457940+0000", 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4329999999999998e-06 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457947+0000", 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9029999999999998e-06 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457953+0000", 2024-09-22T01:36:03.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8900000000000004e-06 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512121+0000", 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054168717999999998 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512221+0000", 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9279999999999998e-05 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514366+0000", 2024-09-22T01:36:03.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002145115 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19464 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1949696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.201519029000004, 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055080249999999997, 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.669 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19464 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459822+0000", 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013738540000000001 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459827+0000", 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1630000000000004e-06 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459840+0000", 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2775000000000001e-05 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459847+0000", 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8360000000000003e-06 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513362+0000", 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053515442000000003 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513441+0000", 2024-09-22T01:36:03.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8708000000000006e-05 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513528+0000", 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7472000000000005e-05 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19484 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1437696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.199977635000003, 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055077586999999997, 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.673 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19484 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:03.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7e-07 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459993+0000", 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8380000000000002e-06 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460000+0000", 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460005+0000", 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3680000000000001e-06 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514879+0000", 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054874038999999999 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514965+0000", 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5574000000000004e-05 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515067+0000", 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010228100000000001 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19485 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1796096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.199954839, 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055255209, 2024-09-22T01:36:03.677 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19485 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460300+0000", 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028730299999999998 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460304+0000", 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460314+0000", 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7119999999999995e-06 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460321+0000", 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6710000000000002e-06 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515101+0000", 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054780263000000003 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515180+0000", 2024-09-22T01:36:03.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9074999999999998e-05 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515268+0000", 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7416999999999993e-05 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19486 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1970176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.199602957000003, 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055098253, 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.681 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19486 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460365+0000", 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9599999999999999e-07 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460369+0000", 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460382+0000", 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3478999999999999e-05 2024-09-22T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460390+0000", 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5340000000000002e-06 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515297+0000", 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054907665000000001 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515373+0000", 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5721000000000002e-05 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515463+0000", 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9653000000000004e-05 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19487 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1980416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.199554583999998, 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055238787999999997, 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.685 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19487 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460764+0000", 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035164799999999998 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460769+0000", 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.169e-06 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460779+0000", 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3239999999999992e-06 2024-09-22T01:36:03.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460786+0000", 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0500000000000003e-06 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515497+0000", 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054711098 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515576+0000", 2024-09-22T01:36:03.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9085999999999995e-05 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515651+0000", 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5413000000000005e-05 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19501 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1089536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.199147879999998, 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055065846000000002, 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.689 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19501 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460820+0000", 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000005e-07 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460823+0000", 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9459999999999998e-06 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460831+0000", 2024-09-22T01:36:03.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6839999999999996e-06 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460837+0000", 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9479999999999996e-06 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515696+0000", 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054859053999999997 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515783+0000", 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7705000000000001e-05 2024-09-22T01:36:03.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515885+0000", 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101908 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19502 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1263616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.199121722000001, 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055304409999999998, 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.693 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19502 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461917+0000", 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0010713960000000001 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461923+0000", 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7030000000000003e-06 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461936+0000", 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2903e-05 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461944+0000", 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4169999999999992e-06 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515939+0000", 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053995026000000002 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516037+0000", 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8462999999999996e-05 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516150+0000", 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000112502 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19507 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1806336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.19788295, 2024-09-22T01:36:03.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055141745999999998, 2024-09-22T01:36:03.698 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.698 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.698 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.698 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.698 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.698 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.698 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19507 2024-09-22T01:36:03.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.698 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462085+0000", 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462087+0000", 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.418e-06 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462095+0000", 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0460000000000006e-06 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462101+0000", 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1150000000000002e-06 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517103+0000", 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055002874 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517153+0000", 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9888000000000001e-05 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517226+0000", 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2775999999999996e-05 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19508 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1816576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.197860228000003, 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055377692999999999, 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19508 2024-09-22T01:36:03.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462497+0000", 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038960900000000002 2024-09-22T01:36:03.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462501+0000", 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2640000000000002e-06 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462513+0000", 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1643e-05 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462520+0000", 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.148e-06 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517286+0000", 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054766269999999999 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517378+0000", 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1853000000000003e-05 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517485+0000", 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106906 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19509 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1990656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.197429399000001, 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055183229, 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19509 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.706 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462541+0000", 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6460000000000002e-06 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462550+0000", 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3440000000000007e-06 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462556+0000", 2024-09-22T01:36:03.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5330000000000002e-06 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517517+0000", 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054960822999999999 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517620+0000", 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010306600000000001 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517721+0000", 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010129299999999999 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19524 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1099776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.197402326000002, 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055394339000000001, 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.710 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19524 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:03.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462933+0000", 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00036762399999999999 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462937+0000", 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5580000000000002e-06 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462946+0000", 2024-09-22T01:36:03.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3179999999999996e-06 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462953+0000", 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8560000000000001e-06 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517759+0000", 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054806133 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517856+0000", 2024-09-22T01:36:03.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7048999999999999e-05 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517959+0000", 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010280099999999999 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19525 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1110016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.196999509999998, 2024-09-22T01:36:03.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055216300000000003, 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19525 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463068+0000", 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100511 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463072+0000", 2024-09-22T01:36:03.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.563e-06 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463081+0000", 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.816e-06 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463087+0000", 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5910000000000001e-06 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517994+0000", 2024-09-22T01:36:03.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054906644999999997 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518084+0000", 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9806e-05 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518184+0000", 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100368 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19526 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1284096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.196870861999997, 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.05530989, 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.719 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19526 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463491+0000", 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00039443699999999998 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463497+0000", 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463508+0000", 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1685000000000001e-05 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463517+0000", 2024-09-22T01:36:03.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2479999999999996e-06 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518222+0000", 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054705548 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518317+0000", 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4660999999999994e-05 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518406+0000", 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9580999999999995e-05 2024-09-22T01:36:03.722 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19527 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1458176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.196392221000004, 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055079491000000001, 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19527 2024-09-22T01:36:03.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463576+0000", 2024-09-22T01:36:03.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3099999999999997e-07 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463579+0000", 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5719999999999999e-06 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463589+0000", 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4020000000000008e-06 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463595+0000", 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1140000000000002e-06 2024-09-22T01:36:03.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518459+0000", 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054863737000000003 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518543+0000", 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4690000000000004e-05 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518655+0000", 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111345 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.726 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19528 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1468416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.196361787000001, 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.059935753000000001, 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19528 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463794+0000", 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018894199999999999 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463798+0000", 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7000000000000002e-06 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463808+0000", 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0045e-05 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463814+0000", 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:36:03.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518732+0000", 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054917796999999997 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518812+0000", 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9759999999999995e-05 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.523541+0000", 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0047297270000000004 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19529 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1642496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.196143429000003, 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055275522000000001, 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19529 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465588+0000", 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017641309999999999 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465593+0000", 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7350000000000004e-06 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465602+0000", 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.329e-06 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465608+0000", 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6779999999999997e-06 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518932+0000", 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053324085 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519006+0000", 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4072000000000005e-05 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519099+0000", 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3492000000000005e-05 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 34.863586724999998, 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:36:03.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:36:03.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:36:03.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop(client.4367.0:90338 3.f e63/22 3:f57ef966:::rbd_data.110f82290689.0000000000000000:head v 63'283, mlcod=62'280)", 2024-09-22T01:36:03.741 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.864061109000001, 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.057883599000000001, 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:03.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795910+0000", 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9230000000000004e-06 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813541+0000", 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.017631371 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813592+0000", 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1038999999999997e-05 2024-09-22T01:36:03.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813620+0000", 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7169e-05 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813793+0000", 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017370600000000001 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813857+0000", 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3540999999999994e-05 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.853698+0000", 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.039841255999999999 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.853790+0000", 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1594000000000004e-05 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:03.745 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 6.1514440070000003, 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.747 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:03.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:03.751 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:03.752 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:03.752 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:03.753 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:03.753 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:03.754 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:03.754 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:03.749+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:03.758 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:03.758 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:03.774 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:03.795 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:03.795 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:03.815 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:03.815 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:03.834 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:03.834 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:03.854 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:03.849+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:03.855 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:03.855 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:03.927 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:03.928 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:03.943 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:03.955 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:03.949+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:04.055 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:04.051+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:04.069 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:04.069 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:04.083 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:04.156 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:04.153+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:04.245 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:04.245 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:04.257 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:04.251+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:04.259 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:04.359 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:04.353+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:04.427 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:04.427 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:04.442 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:04.486 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:04.483+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:04.560 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:04.555+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:04.570 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:04.571 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:04.584 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:04.608 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:36:04.674 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:04.671+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:04.748 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:04.748 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:04.762 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:04.757+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:04.763 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:04.862 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:04.859+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:04.936 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:04.936 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:04.951 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:04.963 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:04.957+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:04.998 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone23 from 0x65f7d06 (overlap 0x80b0c7) to 0xcde7a 2024-09-22T01:36:05.064 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:05.059+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:05.127 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:05.127 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:05.142 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:05.165 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:05.161+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:05.230 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-22T01:36:05.250 INFO:teuthology.orchestra.run.smithi018.stdout:3065 write 0x50bb5a0 thru 0x50c66b3 (0xb114 bytes) 2024-09-22T01:36:05.266 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:05.263+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:05.271 INFO:teuthology.orchestra.run.smithi018.stdout:3067 write 0x35bd7ad thru 0x35bec2d (0x1481 bytes) 2024-09-22T01:36:05.283 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:05.283 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:05.283 INFO:teuthology.orchestra.run.smithi018.stdout:3070 read 0x252b0a9 thru 0x2533a90 (0x89e8 bytes) 2024-09-22T01:36:05.283 INFO:teuthology.orchestra.run.smithi018.stdout:3071 punch from 0x1e3e188 to 0x1e47362, (0x91da bytes) 2024-09-22T01:36:05.283 INFO:teuthology.orchestra.run.smithi018.stdout:3072 read 0x537f2cf thru 0x5387923 (0x8655 bytes) 2024-09-22T01:36:05.284 INFO:teuthology.orchestra.run.smithi018.stdout:3073 read 0x1b96fdc thru 0x1ba3d85 (0xcdaa bytes) 2024-09-22T01:36:05.285 INFO:teuthology.orchestra.run.smithi018.stdout:3074 read 0x3248f6c thru 0x324b0a4 (0x2139 bytes) 2024-09-22T01:36:05.285 INFO:teuthology.orchestra.run.smithi018.stdout:3075 read 0x1216cf8 thru 0x1217d89 (0x1092 bytes) 2024-09-22T01:36:05.285 INFO:teuthology.orchestra.run.smithi018.stdout:3076 write 0x630031 thru 0x637285 (0x7255 bytes) 2024-09-22T01:36:05.325 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:05.325 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:05.331 INFO:teuthology.orchestra.run.smithi018.stdout:3077 write 0xdd6ae9e thru 0xdd6dfee (0x3151 bytes) 2024-09-22T01:36:05.339 INFO:teuthology.orchestra.run.smithi018.stdout:3078 read 0xc89e265 thru 0xc8a5b84 (0x7920 bytes) 2024-09-22T01:36:05.339 INFO:teuthology.orchestra.run.smithi018.stdout:3080 read 0x4c6e6c5 thru 0x4c6f974 (0x12b0 bytes) 2024-09-22T01:36:05.340 INFO:teuthology.orchestra.run.smithi018.stdout:3082 writesame 0xa3be9b3 thru 0xa3ce4fd data_size 0x1(0xfb4b bytes) 2024-09-22T01:36:05.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:05.388 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:05.385+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:05.418 INFO:teuthology.orchestra.run.smithi018.stdout:3083 read 0x884900a thru 0x8853451 (0xa448 bytes) 2024-09-22T01:36:05.418 INFO:teuthology.orchestra.run.smithi018.stdout:3084 read 0x21e2716 thru 0x21e5f68 (0x3853 bytes) 2024-09-22T01:36:05.429 INFO:teuthology.orchestra.run.smithi018.stdout:3085 trunc from 0xdd6dfef to 0x772fa1d 2024-09-22T01:36:05.468 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:05.463+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:05.485 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:05.485 INFO:teuthology.orchestra.run.smithi018.stdout:3088 write 0x2ab0ace thru 0x2ab1572 (0xaa5 bytes) 2024-09-22T01:36:05.487 INFO:teuthology.orchestra.run.smithi018.stdout:3090 read 0x5c320ab thru 0x5c32123 (0x79 bytes) 2024-09-22T01:36:05.487 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:05.488 INFO:teuthology.orchestra.run.smithi018.stdout:3092 trunc from 0x772fa1d to 0x703f978 2024-09-22T01:36:05.492 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:05.493 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:05.510 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:05.514 INFO:teuthology.orchestra.run.smithi018.stdout:3093 trunc from 0x703f978 to 0xde22f4c 2024-09-22T01:36:05.527 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:05.527 INFO:teuthology.orchestra.run.smithi018.stdout:3097 punch from 0x19ced29 to 0x19cfc5f, (0xf36 bytes) 2024-09-22T01:36:05.527 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:05.527 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:05.527 INFO:teuthology.orchestra.run.smithi018.stdout:3103 read 0xdd8adbe thru 0xdd90d8a (0x5fcd bytes) 2024-09-22T01:36:05.527 INFO:teuthology.orchestra.run.smithi018.stdout:3104 clone 25 order 20 su 65536 sc 7 2024-09-22T01:36:05.569 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:05.563+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:05.602 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:36:05.651 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:05.652 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:05.668 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:05.716 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:05.713+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:05.771 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:05.765+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:05.852 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:05.852 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:05.869 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:05.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:05.916 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:05.913+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:05.973 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:05.967+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:06.050 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:06.050 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:06.067 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:06.073 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:06.067+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:06.081 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:06.081 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:06.098 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:06.098 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:06.115 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:06.115 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:06.132 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:06.132 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:06.153 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:06.173 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:06.174 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:06.174 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:06.171+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:06.185 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:06.185 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:06.185 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:06.185 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:06.185 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:06.195 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:06.195 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:06.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:06.216 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:06.216 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:06.275 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:06.271+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:06.337 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:06.337 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:06.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.533344190000001, 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.338 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:36:06.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.533289013999998, 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.343 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:06.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:36:06.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:36:06.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:06.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:36:06.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.533223901, 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:36:06.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:36:06.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.533158153999999, 2024-09-22T01:36:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:36:06.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:36:06.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:36:06.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.533120683999996, 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:06.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:36:06.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:36:06.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.365 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.533070068000001, 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:36:06.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:36:06.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:36:06.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531884728999998, 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.371 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.376 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531822902000002, 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:06.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:36:06.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531774103000004, 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531700549999996, 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:36:06.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531630088, 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:36:06.392 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:36:06.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.397 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531559584999997, 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.398 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:36:06.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:36:06.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:36:06.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:36:06.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531512352999997, 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.403 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:36:06.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:36:06.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531449477000002, 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.408 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:36:06.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531408810999999, 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:36:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:36:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:36:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:36:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531313943999997, 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.419 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:36:06.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:36:06.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531272907000002, 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.424 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:06.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:36:06.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:36:06.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:36:06.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:36:06.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531235416000001, 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:36:06.430 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531195267000001, 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:36:06.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.531152472000002, 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:36:06.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:36:06.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:36:06.446 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.446 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.446 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.446 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.446 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.446 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:06.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:06.448 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:06.441+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:06.548 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:06.545+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:06.635 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:06.636 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:06.636 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:06.636 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:06.649 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:06.643+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:06.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:06.750 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:06.747+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:06.824 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:06.824 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:06.824 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:06.824 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:06.824 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:06.838 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:06.888 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:06.885+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:06.952 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:06.949+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:06.969 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:06.969 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:06.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:06.969 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:06.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 72.967811257999998, 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.973 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 72.638161604999993, 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:36:06.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:06.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:36:06.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 72.638018099999996, 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:06.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:06.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 61.862698827999999, 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:36:06.984 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:06.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 61.861633132999998, 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 61.553600643000003, 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:06.995 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:06.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:06.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 61.553226348999999, 2024-09-22T01:36:07.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:07.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54465 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.005 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.145366500999998, 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050651180000000004, 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54465 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:36:07.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821068+0000", 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821078+0000", 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0164e-05 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821107+0000", 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8985000000000001e-05 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821121+0000", 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.307e-05 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821387+0000", 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026639200000000001 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821395+0000", 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3040000000000005e-06 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825493+0000", 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040977399999999999 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825630+0000", 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136971 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826131+0000", 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050110499999999995 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54466 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.145279971999997, 2024-09-22T01:36:07.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052214690000000003, 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54466 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821153+0000", 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7499999999999999e-07 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821158+0000", 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3800000000000004e-06 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821169+0000", 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1124000000000001e-05 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821177+0000", 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1040000000000007e-06 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821467+0000", 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029025299999999997 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821474+0000", 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826170+0000", 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046964709999999998 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826261+0000", 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0708e-05 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826374+0000", 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113182 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54467 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.145243641, 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054437169999999998, 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54467 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1900000000000002e-07 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821193+0000", 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4130000000000002e-06 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821202+0000", 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821209+0000", 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8800000000000002e-06 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821504+0000", 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029444600000000002 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821509+0000", 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5500000000000002e-06 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826415+0000", 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004905492 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826527+0000", 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112144 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826633+0000", 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105795 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54510 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.145213708999997, 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057311339999999997, 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54510 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821245+0000", 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5774000000000001e-05 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821257+0000", 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2045000000000001e-05 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821265+0000", 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:36:07.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821538+0000", 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027359599999999997 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821544+0000", 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7450000000000001e-06 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826699+0000", 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051546229999999997 2024-09-22T01:36:07.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826815+0000", 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011646600000000001 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826950+0000", 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013463700000000001 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54511 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.145155236999997, 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058910409999999996, 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54511 2024-09-22T01:36:07.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821278+0000", 2024-09-22T01:36:07.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821282+0000", 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821291+0000", 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3039999999999994e-06 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821298+0000", 2024-09-22T01:36:07.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.041e-06 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821573+0000", 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000274283 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821578+0000", 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0679999999999996e-06 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827015+0000", 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054370670000000003 2024-09-22T01:36:07.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827070+0000", 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5773999999999998e-05 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827168+0000", 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7814999999999998e-05 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54512 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.029 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.145124334999998, 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061320309999999996, 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54512 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821309+0000", 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.51e-07 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821312+0000", 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0419999999999998e-06 2024-09-22T01:36:07.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821320+0000", 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.422e-06 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821332+0000", 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1951e-05 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821937+0000", 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060522400000000002 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821944+0000", 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.404e-06 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827219+0000", 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052754389999999998 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827317+0000", 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7536999999999998e-05 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827440+0000", 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123461 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54555 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.144655305000001, 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059477050000000002, 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54555 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821778+0000", 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0500000000000002e-07 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821783+0000", 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.135e-06 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821798+0000", 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4688000000000001e-05 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821808+0000", 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6690000000000001e-06 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821977+0000", 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169541 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821982+0000", 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-06 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827481+0000", 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054988470000000003 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827582+0000", 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100554 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827725+0000", 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014320199999999999 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54556 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.144608484999999, 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00620654, 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54556 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821825+0000", 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821828+0000", 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8809999999999998e-06 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821839+0000", 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.027e-05 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821846+0000", 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822011+0000", 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822017+0000", 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6099999999999997e-06 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827802+0000", 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057848509999999997 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827892+0000", 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0880999999999999e-05 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828030+0000", 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013803200000000001 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54557 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.144574192, 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064190469999999998, 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.044 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54557 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821859+0000", 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.99e-07 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821863+0000", 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6569999999999999e-06 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821871+0000", 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9719999999999998e-06 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821878+0000", 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.917e-06 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822045+0000", 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016703000000000001 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822051+0000", 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.626e-06 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828069+0000", 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060179919999999998 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828161+0000", 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1731999999999995e-05 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828277+0000", 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011652199999999999 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54600 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.144138619000003, 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062310530000000003, 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54600 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822295+0000", 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.19e-06 2024-09-22T01:36:07.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822301+0000", 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5010000000000004e-06 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822320+0000", 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9724e-05 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822330+0000", 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3899999999999999e-06 2024-09-22T01:36:07.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822464+0000", 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013444100000000001 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822470+0000", 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3690000000000003e-06 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828314+0000", 2024-09-22T01:36:07.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058434719999999997 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828405+0000", 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1166000000000001e-05 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828525+0000", 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001198 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.053 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54601 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.144081001000004, 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064068470000000002, 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54601 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822352+0000", 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822356+0000", 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6519999999999999e-06 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822366+0000", 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0686000000000001e-05 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822374+0000", 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4200000000000001e-06 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822500+0000", 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012665800000000001 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822505+0000", 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.938e-06 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828560+0000", 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060544969999999998 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828651+0000", 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0758000000000001e-05 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828758+0000", 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010760900000000001 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.058 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54602 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.144046609, 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066069279999999998, 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54602 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6599999999999996e-07 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822390+0000", 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.377e-06 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822399+0000", 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822406+0000", 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822534+0000", 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012761900000000001 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822539+0000", 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3639999999999998e-06 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828797+0000", 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006257365 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828885+0000", 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8818000000000002e-05 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828993+0000", 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107336 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54688 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 52.140165723999999, 2024-09-22T01:36:07.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044478340000000003, 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54688 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826268+0000", 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-06 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826274+0000", 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826294+0000", 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0211999999999999e-05 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826310+0000", 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6039999999999999e-05 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830569+0000", 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004258632 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830641+0000", 2024-09-22T01:36:07.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2064000000000007e-05 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830715+0000", 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3483000000000001e-05 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.067 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:07.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:07.069 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:07.065+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:07.170 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:07.167+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:07.241 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:07.242 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:07.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:07.271 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:07.267+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:07.372 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:07.367+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:07.374 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:07.375 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:07.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:07.472 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:07.469+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:07.518 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390409452, 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:07.519 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:36:07.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:36:07.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:36:07.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:36:07.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:36:07.523 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390383716000002, 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.524 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:36:07.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390357934000001, 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:36:07.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.532 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390313014999997, 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:36:07.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:36:07.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390280859000001, 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.537 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:07.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:36:07.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:36:07.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390253127000001, 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:36:07.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.543 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:36:07.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390217303, 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.546 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:36:07.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390181159000001, 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.550 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390144954, 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:36:07.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:36:07.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390117601999997, 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:36:07.559 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:07.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:36:07.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390080523999998, 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.564 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:36:07.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.568 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.390056987000001, 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.569 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:36:07.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:36:07.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12683 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.389566987999999, 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058771337, 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.573 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12683 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126558+0000", 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6399999999999998e-07 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126559+0000", 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8360000000000001e-06 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.575 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126567+0000", 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4189999999999996e-06 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126578+0000", 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1439e-05 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185320+0000", 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058741987000000002 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185329+0000", 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2919999999999996e-06 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.389509787000001, 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:36:07.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:36:07.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:36:07.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:36:07.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.389482030000003, 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.582 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:36:07.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.586 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.389459963999997, 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:36:07.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.389429804000002, 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:36:07.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:36:07.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.389009313999999, 2024-09-22T01:36:07.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:36:07.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.599 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.388983533000001, 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:36:07.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.388962265000004, 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:36:07.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:36:07.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:07.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:36:07.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:36:07.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.608 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:07.608 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:07.608 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:07.609 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:07.610 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:07.603+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:07.615 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7, 0] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:36:07.615 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:36:07.615 INFO:tasks.thrashosds.thrasher:Adding osd 2 2024-09-22T01:36:07.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 2 2024-09-22T01:36:07.627 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:36:07.710 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:07.705+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:07.743 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:07.743 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:07.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:07.743 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop(client.4367.0:94440 3.e e85/77 3:701e3dcd:::rbd_id.image_client.0-clone25:head v 85'205, mlcod=79'202)", 2024-09-22T01:36:07.743 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:07.742907+0000", 2024-09-22T01:36:07.743 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00016196, 2024-09-22T01:36:07.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022746800000000001, 2024-09-22T01:36:07.743 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:07.743 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:07.742907+0000", 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:07.742907+0000", 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:07.742908+0000", 2024-09-22T01:36:07.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5600000000000005e-07 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:07.742919+0000", 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0664e-05 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:07.742947+0000", 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7869e-05 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:07.742959+0000", 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2565000000000001e-05 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:07.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:07.743039+0000", 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9623999999999995e-05 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:07.743061+0000", 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2441000000000001e-05 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 1 2024-09-22T01:36:07.746 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:07.759 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:07.782 INFO:teuthology.orchestra.run.smithi018.stdout:flattening image image_client.0-clone24 2024-09-22T01:36:07.810 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:07.807+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:07.876 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:07.876 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:07.876 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:07.876 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:07.877 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:07.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:07.911 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:07.905+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:07.986 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-22T01:36:07.981+0000 7fb667fae640 -1 mon.a@0(leader).osd e85 definitely_dead 0 2024-09-22T01:36:07.990 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-22T01:36:07.996 INFO:teuthology.orchestra.run.smithi018.stdout:3105 read 0x2b80469 thru 0x2b8a3b0 (0x9f48 bytes) 2024-09-22T01:36:07.997 INFO:teuthology.orchestra.run.smithi018.stdout:3106 read 0x933704b thru 0x933d8df (0x6895 bytes) 2024-09-22T01:36:07.998 INFO:teuthology.orchestra.run.smithi018.stdout:3107 write 0x41b7253 thru 0x41c639f (0xf14d bytes) 2024-09-22T01:36:08.010 INFO:teuthology.orchestra.run.smithi018.stdout:3109 read 0xaafa36e thru 0xaafc0d1 (0x1d64 bytes) 2024-09-22T01:36:08.010 INFO:teuthology.orchestra.run.smithi018.stdout:3110 write 0x3a68754 thru 0x3a77b84 (0xf431 bytes) 2024-09-22T01:36:08.012 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:08.009+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:08.016 INFO:teuthology.orchestra.run.smithi018.stdout:3111 write 0x8017e86 thru 0x801ff07 (0x8082 bytes) 2024-09-22T01:36:08.021 INFO:teuthology.orchestra.run.smithi018.stdout:3112 read 0xd4b0ef7 thru 0xd4c0e31 (0xff3b bytes) 2024-09-22T01:36:08.030 INFO:teuthology.orchestra.run.smithi018.stdout:3113 write 0xe91475d thru 0xe9171f5 (0x2a99 bytes) 2024-09-22T01:36:08.035 INFO:teuthology.orchestra.run.smithi018.stdout:3114 punch from 0x5bf4d3a to 0x5bfb347, (0x660d bytes) 2024-09-22T01:36:08.035 INFO:teuthology.orchestra.run.smithi018.stdout:3115 read 0xb2c1b56 thru 0xb2c5bb7 (0x4062 bytes) 2024-09-22T01:36:08.035 INFO:teuthology.orchestra.run.smithi018.stdout:3119 read 0xa7792d1 thru 0xa785cf5 (0xca25 bytes) 2024-09-22T01:36:08.038 INFO:teuthology.orchestra.run.smithi018.stdout:3120 trunc from 0xe9171f6 to 0xcf4bd9d 2024-09-22T01:36:08.060 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.063 INFO:teuthology.orchestra.run.smithi018.stdout:3122 trunc from 0xcf4bd9d to 0xa93d715 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19458 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1417216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.615709440000003, 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.056428816, 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.077 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19458 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7700000000000005e-07 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457940+0000", 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4329999999999998e-06 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457947+0000", 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9029999999999998e-06 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457953+0000", 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8900000000000004e-06 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512121+0000", 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054168717999999998 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512221+0000", 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9279999999999998e-05 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514366+0000", 2024-09-22T01:36:08.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002145115 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19464 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1949696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.615198218000003, 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055080249999999997, 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19464 2024-09-22T01:36:08.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459822+0000", 2024-09-22T01:36:08.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013738540000000001 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459827+0000", 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1630000000000004e-06 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459840+0000", 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2775000000000001e-05 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459847+0000", 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8360000000000003e-06 2024-09-22T01:36:08.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513362+0000", 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053515442000000003 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513441+0000", 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8708000000000006e-05 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513528+0000", 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7472000000000005e-05 2024-09-22T01:36:08.084 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19484 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1437696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.613656824000003, 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055077586999999997, 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19484 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.085 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7e-07 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459993+0000", 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8380000000000002e-06 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460000+0000", 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460005+0000", 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3680000000000001e-06 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514879+0000", 2024-09-22T01:36:08.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054874038999999999 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514965+0000", 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5574000000000004e-05 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515067+0000", 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010228100000000001 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19485 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1796096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.088 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.613634028, 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055255209, 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19485 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460300+0000", 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028730299999999998 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460304+0000", 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460314+0000", 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7119999999999995e-06 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460321+0000", 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6710000000000002e-06 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515101+0000", 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054780263000000003 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515180+0000", 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9074999999999998e-05 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515268+0000", 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7416999999999993e-05 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19486 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1970176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.613282146000003, 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055098253, 2024-09-22T01:36:08.092 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19486 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460365+0000", 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9599999999999999e-07 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460369+0000", 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460382+0000", 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3478999999999999e-05 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460390+0000", 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5340000000000002e-06 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515297+0000", 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054907665000000001 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515373+0000", 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5721000000000002e-05 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515463+0000", 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9653000000000004e-05 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19487 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1980416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.096 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.613233772999997, 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055238787999999997, 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19487 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460764+0000", 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035164799999999998 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460769+0000", 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.169e-06 2024-09-22T01:36:08.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460779+0000", 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3239999999999992e-06 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460786+0000", 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0500000000000003e-06 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515497+0000", 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054711098 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515576+0000", 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9085999999999995e-05 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515651+0000", 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5413000000000005e-05 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19501 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1089536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:08.100 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.612827068999998, 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055065846000000002, 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19501 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:08.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460820+0000", 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000005e-07 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460823+0000", 2024-09-22T01:36:08.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9459999999999998e-06 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460831+0000", 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6839999999999996e-06 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460837+0000", 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9479999999999996e-06 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515696+0000", 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054859053999999997 2024-09-22T01:36:08.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515783+0000", 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7705000000000001e-05 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515885+0000", 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101908 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19502 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1263616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.104 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.612800911000001, 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055304409999999998, 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19502 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.105 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461917+0000", 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0010713960000000001 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461923+0000", 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7030000000000003e-06 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461936+0000", 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2903e-05 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461944+0000", 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4169999999999992e-06 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515939+0000", 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053995026000000002 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516037+0000", 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8462999999999996e-05 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516150+0000", 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000112502 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19507 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1806336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.611562139, 2024-09-22T01:36:08.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055141745999999998, 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19507 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.109 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462085+0000", 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462087+0000", 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.418e-06 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.110 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462095+0000", 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0460000000000006e-06 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462101+0000", 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1150000000000002e-06 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517103+0000", 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055002874 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517153+0000", 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9888000000000001e-05 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517226+0000", 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2775999999999996e-05 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19508 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1816576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.611539417000003, 2024-09-22T01:36:08.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055377692999999999, 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19508 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.113 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462497+0000", 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038960900000000002 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462501+0000", 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2640000000000002e-06 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.114 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462513+0000", 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1643e-05 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462520+0000", 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.148e-06 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517286+0000", 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054766269999999999 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517378+0000", 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1853000000000003e-05 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517485+0000", 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106906 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19509 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1990656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.116 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.611108588, 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055183229, 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19509 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:08.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462541+0000", 2024-09-22T01:36:08.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6460000000000002e-06 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462550+0000", 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3440000000000007e-06 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462556+0000", 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5330000000000002e-06 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517517+0000", 2024-09-22T01:36:08.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054960822999999999 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517620+0000", 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010306600000000001 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517721+0000", 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010129299999999999 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19524 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1099776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.611081515000002, 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055394339000000001, 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19524 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.121 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462933+0000", 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00036762399999999999 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.122 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462937+0000", 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5580000000000002e-06 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462946+0000", 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3179999999999996e-06 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462953+0000", 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8560000000000001e-06 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517759+0000", 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054806133 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517856+0000", 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7048999999999999e-05 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517959+0000", 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010280099999999999 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19525 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1110016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.124 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.610678698999997, 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055216300000000003, 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19525 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463068+0000", 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100511 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463072+0000", 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.563e-06 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463081+0000", 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.816e-06 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463087+0000", 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5910000000000001e-06 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517994+0000", 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054906644999999997 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518084+0000", 2024-09-22T01:36:08.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9806e-05 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518184+0000", 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100368 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19526 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1284096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.610550050999997, 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.05530989, 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.128 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19526 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.129 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463491+0000", 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00039443699999999998 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463497+0000", 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463508+0000", 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1685000000000001e-05 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463517+0000", 2024-09-22T01:36:08.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2479999999999996e-06 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518222+0000", 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054705548 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518317+0000", 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4660999999999994e-05 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518406+0000", 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9580999999999995e-05 2024-09-22T01:36:08.131 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19527 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1458176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.610071410000003, 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055079491000000001, 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19527 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.132 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463576+0000", 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3099999999999997e-07 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.133 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463579+0000", 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5719999999999999e-06 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463589+0000", 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4020000000000008e-06 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463595+0000", 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1140000000000002e-06 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518459+0000", 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054863737000000003 2024-09-22T01:36:08.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518543+0000", 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4690000000000004e-05 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518655+0000", 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111345 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19528 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1468416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:08.135 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.610040976000001, 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.059935753000000001, 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19528 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463794+0000", 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018894199999999999 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463798+0000", 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7000000000000002e-06 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.137 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463808+0000", 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0045e-05 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463814+0000", 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518732+0000", 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054917796999999997 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518812+0000", 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9759999999999995e-05 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.523541+0000", 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0047297270000000004 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19529 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1642496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.609822618000003, 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055275522000000001, 2024-09-22T01:36:08.139 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19529 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:08.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465588+0000", 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017641309999999999 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465593+0000", 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7350000000000004e-06 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465602+0000", 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.329e-06 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465608+0000", 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6779999999999997e-06 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518932+0000", 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053324085 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519006+0000", 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4072000000000005e-05 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519099+0000", 2024-09-22T01:36:08.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3492000000000005e-05 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 39.277265913999997, 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:36:08.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.145 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:36:08.146 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop(client.4367.0:90338 3.f e63/22 3:f57ef966:::rbd_data.110f82290689.0000000000000000:head v 63'283, mlcod=62'280)", 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.277740298000001, 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.057883599000000001, 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:08.149 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795910+0000", 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9230000000000004e-06 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.150 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813541+0000", 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.017631371 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813592+0000", 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1038999999999997e-05 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813620+0000", 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7169e-05 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.151 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813793+0000", 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017370600000000001 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813857+0000", 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3540999999999994e-05 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.853698+0000", 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.039841255999999999 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.152 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.853790+0000", 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1594000000000004e-05 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.565123196, 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.153 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.154 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.155 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.156 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:36:08.157 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.158 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.159 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.159 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.159 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.159 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:08.160 INFO:teuthology.orchestra.run.smithi018.stdout:3123 read 0x91cd241 thru 0x91cf823 (0x25e3 bytes) 2024-09-22T01:36:08.160 INFO:teuthology.orchestra.run.smithi018.stdout:3126 trunc from 0xa93d715 to 0x14a9498 2024-09-22T01:36:08.160 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:08.161 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:08.155+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:08.189 INFO:teuthology.orchestra.run.smithi018.stdout:3127 write 0xe264a02 thru 0xe265d1f (0x131e bytes) 2024-09-22T01:36:08.195 INFO:teuthology.orchestra.run.smithi018.stdout:3128 write 0x235b4e8 thru 0x23601ae (0x4cc7 bytes) 2024-09-22T01:36:08.205 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.205 INFO:teuthology.orchestra.run.smithi018.stdout:3130 read 0xc862a94 thru 0xc86f1bd (0xc72a bytes) 2024-09-22T01:36:08.210 INFO:teuthology.orchestra.run.smithi018.stdout:3131 trunc from 0xe265d20 to 0xc1aa800 2024-09-22T01:36:08.231 INFO:teuthology.orchestra.run.smithi018.stdout:3134 read 0x12cb702 thru 0x12ccddf (0x16de bytes) 2024-09-22T01:36:08.232 INFO:teuthology.orchestra.run.smithi018.stdout:3135 read 0x3d2e85e thru 0x3d3c17a (0xd91d bytes) 2024-09-22T01:36:08.232 INFO:teuthology.orchestra.run.smithi018.stdout:3137 read 0xa7077d7 thru 0xa7094dd (0x1d07 bytes) 2024-09-22T01:36:08.232 INFO:teuthology.orchestra.run.smithi018.stdout:3138 write 0x1d50b8f thru 0x1d5a0ef (0x9561 bytes) 2024-09-22T01:36:08.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:08.239 INFO:teuthology.orchestra.run.smithi018.stdout:3139 write 0x9677394 thru 0x967e566 (0x71d3 bytes) 2024-09-22T01:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:3140 read 0x60bc3f0 thru 0x60bf957 (0x3568 bytes) 2024-09-22T01:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:3141 punch from 0x26c4a44 to 0x26cf421, (0xa9dd bytes) 2024-09-22T01:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:3142 read 0x8681bfb thru 0x8685979 (0x3d7f bytes) 2024-09-22T01:36:08.247 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.251 INFO:teuthology.orchestra.run.smithi018.stdout:3147 trunc from 0xc1aa800 to 0xa8c1d16 2024-09-22T01:36:08.260 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.261 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:08.257+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:08.261 INFO:teuthology.orchestra.run.smithi018.stdout:3150 writesame 0xa6d278f thru 0xa6d8d91 data_size 0x5(0x6603 bytes) 2024-09-22T01:36:08.269 INFO:teuthology.orchestra.run.smithi018.stdout:3151 punch from 0x8fc1a9e to 0x8fcf1c0, (0xd722 bytes) 2024-09-22T01:36:08.269 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.269 INFO:teuthology.orchestra.run.smithi018.stdout:3154 writesame 0x4f43092 thru 0x4f51e1a data_size 0x1(0xed89 bytes) 2024-09-22T01:36:08.316 INFO:teuthology.orchestra.run.smithi018.stdout:3155 punch from 0x8dea984 to 0x8df0b43, (0x61bf bytes) 2024-09-22T01:36:08.316 INFO:teuthology.orchestra.run.smithi018.stdout:3156 punch from 0x279cf7d to 0x27abf0d, (0xef90 bytes) 2024-09-22T01:36:08.334 INFO:teuthology.orchestra.run.smithi018.stdout:3157 write 0xed35c34 thru 0xed374c9 (0x1896 bytes) 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:94953 3.1c 3:39960620:::rbd_data.110f30608ae1.00000000000000e8:head [set-alloc-hint object_size 1048576 write_size 1048576,write 941108~6294 in=6294b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:08.338188+0000", 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.001751378, 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0018332279999999999, 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "waiting for sub ops", 2024-09-22T01:36:08.340 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 94953 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:08.338188+0000", 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:08.338188+0000", 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:08.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:08.338190+0000", 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.616e-06 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:08.338210+0000", 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9847000000000002e-05 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:08.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:08.338241+0000", 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1055e-05 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:08.338257+0000", 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.573e-05 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:08.338415+0000", 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015788099999999999 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:08.338804+0000", 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038897699999999999 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 4", 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:08.339201+0000", 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00039700299999999999 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:08.345 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:36:08.345 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 1 2024-09-22T01:36:08.345 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:08.345 INFO:teuthology.orchestra.run.smithi018.stdout:3158 write 0x1ea0d17 thru 0x1eaa604 (0x98ee bytes) 2024-09-22T01:36:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:3159 read 0x577e1a9 thru 0x5788d1e (0xab76 bytes) 2024-09-22T01:36:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:3160 read 0x6e85e48 thru 0x6e94da2 (0xef5b bytes) 2024-09-22T01:36:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:3163 writesame 0xc79e64b thru 0xc79f246 data_size 0x1a(0xbfc bytes) 2024-09-22T01:36:08.349 INFO:teuthology.orchestra.run.smithi018.stdout:3164 writesame 0x72d0697 thru 0x72de67c data_size 0x52(0xdfe6 bytes) 2024-09-22T01:36:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:3165 punch from 0x85fb348 to 0x85fb74d, (0x405 bytes) 2024-09-22T01:36:08.356 INFO:teuthology.orchestra.run.smithi018.stdout:3166 punch from 0x377856c to 0x3783b48, (0xb5dc bytes) 2024-09-22T01:36:08.356 INFO:teuthology.orchestra.run.smithi018.stdout:3168 punch from 0xd4abf92 to 0xd4b6389, (0xa3f7 bytes) 2024-09-22T01:36:08.356 INFO:teuthology.orchestra.run.smithi018.stdout:3171 read 0x3ecdd50 thru 0x3ed49a6 (0x6c57 bytes) 2024-09-22T01:36:08.356 INFO:teuthology.orchestra.run.smithi018.stdout:3173 read 0x4fcb1f9 thru 0x4fd3eb0 (0x8cb8 bytes) 2024-09-22T01:36:08.357 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:08.357 INFO:teuthology.orchestra.run.smithi018.stdout:3177 writesame 0xce7f843 thru 0xce8f25c data_size 0x9(0xfa1a bytes) 2024-09-22T01:36:08.361 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:08.357+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:08.366 INFO:teuthology.orchestra.run.smithi018.stdout:3178 punch from 0x72c7b0f to 0x72c965f, (0x1b50 bytes) 2024-09-22T01:36:08.366 INFO:teuthology.orchestra.run.smithi018.stdout:3179 writesame 0x19e504 thru 0x1a4cc9 data_size 0x25(0x67c6 bytes) 2024-09-22T01:36:08.381 INFO:teuthology.orchestra.run.smithi018.stdout:3181 trunc from 0xed374ca to 0xa38575d 2024-09-22T01:36:08.395 INFO:teuthology.orchestra.run.smithi018.stdout:3183 read 0x66b69cc thru 0x66bbb4f (0x5184 bytes) 2024-09-22T01:36:08.395 INFO:teuthology.orchestra.run.smithi018.stdout:3184 writesame 0x9d900bb thru 0x9d9dec0 data_size 0x3(0xde06 bytes) 2024-09-22T01:36:08.400 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:08.409 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.409 INFO:teuthology.orchestra.run.smithi018.stdout:3186 write 0x4bfa6b1 thru 0x4c08e5f (0xe7af bytes) 2024-09-22T01:36:08.414 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.418 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:08.420 INFO:teuthology.orchestra.run.smithi018.stdout:3188 trunc from 0xa38575d to 0xe9d6f99 2024-09-22T01:36:08.427 INFO:teuthology.orchestra.run.smithi018.stdout:3189 write 0x80af7f0 thru 0x80b95e7 (0x9df8 bytes) 2024-09-22T01:36:08.432 INFO:teuthology.orchestra.run.smithi018.stdout:3190 write 0x1c8889e thru 0x1c926a9 (0x9e0c bytes) 2024-09-22T01:36:08.436 INFO:teuthology.orchestra.run.smithi018.stdout:3191 write 0x26236f6 thru 0x2627840 (0x414b bytes) 2024-09-22T01:36:08.438 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:08.438 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:08.440 INFO:teuthology.orchestra.run.smithi018.stdout:3192 punch from 0x60d9efd to 0x60dcc55, (0x2d58 bytes) 2024-09-22T01:36:08.440 INFO:teuthology.orchestra.run.smithi018.stdout:3193 write 0x472351a thru 0x4731e8a (0xe971 bytes) 2024-09-22T01:36:08.442 INFO:teuthology.orchestra.run.smithi018.stdout:3194 punch from 0xc10e682 to 0xc11d81d, (0xf19b bytes) 2024-09-22T01:36:08.442 INFO:teuthology.orchestra.run.smithi018.stdout:3195 read 0x976ad7 thru 0x977eff (0x1429 bytes) 2024-09-22T01:36:08.456 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:08.456 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:08.456 INFO:teuthology.orchestra.run.smithi018.stdout:3196 trunc from 0xe9d6f99 to 0x540c11a 2024-09-22T01:36:08.463 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:08.457+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:08.470 INFO:teuthology.orchestra.run.smithi018.stdout:3197 read 0x496e8f thru 0x49c9ed (0x5b5f bytes) 2024-09-22T01:36:08.471 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.471 INFO:teuthology.orchestra.run.smithi018.stdout:3202 writesame 0x329131b thru 0x32967a6 data_size 0xe(0x548c bytes) 2024-09-22T01:36:08.476 INFO:teuthology.orchestra.run.smithi018.stdout:3203 read 0x1cced69 thru 0x1cd5526 (0x67be bytes) 2024-09-22T01:36:08.476 INFO:teuthology.orchestra.run.smithi018.stdout:3204 read 0x9b8a09 thru 0x9c210b (0x9703 bytes) 2024-09-22T01:36:08.477 INFO:teuthology.orchestra.run.smithi018.stdout:3205 punch from 0x21558dc to 0x215ced2, (0x75f6 bytes) 2024-09-22T01:36:08.477 INFO:teuthology.orchestra.run.smithi018.stdout:3207 read 0xefa1b3 thru 0xf04b64 (0xa9b2 bytes) 2024-09-22T01:36:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:3209 read 0x2642761 thru 0x264c313 (0x9bb3 bytes) 2024-09-22T01:36:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:3210 read 0x4c00065 thru 0x4c01d78 (0x1d14 bytes) 2024-09-22T01:36:08.478 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:08.479 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:08.479 INFO:teuthology.orchestra.run.smithi018.stdout:3212 read 0x4fc85d1 thru 0x4fd3528 (0xaf58 bytes) 2024-09-22T01:36:08.479 INFO:teuthology.orchestra.run.smithi018.stdout:3215 read 0x261b81b thru 0x261c982 (0x1168 bytes) 2024-09-22T01:36:08.486 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:08.486 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:08.487 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:08.487 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:08.499 INFO:teuthology.orchestra.run.smithi018.stdout:3217 write 0xbcf4e65 thru 0xbcf5521 (0x6bd bytes) 2024-09-22T01:36:08.500 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:08.501 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:08.502 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:08.503 INFO:teuthology.orchestra.run.smithi018.stdout:3218 read 0x16ba5e1 thru 0x16c3e0a (0x982a bytes) 2024-09-22T01:36:08.503 INFO:teuthology.orchestra.run.smithi018.stdout:3220 read 0xd8d1ba thru 0xd92d26 (0x5b6d bytes) 2024-09-22T01:36:08.504 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.504 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.505 INFO:teuthology.orchestra.run.smithi018.stdout:3224 trunc from 0xbcf5522 to 0xc818811 2024-09-22T01:36:08.514 INFO:teuthology.orchestra.run.smithi018.stdout:3225 punch from 0x6d23d53 to 0x6d2de62, (0xa10f bytes) 2024-09-22T01:36:08.522 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:08.523 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:08.523 INFO:teuthology.orchestra.run.smithi018.stdout:3226 writesame 0xd0b4c5b thru 0xd0bbd50 data_size 0x2(0x70f6 bytes) 2024-09-22T01:36:08.523 INFO:teuthology.orchestra.run.smithi018.stdout:3228 read 0xcd1d396 thru 0xcd2801e (0xac89 bytes) 2024-09-22T01:36:08.523 INFO:teuthology.orchestra.run.smithi018.stdout:3229 read 0x9dbf61d thru 0x9dcc641 (0xd025 bytes) 2024-09-22T01:36:08.523 INFO:teuthology.orchestra.run.smithi018.stdout:3230 write 0x4f3c2d3 thru 0x4f4a8ee (0xe61c bytes) 2024-09-22T01:36:08.527 INFO:teuthology.orchestra.run.smithi018.stdout:3232 write 0xa52a1f4 thru 0xa5374d4 (0xd2e1 bytes) 2024-09-22T01:36:08.531 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.532 INFO:teuthology.orchestra.run.smithi018.stdout:3234 write 0x23ca133 thru 0x23cd4f2 (0x33c0 bytes) 2024-09-22T01:36:08.533 INFO:teuthology.orchestra.run.smithi018.stdout:3235 writesame 0xf0fa11 thru 0xf10996 data_size 0x1(0xf86 bytes) 2024-09-22T01:36:08.536 INFO:teuthology.orchestra.run.smithi018.stdout:3236 write 0x37ef8d2 thru 0x37f0a75 (0x11a4 bytes) 2024-09-22T01:36:08.541 INFO:teuthology.orchestra.run.smithi018.stdout:3237 read 0x1141335 thru 0x1150dee (0xfaba bytes) 2024-09-22T01:36:08.545 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:08.551 INFO:teuthology.orchestra.run.smithi018.stdout:3238 writesame 0xe5005bc thru 0xe510024 data_size 0x1(0xfa69 bytes) 2024-09-22T01:36:08.551 INFO:teuthology.orchestra.run.smithi018.stdout:3241 write 0x2348702 thru 0x234c479 (0x3d78 bytes) 2024-09-22T01:36:08.555 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.555 INFO:teuthology.orchestra.run.smithi018.stdout:3243 punch from 0xc39ad8d to 0xc3a3f1d, (0x9190 bytes) 2024-09-22T01:36:08.557 INFO:teuthology.orchestra.run.smithi018.stdout:3245 trunc from 0xe510025 to 0xd27a3e9 2024-09-22T01:36:08.563 INFO:teuthology.orchestra.run.smithi018.stdout:3246 write 0x4839ffa thru 0x4845436 (0xb43d bytes) 2024-09-22T01:36:08.563 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:08.561+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:08.567 INFO:teuthology.orchestra.run.smithi018.stdout:3247 writesame 0xb4faf81 thru 0xb4fbb2d data_size 0x7(0xbad bytes) 2024-09-22T01:36:08.570 INFO:teuthology.orchestra.run.smithi018.stdout:3248 write 0x6213ad9 thru 0x621f650 (0xbb78 bytes) 2024-09-22T01:36:08.573 INFO:teuthology.orchestra.run.smithi018.stdout:3250 write 0x5c2a44d thru 0x5c2ed56 (0x490a bytes) 2024-09-22T01:36:08.577 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.577 INFO:teuthology.orchestra.run.smithi018.stdout:3254 read 0xe4b31c thru 0xe51e93 (0x6b78 bytes) 2024-09-22T01:36:08.578 INFO:teuthology.orchestra.run.smithi018.stdout:3256 read 0x7517e9e thru 0x7523067 (0xb1ca bytes) 2024-09-22T01:36:08.578 INFO:teuthology.orchestra.run.smithi018.stdout:3257 read 0xc21534b thru 0xc21d7de (0x8494 bytes) 2024-09-22T01:36:08.578 INFO:teuthology.orchestra.run.smithi018.stdout:3258 punch from 0x874c10d to 0x875acbb, (0xebae bytes) 2024-09-22T01:36:08.578 INFO:teuthology.orchestra.run.smithi018.stdout:3260 read 0xa304d74 thru 0xa3071a6 (0x2433 bytes) 2024-09-22T01:36:08.579 INFO:teuthology.orchestra.run.smithi018.stdout:3261 read 0x8c9c6a0 thru 0x8ca535a (0x8cbb bytes) 2024-09-22T01:36:08.579 INFO:teuthology.orchestra.run.smithi018.stdout:3262 read 0x1120a11 thru 0x1120ae0 (0xd0 bytes) 2024-09-22T01:36:08.579 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:08.580 INFO:teuthology.orchestra.run.smithi018.stdout:3265 write 0x15f0528 thru 0x15facf8 (0xa7d1 bytes) 2024-09-22T01:36:08.583 INFO:teuthology.orchestra.run.smithi018.stdout:3266 read 0x1437f00 thru 0x1445108 (0xd209 bytes) 2024-09-22T01:36:08.584 INFO:teuthology.orchestra.run.smithi018.stdout:3268 read 0x5606c9f thru 0x560b860 (0x4bc2 bytes) 2024-09-22T01:36:08.614 INFO:teuthology.orchestra.run.smithi018.stdout:3269 trunc from 0xd27a3e9 to 0xb06133 2024-09-22T01:36:08.619 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:36:08.623 INFO:teuthology.orchestra.run.smithi018.stderr:marked in osd.2. 2024-09-22T01:36:08.637 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:08.637 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:08.647 INFO:tasks.thrashosds.thrasher:Added osd 2 2024-09-22T01:36:08.651 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:08.698 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:08.695+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:08.766 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:08.763+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:08.771 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:08.771 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:08.785 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:08.874 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:08.871+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:08.951 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:08.951 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:08.966 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:08.967 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:08.961+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:09.068 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:09.065+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:09.132 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:09.132 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:09.146 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:09.194 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:09.191+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:09.268 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:09.268 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:09.269 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:09.265+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:09.282 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:09.370 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:09.365+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:09.450 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:09.450 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:09.464 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:09.471 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:09.469+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:09.572 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:09.569+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:09.589 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:09.589 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:09.603 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:09.673 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:09.669+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:09.739 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:09.739 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:09.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:09.796 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:09.793+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:09.875 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:09.871+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:09.922 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:09.923 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:09.937 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:09.984 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:09.981+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:10.057 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:10.057 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:10.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:10.116 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:10.113+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:10.178 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:10.175+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:10.241 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:10.241 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:10.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:10.304 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:10.301+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:10.379 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:10.379 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:10.380 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:10.377+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:10.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:10.481 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:10.475+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:10.556 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:10.556 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:10.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:10.571 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:10.613 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:10.609+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:10.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:36:10.683 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:10.679+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:10.731 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:10.739 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:10.739 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:10.749 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:10.749 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:10.756 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:10.767 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:10.767 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:10.784 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:10.779+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:10.785 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:10.785 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:10.808 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:10.808 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:10.829 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:10.829 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:10.850 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:10.851 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:10.871 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:10.871 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:10.878 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:10.878 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:10.878 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:10.884 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:10.881+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:10.895 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:10.985 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:10.981+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:11.059 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:11.059 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_repop(client.4367.0:342 3.9 e26/22 3:94f7da1d:::rbd_data.110fc6985e86.0000000000000009:head v 26'4, mlcod=26'2)", 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 77.056865845999994, 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0049789220000000002, 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998621+0000", 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:53.998623+0000", 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.917e-06 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001896+0000", 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0032733710000000002 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001928+0000", 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1084000000000003e-05 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.001942+0000", 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4676e-05 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002074+0000", 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013162300000000001 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.002111+0000", 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7409e-05 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003521+0000", 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001409963 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.003600+0000", 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8879000000000002e-05 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:457 3.0 3:06e95cd1:::rbd_data.110fc6985e86.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.727216193000004, 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044600389999999998, 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 457 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328271+0000", 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328274+0000", 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2160000000000002e-06 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328291+0000", 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6684000000000002e-05 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328330+0000", 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9606e-05 2024-09-22T01:36:11.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328356+0000", 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5743000000000001e-05 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328571+0000", 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021475199999999999 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328798+0000", 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022722500000000001 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.329169+0000", 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00037053699999999999 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.331686+0000", 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00251702 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332444+0000", 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00075864499999999996 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332612+0000", 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000167842 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332731+0000", 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118769 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:458 3.0 3:070460b3:::rbd_data.110fc6985e86.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-22T01:36:11.069 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.727072688000007, 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004924299, 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 458 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328414+0000", 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328416+0000", 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4699999999999999e-06 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328425+0000", 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2299999999999997e-06 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328458+0000", 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3207000000000002e-05 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.328477+0000", 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8369999999999999e-05 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330151+0000", 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016743999999999999 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330515+0000", 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000364254 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.330844+0000", 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00032882700000000001 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:11.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.332188+0000", 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001343997 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333188+0000", 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00099998499999999989 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333270+0000", 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1780000000000006e-05 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:34:54.333339+0000", 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8779e-05 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12043 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 65.951753416000003, 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062348799999999999, 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.075 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12043 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103734+0000", 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.103737+0000", 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.563e-06 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104658+0000", 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00092131799999999996 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104713+0000", 2024-09-22T01:36:11.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4345000000000002e-05 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104736+0000", 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3315e-05 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104848+0000", 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112179 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105024+0000", 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000175181 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.105256+0000", 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00023272700000000001 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.108154+0000", 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002897667 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109848+0000", 2024-09-22T01:36:11.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016945440000000001 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109917+0000", 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8486999999999997e-05 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109968+0000", 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1554000000000001e-05 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.080 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12044 3.4 3:24258e85:::rbd_data.110f42c29252.0000000000000005:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 65.950687720999994, 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0065101619999999999, 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12044 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104799+0000", 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104801+0000", 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0229999999999999e-06 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104810+0000", 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8799999999999997e-06 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104836+0000", 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5422000000000002e-05 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.104852+0000", 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6653000000000001e-05 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.106895+0000", 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0020430230000000001 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107002+0000", 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010717699999999999 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.107202+0000", 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000199221 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.109298+0000", 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002096634 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111206+0000", 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001907623 2024-09-22T01:36:11.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111261+0000", 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5126e-05 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.111309+0000", 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8380000000000001e-05 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18530 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.085 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 65.642655231000006, 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0047195830000000003, 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18530 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412832+0000", 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.412834+0000", 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8199999999999999e-06 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413139+0000", 2024-09-22T01:36:11.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00030565099999999999 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413165+0000", 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5837e-05 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413176+0000", 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1236000000000001e-05 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413261+0000", 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4645e-05 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413450+0000", 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018897599999999999 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413701+0000", 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00025127 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415932+0000", 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.002230461 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:11.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417442+0000", 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0015099849999999999 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417501+0000", 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9812999999999998e-05 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.417551+0000", 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9889000000000003e-05 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:18531 3.0 3:07cc02fa:::rbd_data.110f42c29252.0000000000000016:head [write 0~0] snapc 9=[9] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 65.642280936999995, 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0055324989999999998, 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 18531 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413206+0000", 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413207+0000", 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9299999999999997e-07 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413211+0000", 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.811e-06 2024-09-22T01:36:11.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413220+0000", 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9500000000000007e-06 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.413226+0000", 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7880000000000001e-06 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.415974+0000", 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0027473279999999998 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416066+0000", 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2019000000000001e-05 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 1", 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.416238+0000", 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017202799999999999 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418146+0000", 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0019079100000000001 2024-09-22T01:36:11.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418644+0000", 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00049864899999999999 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418696+0000", 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1483999999999997e-05 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.418739+0000", 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2839000000000001e-05 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.095 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54465 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 0~65536] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.234421089000001, 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0050651180000000004, 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54465 2024-09-22T01:36:11.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821066+0000", 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821068+0000", 2024-09-22T01:36:11.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821078+0000", 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0164e-05 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821107+0000", 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8985000000000001e-05 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821121+0000", 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.307e-05 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821387+0000", 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00026639200000000001 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821395+0000", 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3040000000000005e-06 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825493+0000", 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040977399999999999 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.825630+0000", 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136971 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826131+0000", 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00050110499999999995 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54466 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1638400~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.234334560000001, 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052214690000000003, 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54466 2024-09-22T01:36:11.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821152+0000", 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821153+0000", 2024-09-22T01:36:11.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7499999999999999e-07 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821158+0000", 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3800000000000004e-06 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821169+0000", 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1124000000000001e-05 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821177+0000", 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1040000000000007e-06 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821467+0000", 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029025299999999997 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821474+0000", 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.472e-06 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826170+0000", 2024-09-22T01:36:11.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0046964709999999998 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826261+0000", 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0708e-05 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826374+0000", 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113182 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.105 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54467 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3342336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.234298228999997, 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054437169999999998, 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54467 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821189+0000", 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1900000000000002e-07 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821193+0000", 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4130000000000002e-06 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821202+0000", 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3780000000000007e-06 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821209+0000", 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8800000000000002e-06 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821504+0000", 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00029444600000000002 2024-09-22T01:36:11.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821509+0000", 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5500000000000002e-06 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826415+0000", 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004905492 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826527+0000", 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000112144 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826633+0000", 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000105795 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54510 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.234268297, 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057311339999999997, 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54510 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821219+0000", 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821245+0000", 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5774000000000001e-05 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821257+0000", 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2045000000000001e-05 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821265+0000", 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7239999999999992e-06 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821538+0000", 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00027359599999999997 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821544+0000", 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7450000000000001e-06 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826699+0000", 2024-09-22T01:36:11.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0051546229999999997 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826815+0000", 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011646600000000001 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826950+0000", 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013463700000000001 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54511 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.234209825000001, 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058910409999999996, 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54511 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821277+0000", 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821278+0000", 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821282+0000", 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.019e-06 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821291+0000", 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3039999999999994e-06 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821298+0000", 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.041e-06 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821573+0000", 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000274283 2024-09-22T01:36:11.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821578+0000", 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0679999999999996e-06 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827015+0000", 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054370670000000003 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827070+0000", 2024-09-22T01:36:11.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5773999999999998e-05 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827168+0000", 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7814999999999998e-05 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54512 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3604480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.234178923000002, 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0061320309999999996, 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54512 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821308+0000", 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821309+0000", 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.51e-07 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821312+0000", 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0419999999999998e-06 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821320+0000", 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.422e-06 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821332+0000", 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1951e-05 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821937+0000", 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00060522400000000002 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821944+0000", 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.404e-06 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827219+0000", 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0052754389999999998 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827317+0000", 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7536999999999998e-05 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827440+0000", 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123461 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54555 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 524288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.233709892999997, 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0059477050000000002, 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54555 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821777+0000", 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821778+0000", 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0500000000000002e-07 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821783+0000", 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.135e-06 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821798+0000", 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4688000000000001e-05 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821808+0000", 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6690000000000001e-06 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821977+0000", 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169541 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821982+0000", 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.164e-06 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827481+0000", 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0054988470000000003 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827582+0000", 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100554 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827725+0000", 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014320199999999999 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54556 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:36:11.128 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.233663073000002, 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00620654, 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54556 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821824+0000", 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821825+0000", 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821828+0000", 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8809999999999998e-06 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821839+0000", 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.027e-05 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821846+0000", 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5619999999999998e-06 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822011+0000", 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016490100000000001 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822017+0000", 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6099999999999997e-06 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827802+0000", 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0057848509999999997 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.827892+0000", 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0880999999999999e-05 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828030+0000", 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013803200000000001 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54557 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.233628779999997, 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064190469999999998, 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54557 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821858+0000", 2024-09-22T01:36:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821859+0000", 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.99e-07 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821863+0000", 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6569999999999999e-06 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821871+0000", 2024-09-22T01:36:11.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9719999999999998e-06 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.821878+0000", 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.917e-06 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822045+0000", 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016703000000000001 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822051+0000", 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.626e-06 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828069+0000", 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060179919999999998 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828161+0000", 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1731999999999995e-05 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828277+0000", 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011652199999999999 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54600 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 786432~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.233193206999999, 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0062310530000000003, 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.138 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54600 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822294+0000", 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822295+0000", 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.19e-06 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822301+0000", 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5010000000000004e-06 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822320+0000", 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9724e-05 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822330+0000", 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3899999999999999e-06 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822464+0000", 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013444100000000001 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822470+0000", 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3690000000000003e-06 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828314+0000", 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0058434719999999997 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828405+0000", 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1166000000000001e-05 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828525+0000", 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001198 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.142 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54601 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.233135589, 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0064068470000000002, 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54601 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.143 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822351+0000", 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822352+0000", 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:36:11.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822356+0000", 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6519999999999999e-06 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822366+0000", 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0686000000000001e-05 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822374+0000", 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4200000000000001e-06 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822500+0000", 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012665800000000001 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822505+0000", 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.938e-06 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828560+0000", 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0060544969999999998 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828651+0000", 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0758000000000001e-05 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828758+0000", 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010760900000000001 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54602 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4194304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.233101197000003, 2024-09-22T01:36:11.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0066069279999999998, 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54602 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822386+0000", 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6599999999999996e-07 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822390+0000", 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.377e-06 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822399+0000", 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822406+0000", 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822534+0000", 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012761900000000001 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting_for_map not empty", 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.822539+0000", 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3639999999999998e-06 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828797+0000", 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.006257365 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828885+0000", 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8818000000000002e-05 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.828993+0000", 2024-09-22T01:36:11.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000107336 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:54688 3.4 3:24ebdab8:::rbd_data.110fd805e3ed.000000000000000e:c [sparse-read 4718592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 56.229220312000002, 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0044478340000000003, 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 54688 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826267+0000", 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826268+0000", 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-06 2024-09-22T01:36:11.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826274+0000", 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826294+0000", 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0211999999999999e-05 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.826310+0000", 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6039999999999999e-05 2024-09-22T01:36:11.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830569+0000", 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.004258632 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830641+0000", 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2064000000000007e-05 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:14.830715+0000", 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3483000000000001e-05 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.155 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.156 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.156 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:11.157 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:11.157 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:11.153+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:11.193 INFO:teuthology.orchestra.run.smithi018.stdout:3270 punch from 0x2c91b7 to 0x2ccf6e, (0x3db7 bytes) 2024-09-22T01:36:11.214 INFO:teuthology.orchestra.run.smithi018.stdout:3271 trunc from 0xb06133 to 0xbca7dfb 2024-09-22T01:36:11.227 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:11.244 INFO:teuthology.orchestra.run.smithi018.stdout:3273 write 0xdb6f481 thru 0xdb7b7aa (0xc32a bytes) 2024-09-22T01:36:11.251 INFO:teuthology.orchestra.run.smithi018.stdout:3274 write 0x9e111b7 thru 0x9e159a7 (0x47f1 bytes) 2024-09-22T01:36:11.258 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:11.253+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:11.258 INFO:teuthology.orchestra.run.smithi018.stdout:3275 punch from 0x4c19bdd to 0x4c22bf6, (0x9019 bytes) 2024-09-22T01:36:11.260 INFO:teuthology.orchestra.run.smithi018.stdout:3276 trunc from 0xdb7b7ab to 0xc5d5dde 2024-09-22T01:36:11.279 INFO:teuthology.orchestra.run.smithi018.stdout:3277 read 0x6499978 thru 0x649b4c3 (0x1b4c bytes) 2024-09-22T01:36:11.279 INFO:teuthology.orchestra.run.smithi018.stdout:3278 writesame 0x6524993 thru 0x652a112 data_size 0x32(0x5780 bytes) 2024-09-22T01:36:11.284 INFO:teuthology.orchestra.run.smithi018.stdout:3280 write 0xa7cfdca thru 0xa7d6415 (0x664c bytes) 2024-09-22T01:36:11.307 INFO:teuthology.orchestra.run.smithi018.stdout:3281 trunc from 0xc5d5dde to 0x1c9752a 2024-09-22T01:36:11.327 INFO:teuthology.orchestra.run.smithi018.stdout:3282 read 0x17ead thru 0x26949 (0xea9d bytes) 2024-09-22T01:36:11.328 INFO:teuthology.orchestra.run.smithi018.stdout:3283 write 0x16b69f thru 0x16bcf0 (0x652 bytes) 2024-09-22T01:36:11.338 INFO:teuthology.orchestra.run.smithi018.stdout:3284 punch from 0x15b73ee to 0x15c1a45, (0xa657 bytes) 2024-09-22T01:36:11.338 INFO:teuthology.orchestra.run.smithi018.stdout:3286 punch from 0x1a1ffc9 to 0x1a276c8, (0x76ff bytes) 2024-09-22T01:36:11.342 INFO:teuthology.orchestra.run.smithi018.stdout:3287 trunc from 0x1c9752a to 0x3987755 2024-09-22T01:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:11.350 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:11.353 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:11.353 INFO:teuthology.orchestra.run.smithi018.stdout:3289 read 0x16747b6 thru 0x167689b (0x20e6 bytes) 2024-09-22T01:36:11.353 INFO:teuthology.orchestra.run.smithi018.stdout:3291 punch from 0x1d47486 to 0x1d48372, (0xeec bytes) 2024-09-22T01:36:11.358 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:11.353+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:11.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:11.379 INFO:teuthology.orchestra.run.smithi018.stdout:3292 writesame 0xb592835 thru 0xb59d684 data_size 0x8(0xae50 bytes) 2024-09-22T01:36:11.379 INFO:teuthology.orchestra.run.smithi018.stdout:3293 write 0xb86484 thru 0xb86743 (0x2c0 bytes) 2024-09-22T01:36:11.382 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:11.382 INFO:teuthology.orchestra.run.smithi018.stdout:3295 read 0x33997f7 thru 0x33a149e (0x7ca8 bytes) 2024-09-22T01:36:11.382 INFO:teuthology.orchestra.run.smithi018.stdout:3296 read 0x413125a thru 0x41399ac (0x8753 bytes) 2024-09-22T01:36:11.382 INFO:teuthology.orchestra.run.smithi018.stdout:3297 write 0x2966311 thru 0x296e9bd (0x86ad bytes) 2024-09-22T01:36:11.388 INFO:teuthology.orchestra.run.smithi018.stdout:3298 punch from 0x92e2e23 to 0x92f2705, (0xf8e2 bytes) 2024-09-22T01:36:11.388 INFO:teuthology.orchestra.run.smithi018.stdout:3299 read 0x6ca451f thru 0x6cb1791 (0xd273 bytes) 2024-09-22T01:36:11.388 INFO:teuthology.orchestra.run.smithi018.stdout:3304 writesame 0x5d21156 thru 0x5d2dff0 data_size 0x1(0xce9b bytes) 2024-09-22T01:36:11.421 INFO:teuthology.orchestra.run.smithi018.stdout:3305 punch from 0x2d9190 to 0x2e81a0, (0xf010 bytes) 2024-09-22T01:36:11.421 INFO:teuthology.orchestra.run.smithi018.stdout:3306 punch from 0x91202ab to 0x9128e71, (0x8bc6 bytes) 2024-09-22T01:36:11.421 INFO:teuthology.orchestra.run.smithi018.stdout:3310 write 0x58f7ad8 thru 0x58f8d9a (0x12c3 bytes) 2024-09-22T01:36:11.427 INFO:teuthology.orchestra.run.smithi018.stdout:3311 read 0x2da9960 thru 0x2dac8d3 (0x2f74 bytes) 2024-09-22T01:36:11.427 INFO:teuthology.orchestra.run.smithi018.stdout:3312 punch from 0xb0aa880 to 0xb0b6427, (0xbba7 bytes) 2024-09-22T01:36:11.427 INFO:teuthology.orchestra.run.smithi018.stdout:3313 read 0x37e5c97 thru 0x37e778f (0x1af9 bytes) 2024-09-22T01:36:11.439 INFO:teuthology.orchestra.run.smithi018.stdout:3317 writesame 0xc0f4624 thru 0xc103a09 data_size 0x1(0xf3e6 bytes) 2024-09-22T01:36:11.439 INFO:teuthology.orchestra.run.smithi018.stdout:3319 read 0x414260c thru 0x4147476 (0x4e6b bytes) 2024-09-22T01:36:11.440 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:11.440 INFO:teuthology.orchestra.run.smithi018.stdout:3322 read 0x8498ee thru 0x84d6fa (0x3e0d bytes) 2024-09-22T01:36:11.441 INFO:teuthology.orchestra.run.smithi018.stdout:3323 punch from 0x14d22f3 to 0x14d8bba, (0x68c7 bytes) 2024-09-22T01:36:11.441 INFO:teuthology.orchestra.run.smithi018.stdout:3324 read 0x92d5bb2 thru 0x92daaad (0x4efc bytes) 2024-09-22T01:36:11.441 INFO:teuthology.orchestra.run.smithi018.stdout:3326 read 0x28d4d34 thru 0x28e12cf (0xc59c bytes) 2024-09-22T01:36:11.441 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:11.441 INFO:teuthology.orchestra.run.smithi018.stdout:3328 writesame 0x89f6552 thru 0x8a04b48 data_size 0x1(0xe5f7 bytes) 2024-09-22T01:36:11.441 INFO:teuthology.orchestra.run.smithi018.stdout:3329 write 0x5382fb0 thru 0x538e390 (0xb3e1 bytes) 2024-09-22T01:36:11.448 INFO:teuthology.orchestra.run.smithi018.stdout:3333 trunc from 0xc103a0a to 0xb4ea101 2024-09-22T01:36:11.460 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:11.455+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout:3335 punch from 0x5f964fe to 0x5f9a075, (0x3b77 bytes) 2024-09-22T01:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout:3336 read 0x8eb3657 thru 0x8ebe1dd (0xab87 bytes) 2024-09-22T01:36:11.460 INFO:teuthology.orchestra.run.smithi018.stdout:3337 write 0x2d5dbb1 thru 0x2d63ccd (0x611d bytes) 2024-09-22T01:36:11.476 INFO:teuthology.orchestra.run.smithi018.stdout:3338 trunc from 0xb4ea101 to 0x5280ec5 2024-09-22T01:36:11.499 INFO:teuthology.orchestra.run.smithi018.stdout:3342 writesame 0x48c6878 thru 0x48c9662 data_size 0x1(0x2deb bytes) 2024-09-22T01:36:11.511 INFO:teuthology.orchestra.run.smithi018.stdout:3344 punch from 0xc2fe6a to 0xc322ff, (0x2495 bytes) 2024-09-22T01:36:11.511 INFO:teuthology.orchestra.run.smithi018.stdout:3345 punch from 0x3eb600d to 0x3ebb31d, (0x5310 bytes) 2024-09-22T01:36:11.511 INFO:teuthology.orchestra.run.smithi018.stdout:3347 read 0xec3ac8 thru 0xed0256 (0xc78f bytes) 2024-09-22T01:36:11.511 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:11.511 INFO:teuthology.orchestra.run.smithi018.stdout:3351 read 0x1caab2d thru 0x1caeb84 (0x4058 bytes) 2024-09-22T01:36:11.511 INFO:teuthology.orchestra.run.smithi018.stdout:3354 trunc from 0x5280ec5 to 0x4e9fc15 2024-09-22T01:36:11.525 INFO:teuthology.orchestra.run.smithi018.stdout:3355 punch from 0x1646950 to 0x16473b0, (0xa60 bytes) 2024-09-22T01:36:11.525 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:11.525 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:11.525 INFO:teuthology.orchestra.run.smithi018.stdout:3360 writesame 0x867233 thru 0x86cad0 data_size 0x39(0x589e bytes) 2024-09-22T01:36:11.525 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:11.526 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:11.526 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:11.526 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:11.526 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:11.531 INFO:teuthology.orchestra.run.smithi018.stdout:3361 trunc from 0x4e9fc15 to 0x2226432 2024-09-22T01:36:11.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:11.560 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:11.555+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:11.573 INFO:teuthology.orchestra.run.smithi018.stdout:3364 write 0x9c85315 thru 0x9c91bdd (0xc8c9 bytes) 2024-09-22T01:36:11.592 INFO:teuthology.orchestra.run.smithi018.stdout:3366 write 0xa6775d9 thru 0xa67f695 (0x80bd bytes) 2024-09-22T01:36:11.615 INFO:teuthology.orchestra.run.smithi018.stdout:3369 writesame 0xea0e64d thru 0xea190ff data_size 0x1(0xaab3 bytes) 2024-09-22T01:36:11.615 INFO:teuthology.orchestra.run.smithi018.stdout:3370 write 0x21a3dc6 thru 0x21a9eaf (0x60ea bytes) 2024-09-22T01:36:11.620 INFO:teuthology.orchestra.run.smithi018.stdout:3372 read 0x8005391 thru 0x800c0e1 (0x6d51 bytes) 2024-09-22T01:36:11.620 INFO:teuthology.orchestra.run.smithi018.stdout:3375 read 0x6859bc8 thru 0x68619dc (0x7e15 bytes) 2024-09-22T01:36:11.620 INFO:teuthology.orchestra.run.smithi018.stdout:3376 write 0x28902b5 thru 0x289079a (0x4e6 bytes) 2024-09-22T01:36:11.644 INFO:teuthology.orchestra.run.smithi018.stdout:3378 trunc from 0xea19100 to 0x1014e41 2024-09-22T01:36:11.650 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:36:11.661 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:11.657+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:11.710 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:11.710 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:11.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:11.710 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.583141385000005, 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.711 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:36:11.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.714 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.583115649000007, 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.715 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:36:11.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.583089866999998, 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:36:11.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:36:11.722 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.583044947999994, 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.723 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:36:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.583012792000005, 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.727 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582985059999999, 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.731 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:36:11.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:36:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582949236000005, 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.735 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.738 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582913091999998, 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.739 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:11.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582876886999998, 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:11.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:36:11.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:36:11.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:36:11.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:36:11.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:36:11.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:36:11.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:36:11.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:36:11.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:36:11.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:36:11.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:36:11.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:36:11.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.749 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.750 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.750 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:11.750 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582849534999994, 2024-09-22T01:36:11.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:36:11.750 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.751 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.751 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.751 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:36:11.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.754 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.755 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.755 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:11.755 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582812457000003, 2024-09-22T01:36:11.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:36:11.755 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:36:11.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:36:11.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582788919999999, 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:36:11.759 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:11.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:36:11.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12683 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.763 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582298921000003, 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058771337, 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12683 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126558+0000", 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6399999999999998e-07 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126559+0000", 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8360000000000001e-06 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126567+0000", 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4189999999999996e-06 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126578+0000", 2024-09-22T01:36:11.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1439e-05 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185320+0000", 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058741987000000002 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185329+0000", 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2919999999999996e-06 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582241719999999, 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.768 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:36:11.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:36:11.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582213963000001, 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:36:11.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:36:11.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:36:11.775 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582191897000001, 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.776 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.582161737000007, 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:36:11.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:36:11.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.581741246999997, 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:36:11.784 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:36:11.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:36:11.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:11.788 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.581715466000006, 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:11.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 66.581694197999994, 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.793 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:36:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:11.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:36:11.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:36:11.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.797 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:11.797 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:11.797 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:11.798 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:11.799 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:11.795+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:11.900 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:11.895+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:11.932 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:11.932 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:11.932 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:11.932 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:11.946 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:12.034 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:12.031+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:12.102 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:12.097+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:12.107 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:12.107 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:12.107 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:12.107 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:12.108 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:12.121 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:12.202 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:12.197+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:12.291 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:12.291 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:12.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:12.291 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:12.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.291 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19458 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1417216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.83006503, 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.056428816, 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19458 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7700000000000005e-07 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457940+0000", 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4329999999999998e-06 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457947+0000", 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9029999999999998e-06 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457953+0000", 2024-09-22T01:36:12.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8900000000000004e-06 2024-09-22T01:36:12.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512121+0000", 2024-09-22T01:36:12.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054168717999999998 2024-09-22T01:36:12.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512221+0000", 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9279999999999998e-05 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514366+0000", 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002145115 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19464 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1949696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.829553808, 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055080249999999997, 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19464 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459822+0000", 2024-09-22T01:36:12.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013738540000000001 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459827+0000", 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1630000000000004e-06 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459840+0000", 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2775000000000001e-05 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459847+0000", 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8360000000000003e-06 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513362+0000", 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053515442000000003 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513441+0000", 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8708000000000006e-05 2024-09-22T01:36:12.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513528+0000", 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7472000000000005e-05 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19484 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1437696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:12.301 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.828012414, 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055077586999999997, 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19484 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7e-07 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459993+0000", 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8380000000000002e-06 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460000+0000", 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460005+0000", 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3680000000000001e-06 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514879+0000", 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054874038999999999 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514965+0000", 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5574000000000004e-05 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515067+0000", 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010228100000000001 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.305 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.306 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19485 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1796096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.306 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:12.306 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.827989618000004, 2024-09-22T01:36:12.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055255209, 2024-09-22T01:36:12.306 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.306 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.306 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.306 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19485 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460300+0000", 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028730299999999998 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460304+0000", 2024-09-22T01:36:12.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:12.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460314+0000", 2024-09-22T01:36:12.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7119999999999995e-06 2024-09-22T01:36:12.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460321+0000", 2024-09-22T01:36:12.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6710000000000002e-06 2024-09-22T01:36:12.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515101+0000", 2024-09-22T01:36:12.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054780263000000003 2024-09-22T01:36:12.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515180+0000", 2024-09-22T01:36:12.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9074999999999998e-05 2024-09-22T01:36:12.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515268+0000", 2024-09-22T01:36:12.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7416999999999993e-05 2024-09-22T01:36:12.312 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.312 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.312 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.312 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19486 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1970176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.312 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:12.312 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.827637736, 2024-09-22T01:36:12.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055098253, 2024-09-22T01:36:12.312 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.313 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.313 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.313 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.313 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.313 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.313 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19486 2024-09-22T01:36:12.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.313 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:12.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:12.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460365+0000", 2024-09-22T01:36:12.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9599999999999999e-07 2024-09-22T01:36:12.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460369+0000", 2024-09-22T01:36:12.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:12.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460382+0000", 2024-09-22T01:36:12.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3478999999999999e-05 2024-09-22T01:36:12.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460390+0000", 2024-09-22T01:36:12.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5340000000000002e-06 2024-09-22T01:36:12.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515297+0000", 2024-09-22T01:36:12.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054907665000000001 2024-09-22T01:36:12.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515373+0000", 2024-09-22T01:36:12.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5721000000000002e-05 2024-09-22T01:36:12.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515463+0000", 2024-09-22T01:36:12.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9653000000000004e-05 2024-09-22T01:36:12.318 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.319 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.319 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.319 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19487 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1980416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.319 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:12.319 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.827589363000001, 2024-09-22T01:36:12.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055238787999999997, 2024-09-22T01:36:12.320 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.320 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.320 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.320 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.320 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.320 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.320 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19487 2024-09-22T01:36:12.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.320 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:12.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:12.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460764+0000", 2024-09-22T01:36:12.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035164799999999998 2024-09-22T01:36:12.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460769+0000", 2024-09-22T01:36:12.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.169e-06 2024-09-22T01:36:12.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460779+0000", 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3239999999999992e-06 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460786+0000", 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0500000000000003e-06 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515497+0000", 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054711098 2024-09-22T01:36:12.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515576+0000", 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9085999999999995e-05 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515651+0000", 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5413000000000005e-05 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.324 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19501 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1089536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.827182659000002, 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055065846000000002, 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19501 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460820+0000", 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000005e-07 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460823+0000", 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9459999999999998e-06 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460831+0000", 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6839999999999996e-06 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460837+0000", 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9479999999999996e-06 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515696+0000", 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054859053999999997 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515783+0000", 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7705000000000001e-05 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515885+0000", 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101908 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.328 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19502 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1263616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.827156501000005, 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055304409999999998, 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.329 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19502 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461917+0000", 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0010713960000000001 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461923+0000", 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7030000000000003e-06 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461936+0000", 2024-09-22T01:36:12.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2903e-05 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461944+0000", 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4169999999999992e-06 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515939+0000", 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053995026000000002 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516037+0000", 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8462999999999996e-05 2024-09-22T01:36:12.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516150+0000", 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000112502 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19507 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1806336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.825917728999997, 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055141745999999998, 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.333 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19507 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462085+0000", 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462087+0000", 2024-09-22T01:36:12.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.418e-06 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462095+0000", 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0460000000000006e-06 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462101+0000", 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1150000000000002e-06 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517103+0000", 2024-09-22T01:36:12.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055002874 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517153+0000", 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9888000000000001e-05 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517226+0000", 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2775999999999996e-05 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19508 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1816576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.825895007, 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055377692999999999, 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19508 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462497+0000", 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038960900000000002 2024-09-22T01:36:12.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462501+0000", 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2640000000000002e-06 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462513+0000", 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1643e-05 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462520+0000", 2024-09-22T01:36:12.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.148e-06 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517286+0000", 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054766269999999999 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517378+0000", 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1853000000000003e-05 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517485+0000", 2024-09-22T01:36:12.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106906 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19509 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1990656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.825464178000004, 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055183229, 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.342 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19509 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462541+0000", 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6460000000000002e-06 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462550+0000", 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3440000000000007e-06 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462556+0000", 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5330000000000002e-06 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517517+0000", 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054960822999999999 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517620+0000", 2024-09-22T01:36:12.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010306600000000001 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517721+0000", 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010129299999999999 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19524 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1099776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.825437105000006, 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055394339000000001, 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.346 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19524 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:12.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462933+0000", 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00036762399999999999 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462937+0000", 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5580000000000002e-06 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462946+0000", 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3179999999999996e-06 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462953+0000", 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8560000000000001e-06 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517759+0000", 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054806133 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517856+0000", 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7048999999999999e-05 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517959+0000", 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010280099999999999 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19525 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1110016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.825034289000001, 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055216300000000003, 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.350 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19525 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463068+0000", 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100511 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463072+0000", 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.563e-06 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463081+0000", 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.816e-06 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463087+0000", 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5910000000000001e-06 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517994+0000", 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054906644999999997 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518084+0000", 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9806e-05 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.353 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518184+0000", 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100368 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19526 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1284096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.824905641000001, 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.05530989, 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.354 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19526 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463491+0000", 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00039443699999999998 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463497+0000", 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463508+0000", 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1685000000000001e-05 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463517+0000", 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2479999999999996e-06 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518222+0000", 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054705548 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518317+0000", 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4660999999999994e-05 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518406+0000", 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9580999999999995e-05 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19527 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1458176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.824427, 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055079491000000001, 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.358 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19527 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463576+0000", 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3099999999999997e-07 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463579+0000", 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5719999999999999e-06 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463589+0000", 2024-09-22T01:36:12.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4020000000000008e-06 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463595+0000", 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1140000000000002e-06 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518459+0000", 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054863737000000003 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518543+0000", 2024-09-22T01:36:12.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4690000000000004e-05 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518655+0000", 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111345 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19528 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1468416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.824396566000004, 2024-09-22T01:36:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.059935753000000001, 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19528 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463794+0000", 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018894199999999999 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463798+0000", 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7000000000000002e-06 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463808+0000", 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0045e-05 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463814+0000", 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518732+0000", 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054917796999999997 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518812+0000", 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9759999999999995e-05 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.523541+0000", 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0047297270000000004 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.366 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19529 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1642496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.824178208000006, 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055275522000000001, 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.367 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19529 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465588+0000", 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017641309999999999 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465593+0000", 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7350000000000004e-06 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465602+0000", 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.329e-06 2024-09-22T01:36:12.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465608+0000", 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6779999999999997e-06 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518932+0000", 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053324085 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519006+0000", 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4072000000000005e-05 2024-09-22T01:36:12.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519099+0000", 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3492000000000005e-05 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.491621504000001, 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.371 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.373 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:36:12.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:36:12.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop(client.4367.0:90338 3.f e63/22 3:f57ef966:::rbd_data.110f82290689.0000000000000000:head v 63'283, mlcod=62'280)", 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 27.492095888000001, 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.057883599000000001, 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.378 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795910+0000", 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9230000000000004e-06 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813541+0000", 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.017631371 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813592+0000", 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1038999999999997e-05 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813620+0000", 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7169e-05 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813793+0000", 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017370600000000001 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813857+0000", 2024-09-22T01:36:12.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3540999999999994e-05 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.853698+0000", 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.039841255999999999 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.853790+0000", 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1594000000000004e-05 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 14.779478786, 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:36:12.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:36:12.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.389 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.389 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:12.390 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:12.391 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:12.385+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:12.491 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:12.487+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:12.516 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:12.516 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:12.516 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:12.517 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:12.530 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:12.622 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:12.619+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:12.692 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:12.689+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:12.693 INFO:teuthology.orchestra.run.smithi018.stdout:3379 write 0xbabafc thru 0xbb6c17 (0xb11c bytes) 2024-09-22T01:36:12.697 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:12.706 INFO:teuthology.orchestra.run.smithi018.stdout:3382 trunc from 0x1014e41 to 0x4e14d7c 2024-09-22T01:36:12.706 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:12.706 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:12.707 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:12.707 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:12.707 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:12.719 INFO:teuthology.orchestra.run.smithi018.stdout:3383 writesame 0x1ff50e3 thru 0x20002e9 data_size 0x5(0xb207 bytes) 2024-09-22T01:36:12.722 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:12.739 INFO:teuthology.orchestra.run.smithi018.stdout:3384 trunc from 0x4e14d7c to 0x7b969bd 2024-09-22T01:36:12.749 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:12.750 INFO:teuthology.orchestra.run.smithi018.stdout:3386 read 0x483533a thru 0x4836be3 (0x18aa bytes) 2024-09-22T01:36:12.750 INFO:teuthology.orchestra.run.smithi018.stdout:3387 read 0x491d46f thru 0x4927926 (0xa4b8 bytes) 2024-09-22T01:36:12.778 INFO:teuthology.orchestra.run.smithi018.stdout:3392 writesame 0xe7ea34d thru 0xe7f3e7b data_size 0x1(0x9b2f bytes) 2024-09-22T01:36:12.778 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:12.779 INFO:teuthology.orchestra.run.smithi018.stdout:3396 read 0x8ae7438 thru 0x8af5a11 (0xe5da bytes) 2024-09-22T01:36:12.779 INFO:teuthology.orchestra.run.smithi018.stdout:3397 read 0x6406689 thru 0x64124ef (0xbe67 bytes) 2024-09-22T01:36:12.779 INFO:teuthology.orchestra.run.smithi018.stdout:3398 write 0xd924fdb thru 0xd92d5e9 (0x860f bytes) 2024-09-22T01:36:12.786 INFO:teuthology.orchestra.run.smithi018.stdout:3399 read 0x6db50cd thru 0x6db5783 (0x6b7 bytes) 2024-09-22T01:36:12.786 INFO:teuthology.orchestra.run.smithi018.stdout:3400 read 0xc823605 thru 0xc8290ee (0x5aea bytes) 2024-09-22T01:36:12.786 INFO:teuthology.orchestra.run.smithi018.stdout:3402 read 0xe20172c thru 0xe20b976 (0xa24b bytes) 2024-09-22T01:36:12.787 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:12.787 INFO:teuthology.orchestra.run.smithi018.stdout:3404 read 0x29e0ee7 thru 0x29ea841 (0x995b bytes) 2024-09-22T01:36:12.787 INFO:teuthology.orchestra.run.smithi018.stdout:3405 punch from 0x3249968 to 0x324b6c9, (0x1d61 bytes) 2024-09-22T01:36:12.787 INFO:teuthology.orchestra.run.smithi018.stdout:3408 punch from 0x6267ee8 to 0x6269125, (0x123d bytes) 2024-09-22T01:36:12.787 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:12.787 INFO:teuthology.orchestra.run.smithi018.stdout:3410 writesame 0xd1238ba thru 0xd12b8fa data_size 0x1(0x8041 bytes) 2024-09-22T01:36:12.794 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:12.789+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:12.834 INFO:teuthology.orchestra.run.smithi018.stdout:3411 read 0x5a2b83e thru 0x5a36c11 (0xb3d4 bytes) 2024-09-22T01:36:12.834 INFO:teuthology.orchestra.run.smithi018.stdout:3412 write 0x2155cdd thru 0x2164ed9 (0xf1fd bytes) 2024-09-22T01:36:12.841 INFO:teuthology.orchestra.run.smithi018.stdout:3413 read 0xba31118 thru 0xba3f58c (0xe475 bytes) 2024-09-22T01:36:12.841 INFO:teuthology.orchestra.run.smithi018.stdout:3414 write 0x648c0bd thru 0x6499906 (0xd84a bytes) 2024-09-22T01:36:12.850 INFO:teuthology.orchestra.run.smithi018.stdout:3415 read 0x82af310 thru 0x82b365e (0x434f bytes) 2024-09-22T01:36:12.871 INFO:teuthology.orchestra.run.smithi018.stdout:3416 trunc from 0xe7f3e7c to 0x6d8cb7a 2024-09-22T01:36:12.890 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:12.890 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:12.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:12.891 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:12.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.891 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85503 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2535424~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.891 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:12.891 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.440140122000003, 2024-09-22T01:36:12.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093530897000000002, 2024-09-22T01:36:12.892 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.892 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.892 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.892 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.892 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.892 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.892 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85503 2024-09-22T01:36:12.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.893 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:12.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.894 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.894 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:12.894 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.894 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.894 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.894 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:12.894 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2899999999999999e-07 2024-09-22T01:36:12.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446999+0000", 2024-09-22T01:36:12.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.916e-06 2024-09-22T01:36:12.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447004+0000", 2024-09-22T01:36:12.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0799999999999996e-06 2024-09-22T01:36:12.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.896 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.896 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447009+0000", 2024-09-22T01:36:12.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4020000000000004e-06 2024-09-22T01:36:12.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540204+0000", 2024-09-22T01:36:12.897 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093195373999999997 2024-09-22T01:36:12.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540345+0000", 2024-09-22T01:36:12.898 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000140381 2024-09-22T01:36:12.898 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.898 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.898 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.898 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540528+0000", 2024-09-22T01:36:12.898 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000183415 2024-09-22T01:36:12.898 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.899 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.899 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.899 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.899 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.899 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85504 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2547712~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.899 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:12.900 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.440121779999998, 2024-09-22T01:36:12.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093891557, 2024-09-22T01:36:12.900 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.900 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.900 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.900 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.901 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.901 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.901 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85504 2024-09-22T01:36:12.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.901 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.901 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:12.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.902 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:12.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.903 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.903 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447016+0000", 2024-09-22T01:36:12.903 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5199999999999998e-07 2024-09-22T01:36:12.903 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.903 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.903 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.903 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447018+0000", 2024-09-22T01:36:12.903 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9039999999999999e-06 2024-09-22T01:36:12.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.904 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447023+0000", 2024-09-22T01:36:12.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2750000000000003e-06 2024-09-22T01:36:12.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447027+0000", 2024-09-22T01:36:12.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4530000000000004e-06 2024-09-22T01:36:12.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540594+0000", 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093566496999999998 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540737+0000", 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014323299999999999 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540907+0000", 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016984300000000001 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.906 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.440104062000003, 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.907 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:36:12.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.911 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85514 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1789952~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.436154766999998, 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093579774000000004, 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85514 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.912 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450983+0000", 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7999999999999996e-07 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450985+0000", 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1849999999999998e-06 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450991+0000", 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2129999999999996e-06 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450996+0000", 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4610000000000001e-06 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544381+0000", 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093384923999999994 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544456+0000", 2024-09-22T01:36:12.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5506999999999994e-05 2024-09-22T01:36:12.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544562+0000", 2024-09-22T01:36:12.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106004 2024-09-22T01:36:12.916 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.916 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.916 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.436135835999998, 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.917 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:36:12.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.920 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.436116775999999, 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.921 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.435890913000001, 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.925 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:36:12.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:36:12.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85526 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2732032~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.432113985999997, 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093423637000000004, 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85526 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.930 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455024+0000", 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2500000000000001e-07 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455025+0000", 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8959999999999999e-06 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455031+0000", 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0780000000000003e-06 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455035+0000", 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4580000000000003e-06 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548127+0000", 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093091561000000003 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548220+0000", 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3262000000000003e-05 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.933 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548447+0000", 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022705699999999999 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85527 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2744320~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.432096825999999, 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093760895999999996, 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.934 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85527 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458570+0000", 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035298489999999998 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458576+0000", 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3229999999999997e-06 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458585+0000", 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5410000000000006e-06 2024-09-22T01:36:12.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458591+0000", 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.285e-06 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548485+0000", 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089893197999999994 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.937 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548570+0000", 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5853000000000006e-05 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548801+0000", 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023084700000000001 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85536 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2818048~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.938 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.428385996999999, 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093657773999999999, 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85536 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458752+0000", 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2500000000000001e-07 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458759+0000", 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0759999999999997e-06 2024-09-22T01:36:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458766+0000", 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6329999999999996e-06 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458771+0000", 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5900000000000001e-06 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552107+0000", 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093335687000000001 2024-09-22T01:36:12.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552246+0000", 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013969399999999999 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552409+0000", 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000162769 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.428360570000002, 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.943 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:36:12.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:36:12.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:36:12.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:36:12.947 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.947 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.947 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.947 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85546 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2904064~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.947 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:12.947 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.424413756, 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093702627999999996, 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85546 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462724+0000", 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.27e-07 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.949 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462726+0000", 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9099999999999999e-06 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462731+0000", 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0969999999999996e-06 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462735+0000", 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5410000000000002e-06 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556116+0000", 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093380303999999997 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556261+0000", 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000145353 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556426+0000", 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016509599999999999 2024-09-22T01:36:12.951 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85547 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1912832~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.424396246999997, 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093927398999999995, 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.952 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85547 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:12.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4299999999999999e-07 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462743+0000", 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.815e-06 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462748+0000", 2024-09-22T01:36:12.954 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1930000000000001e-06 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462752+0000", 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1269999999999996e-06 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556484+0000", 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093731223000000002 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556561+0000", 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7082999999999994e-05 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556668+0000", 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010761500000000001 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.424379275, 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:36:12.956 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.958 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:12.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.958 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.958 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:36:12.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:36:12.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.958 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.959 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:36:12.959 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:36:12.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.959 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.959 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.959 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:36:12.959 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:36:12.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:36:12.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:36:12.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:36:12.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:36:12.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:36:12.962 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:36:12.962 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.962 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.962 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:36:12.962 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:36:12.962 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.962 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.963 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.963 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.963 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.963 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85558 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3002368~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.963 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:12.963 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.420197352999999, 2024-09-22T01:36:12.963 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093611833000000005, 2024-09-22T01:36:12.964 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.964 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.964 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.964 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.964 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.964 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.964 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85558 2024-09-22T01:36:12.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.965 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:12.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:12.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.966 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.966 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:12.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3700000000000001e-07 2024-09-22T01:36:12.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.967 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.967 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.967 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466942+0000", 2024-09-22T01:36:12.967 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6509999999999999e-06 2024-09-22T01:36:12.967 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.967 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.968 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.968 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466947+0000", 2024-09-22T01:36:12.968 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:36:12.968 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.968 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.968 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.968 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466951+0000", 2024-09-22T01:36:12.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3460000000000004e-06 2024-09-22T01:36:12.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560282+0000", 2024-09-22T01:36:12.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093330294999999994 2024-09-22T01:36:12.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.970 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560404+0000", 2024-09-22T01:36:12.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012278500000000001 2024-09-22T01:36:12.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.971 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.971 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560552+0000", 2024-09-22T01:36:12.971 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014742100000000001 2024-09-22T01:36:12.971 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.971 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.971 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.971 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.971 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.971 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85559 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1961984~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.971 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:12.972 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.420180487000003, 2024-09-22T01:36:12.972 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093835707000000004, 2024-09-22T01:36:12.972 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.972 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.972 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.972 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.972 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.972 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.973 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85559 2024-09-22T01:36:12.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.973 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:12.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.974 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:12.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.974 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6699999999999999e-07 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466959+0000", 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.516e-06 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466965+0000", 2024-09-22T01:36:12.975 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0610000000000001e-06 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466970+0000", 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6930000000000004e-06 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560608+0000", 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093637915000000002 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.976 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560688+0000", 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0139e-05 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560792+0000", 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000104016 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.420161192000002, 2024-09-22T01:36:12.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:12.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:36:12.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.980 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.981 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85570 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3100672~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.416227802999998, 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093416421999999999, 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85570 2024-09-22T01:36:12.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470910+0000", 2024-09-22T01:36:12.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.46e-07 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470912+0000", 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.829e-06 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470917+0000", 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0749999999999997e-06 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.984 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470923+0000", 2024-09-22T01:36:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6340000000000003e-06 2024-09-22T01:36:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564045+0000", 2024-09-22T01:36:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093121588000000005 2024-09-22T01:36:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564169+0000", 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000124311 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564326+0000", 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156639 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85571 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2011136~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.416206674999998, 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093598939000000006, 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85571 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470979+0000", 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8327e-05 2024-09-22T01:36:12.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470982+0000", 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470999+0000", 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6305999999999999e-05 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471005+0000", 2024-09-22T01:36:12.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0059999999999998e-06 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564351+0000", 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093346425999999996 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564436+0000", 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4425000000000006e-05 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564530+0000", 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3890999999999999e-05 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85572 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3112960~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 32.416122651999999, 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093850133000000002, 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:12.991 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85572 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474653+0000", 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036386040000000001 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474662+0000", 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9330000000000007e-06 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474674+0000", 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2054e-05 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474680+0000", 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000001e-06 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564595+0000", 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089914358999999999 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564715+0000", 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012013700000000001 2024-09-22T01:36:12.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:12.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:12.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:12.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564865+0000", 2024-09-22T01:36:12.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015003600000000001 2024-09-22T01:36:12.995 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.995 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.995 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.995 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:12.995 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:12.995 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:12.995 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:12.998 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:12.998 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:12.991+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:12.999 INFO:teuthology.orchestra.run.smithi018.stdout:3417 trunc from 0x6d8cb7a to 0xd2066ef 2024-09-22T01:36:12.999 INFO:teuthology.orchestra.run.smithi018.stdout:3421 read 0x6122157 thru 0x612e659 (0xc503 bytes) 2024-09-22T01:36:12.999 INFO:teuthology.orchestra.run.smithi018.stdout:3422 write 0x17e4993 thru 0x17e8264 (0x38d2 bytes) 2024-09-22T01:36:12.999 INFO:teuthology.orchestra.run.smithi018.stdout:3423 punch from 0x3ce5762 to 0x3cf10cb, (0xb969 bytes) 2024-09-22T01:36:12.999 INFO:teuthology.orchestra.run.smithi018.stdout:3424 writesame 0x6fa5884 thru 0x6fb2a7c data_size 0x7(0xd1f9 bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3425 write 0xed4ea67 thru 0xed5dbaf (0xf149 bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3428 read 0xa63f042 thru 0xa648b34 (0x9af3 bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3429 write 0xce9e1dd thru 0xcea5bbc (0x79e0 bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3430 read 0x282c36b thru 0x28361b8 (0x9e4e bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3432 read 0x63c129e thru 0x63ce318 (0xd07b bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3434 read 0x431032e thru 0x431af91 (0xac64 bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3435 punch from 0xc6bc67b to 0xc6be986, (0x230b bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3439 punch from 0x9a66064 to 0x9a74705, (0xe6a1 bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3442 punch from 0x24f5c3a to 0x24fc34d, (0x6713 bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3443 write 0x50685eb thru 0x5074c3d (0xc653 bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3445 write 0x7113915 thru 0x7115281 (0x196d bytes) 2024-09-22T01:36:13.000 INFO:teuthology.orchestra.run.smithi018.stdout:3447 writesame 0x5ab7e7b thru 0x5aba112 data_size 0x36(0x2298 bytes) 2024-09-22T01:36:13.001 INFO:teuthology.orchestra.run.smithi018.stdout:3448 read 0xd647136 thru 0xd656046 (0xef11 bytes) 2024-09-22T01:36:13.001 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.001 INFO:teuthology.orchestra.run.smithi018.stdout:3450 punch from 0x6062cf5 to 0x6067649, (0x4954 bytes) 2024-09-22T01:36:13.001 INFO:teuthology.orchestra.run.smithi018.stdout:3452 read 0x4fbb164 thru 0x4fbd88c (0x2729 bytes) 2024-09-22T01:36:13.001 INFO:teuthology.orchestra.run.smithi018.stdout:3453 write 0x10dc396 thru 0x10ea546 (0xe1b1 bytes) 2024-09-22T01:36:13.008 INFO:teuthology.orchestra.run.smithi018.stdout:3454 write 0x90227a3 thru 0x902e94f (0xc1ad bytes) 2024-09-22T01:36:13.014 INFO:teuthology.orchestra.run.smithi018.stdout:3455 write 0x1233c17 thru 0x1235675 (0x1a5f bytes) 2024-09-22T01:36:13.016 INFO:teuthology.orchestra.run.smithi018.stdout:3456 read 0x9b565f thru 0x9c10aa (0xba4c bytes) 2024-09-22T01:36:13.017 INFO:teuthology.orchestra.run.smithi018.stdout:3457 writesame 0xb131e34 thru 0xb13ecf3 data_size 0x20(0xcec0 bytes) 2024-09-22T01:36:13.024 INFO:teuthology.orchestra.run.smithi018.stdout:3458 read 0x878bd54 thru 0x878df52 (0x21ff bytes) 2024-09-22T01:36:13.024 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.025 INFO:teuthology.orchestra.run.smithi018.stdout:3461 write 0x43cbe02 thru 0x43cd7a7 (0x19a6 bytes) 2024-09-22T01:36:13.030 INFO:teuthology.orchestra.run.smithi018.stdout:3462 read 0x3005fad thru 0x3012096 (0xc0ea bytes) 2024-09-22T01:36:13.030 INFO:teuthology.orchestra.run.smithi018.stdout:3463 write 0xda900ef thru 0xda954c6 (0x53d8 bytes) 2024-09-22T01:36:13.050 INFO:teuthology.orchestra.run.smithi018.stdout:3464 trunc from 0xed5dbb0 to 0x713750d 2024-09-22T01:36:13.079 INFO:teuthology.orchestra.run.smithi018.stdout:3467 write 0x7b4830a thru 0x7b4e001 (0x5cf8 bytes) 2024-09-22T01:36:13.085 INFO:teuthology.orchestra.run.smithi018.stdout:3469 write 0x7742c90 thru 0x77460bc (0x342d bytes) 2024-09-22T01:36:13.098 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:13.095+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:13.103 INFO:teuthology.orchestra.run.smithi018.stdout:3471 write 0xa47b0c9 thru 0xa48187b (0x67b3 bytes) 2024-09-22T01:36:13.110 INFO:teuthology.orchestra.run.smithi018.stdout:3472 read 0x27d6a3 thru 0x287117 (0x9a75 bytes) 2024-09-22T01:36:13.110 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.111 INFO:teuthology.orchestra.run.smithi018.stdout:3475 read 0x24ead47 thru 0x24ee695 (0x394f bytes) 2024-09-22T01:36:13.111 INFO:teuthology.orchestra.run.smithi018.stdout:3476 writesame 0x493c48e thru 0x4942f53 data_size 0x2(0x6ac6 bytes) 2024-09-22T01:36:13.123 INFO:teuthology.orchestra.run.smithi018.stdout:3477 punch from 0x72a79bf to 0x72ac9fb, (0x503c bytes) 2024-09-22T01:36:13.123 INFO:teuthology.orchestra.run.smithi018.stdout:3478 writesame 0x6785c72 thru 0x67900da data_size 0x1(0xa469 bytes) 2024-09-22T01:36:13.166 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:13.166 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:13.180 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:13.181 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:13.181 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:13.181 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:13.187 INFO:teuthology.orchestra.run.smithi018.stdout:3479 trunc from 0xa48187c to 0x3859582 2024-09-22T01:36:13.190 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:13.190 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:13.197 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:13.198 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:13.193+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:13.210 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:13.210 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:13.228 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:13.229 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:13.230 INFO:teuthology.orchestra.run.smithi018.stdout:3480 writesame 0xb295ece thru 0xb2a2e92 data_size 0x1(0xcfc5 bytes) 2024-09-22T01:36:13.230 INFO:teuthology.orchestra.run.smithi018.stdout:3481 read 0x83a1850 thru 0x83a571c (0x3ecd bytes) 2024-09-22T01:36:13.230 INFO:teuthology.orchestra.run.smithi018.stdout:3482 read 0x4a68466 thru 0x4a780ee (0xfc89 bytes) 2024-09-22T01:36:13.230 INFO:teuthology.orchestra.run.smithi018.stdout:3483 read 0x96aca48 thru 0x96ba1c5 (0xd77e bytes) 2024-09-22T01:36:13.230 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.242 INFO:teuthology.orchestra.run.smithi018.stdout:3485 write 0xed5eab0 thru 0xed6e4e6 (0xfa37 bytes) 2024-09-22T01:36:13.247 INFO:teuthology.orchestra.run.smithi018.stdout:3486 punch from 0x763ad7a to 0x764852b, (0xd7b1 bytes) 2024-09-22T01:36:13.247 INFO:teuthology.orchestra.run.smithi018.stdout:3488 write 0x9544996 thru 0x954dbbd (0x9228 bytes) 2024-09-22T01:36:13.252 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:13.253 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:13.260 INFO:teuthology.orchestra.run.smithi018.stdout:3491 trunc from 0xed6e4e7 to 0x94ba7fe 2024-09-22T01:36:13.274 INFO:teuthology.orchestra.run.smithi018.stdout:3493 write 0x8a70f6 thru 0x8b63b0 (0xf2bb bytes) 2024-09-22T01:36:13.275 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:13.276 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:13.276 INFO:teuthology.orchestra.run.smithi018.stdout:3494 read 0x7fbfe56 thru 0x7fcd8bc (0xda67 bytes) 2024-09-22T01:36:13.276 INFO:teuthology.orchestra.run.smithi018.stdout:3495 write 0x102582f thru 0x10287e4 (0x2fb6 bytes) 2024-09-22T01:36:13.279 INFO:teuthology.orchestra.run.smithi018.stdout:3496 write 0x118f067 thru 0x119d5e9 (0xe583 bytes) 2024-09-22T01:36:13.284 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.294 INFO:teuthology.orchestra.run.smithi018.stdout:3499 trunc from 0x94ba7fe to 0x2440649 2024-09-22T01:36:13.295 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:13.295 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:13.299 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:13.295+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:13.305 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.305 INFO:teuthology.orchestra.run.smithi018.stdout:3501 read 0x1ddd5f5 thru 0x1de5b62 (0x856e bytes) 2024-09-22T01:36:13.306 INFO:teuthology.orchestra.run.smithi018.stdout:3502 read 0x21cfc78 thru 0x21d15c8 (0x1951 bytes) 2024-09-22T01:36:13.306 INFO:teuthology.orchestra.run.smithi018.stdout:3503 read 0x20dea0c thru 0x20df318 (0x90d bytes) 2024-09-22T01:36:13.315 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:13.316 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:13.333 INFO:teuthology.orchestra.run.smithi018.stdout:3504 writesame 0xe93e36f thru 0xe94c78c data_size 0x3(0xe41e bytes) 2024-09-22T01:36:13.333 INFO:teuthology.orchestra.run.smithi018.stdout:3505 read 0x706fd52 thru 0x707d6f9 (0xd9a8 bytes) 2024-09-22T01:36:13.337 INFO:teuthology.orchestra.run.smithi018.stdout:3506 trunc from 0xe94c78d to 0xc0c83ed 2024-09-22T01:36:13.343 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.343 INFO:teuthology.orchestra.run.smithi018.stdout:3508 punch from 0x7da1c41 to 0x7da737b, (0x573a bytes) 2024-09-22T01:36:13.344 INFO:teuthology.orchestra.run.smithi018.stdout:3509 read 0xea2ade thru 0xeafb56 (0xd079 bytes) 2024-09-22T01:36:13.344 INFO:teuthology.orchestra.run.smithi018.stdout:3510 write 0x2af637c thru 0x2b04d35 (0xe9ba bytes) 2024-09-22T01:36:13.349 INFO:teuthology.orchestra.run.smithi018.stdout:3511 writesame 0xad98d17 thru 0xad99fae data_size 0x28(0x1298 bytes) 2024-09-22T01:36:13.352 INFO:teuthology.orchestra.run.smithi018.stdout:3512 writesame 0x6ba09e0 thru 0x6ba344d data_size 0x1(0x2a6e bytes) 2024-09-22T01:36:13.361 INFO:teuthology.orchestra.run.smithi018.stdout:3513 writesame 0x500e6bf thru 0x5011949 data_size 0x13(0x328b bytes) 2024-09-22T01:36:13.367 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.369 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:13.369 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:13.383 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:13.386 INFO:teuthology.orchestra.run.smithi018.stdout:3515 trunc from 0xc0c83ed to 0x42fab2 2024-09-22T01:36:13.400 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:13.397+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:13.417 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.417 INFO:teuthology.orchestra.run.smithi018.stdout:3517 read 0x32b4dc thru 0x330ef1 (0x5a16 bytes) 2024-09-22T01:36:13.422 INFO:teuthology.orchestra.run.smithi018.stdout:3518 trunc from 0x42fab2 to 0x2e45a1c 2024-09-22T01:36:13.429 INFO:teuthology.orchestra.run.smithi018.stdout:3519 writesame 0x1b2d085 thru 0x1b3198f data_size 0x17(0x490b bytes) 2024-09-22T01:36:13.434 INFO:teuthology.orchestra.run.smithi018.stdout:3520 read 0x22eac9b thru 0x22ec8f2 (0x1c58 bytes) 2024-09-22T01:36:13.434 INFO:teuthology.orchestra.run.smithi018.stdout:3521 write 0x2bc07 thru 0x2fb13 (0x3f0d bytes) 2024-09-22T01:36:13.445 INFO:teuthology.orchestra.run.smithi018.stdout:3522 trunc from 0x2e45a1c to 0x7f17492 2024-09-22T01:36:13.453 INFO:teuthology.orchestra.run.smithi018.stdout:3524 punch from 0x353ea79 to 0x353f51b, (0xaa2 bytes) 2024-09-22T01:36:13.453 INFO:teuthology.orchestra.run.smithi018.stdout:3525 writesame 0x40f72db thru 0x40fc6ac data_size 0x1(0x53d2 bytes) 2024-09-22T01:36:13.491 INFO:teuthology.orchestra.run.smithi018.stdout:3526 write 0xeb2c15f thru 0xeb363e1 (0xa283 bytes) 2024-09-22T01:36:13.498 INFO:teuthology.orchestra.run.smithi018.stdout:3527 read 0x85581d5 thru 0x8565112 (0xcf3e bytes) 2024-09-22T01:36:13.498 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.498 INFO:teuthology.orchestra.run.smithi018.stdout:3529 read 0xc74d522 thru 0xc751567 (0x4046 bytes) 2024-09-22T01:36:13.498 INFO:teuthology.orchestra.run.smithi018.stdout:3531 write 0x25d9c2b thru 0x25e5796 (0xbb6c bytes) 2024-09-22T01:36:13.501 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:13.497+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:13.504 INFO:teuthology.orchestra.run.smithi018.stdout:3532 punch from 0xcd101b4 to 0xcd18947, (0x8793 bytes) 2024-09-22T01:36:13.505 INFO:teuthology.orchestra.run.smithi018.stdout:3533 read 0xdffff3d thru 0xe0000ea (0x1ae bytes) 2024-09-22T01:36:13.505 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.505 INFO:teuthology.orchestra.run.smithi018.stdout:3536 write 0x364b6f1 thru 0x365a151 (0xea61 bytes) 2024-09-22T01:36:13.512 INFO:teuthology.orchestra.run.smithi018.stdout:3538 read 0x6e3a856 thru 0x6e41718 (0x6ec3 bytes) 2024-09-22T01:36:13.512 INFO:teuthology.orchestra.run.smithi018.stdout:3541 read 0x91818ce thru 0x9189566 (0x7c99 bytes) 2024-09-22T01:36:13.512 INFO:teuthology.orchestra.run.smithi018.stdout:3543 punch from 0x250c2d4 to 0x25123b0, (0x60dc bytes) 2024-09-22T01:36:13.512 INFO:teuthology.orchestra.run.smithi018.stdout:3544 write 0x14ada34 thru 0x14bc648 (0xec15 bytes) 2024-09-22T01:36:13.518 INFO:teuthology.orchestra.run.smithi018.stdout:3545 read 0x9e931d0 thru 0x9e9ec85 (0xbab6 bytes) 2024-09-22T01:36:13.519 INFO:teuthology.orchestra.run.smithi018.stdout:3546 read 0xd9de1d4 thru 0xd9e0182 (0x1faf bytes) 2024-09-22T01:36:13.519 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.524 INFO:teuthology.orchestra.run.smithi018.stdout:3548 trunc from 0xeb363e2 to 0xc58c4a9 2024-09-22T01:36:13.545 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.545 INFO:teuthology.orchestra.run.smithi018.stdout:3551 punch from 0xa51d68b to 0xa52cb69, (0xf4de bytes) 2024-09-22T01:36:13.545 INFO:teuthology.orchestra.run.smithi018.stdout:3553 read 0x2117f4b thru 0x2119abb (0x1b71 bytes) 2024-09-22T01:36:13.545 INFO:teuthology.orchestra.run.smithi018.stdout:3555 write 0x457a301 thru 0x457cc64 (0x2964 bytes) 2024-09-22T01:36:13.547 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:13.547 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:13.552 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.552 INFO:teuthology.orchestra.run.smithi018.stdout:3557 punch from 0x7011015 to 0x701ae93, (0x9e7e bytes) 2024-09-22T01:36:13.552 INFO:teuthology.orchestra.run.smithi018.stdout:3558 read 0x28e8e1e thru 0x28ea6e3 (0x18c6 bytes) 2024-09-22T01:36:13.552 INFO:teuthology.orchestra.run.smithi018.stdout:3559 write 0x9a805c7 thru 0x9a8e3af (0xdde9 bytes) 2024-09-22T01:36:13.561 INFO:teuthology.orchestra.run.smithi018.stdout:3560 punch from 0xb8b346e to 0xb8bed1c, (0xb8ae bytes) 2024-09-22T01:36:13.562 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:13.592 INFO:teuthology.orchestra.run.smithi018.stdout:3561 trunc from 0xc58c4a9 to 0xaaa642 2024-09-22T01:36:13.606 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:13.603+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:13.648 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7, 0, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:36:13.648 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:36:13.649 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-22T01:36:13.649 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-22T01:36:13.649 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-22T01:36:13.649 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-22T01:36:13.652 INFO:teuthology.orchestra.run.smithi018.stdout:3562 write 0x9bc39e0 thru 0x9bcddfa (0xa41b bytes) 2024-09-22T01:36:13.667 INFO:teuthology.orchestra.run.smithi018.stdout:3563 trunc from 0x9bcddfb to 0x81663a4 2024-09-22T01:36:13.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:36:13.686 INFO:teuthology.orchestra.run.smithi018.stdout:3564 read 0x825814 thru 0x82c943 (0x7130 bytes) 2024-09-22T01:36:13.688 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:13.688 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:13.689 INFO:teuthology.orchestra.run.smithi018.stdout:3565 trunc from 0x81663a4 to 0x6b2066b 2024-09-22T01:36:13.698 INFO:teuthology.orchestra.run.smithi018.stdout:3567 read 0x341601f thru 0x3423e4f (0xde31 bytes) 2024-09-22T01:36:13.698 INFO:teuthology.orchestra.run.smithi018.stdout:3569 read 0x52b1f28 thru 0x52ba21c (0x82f5 bytes) 2024-09-22T01:36:13.704 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:13.699+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:13.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:13.713 INFO:teuthology.orchestra.run.smithi018.stdout:3571 write 0x9c8dd1d thru 0x9c92a9f (0x4d83 bytes) 2024-09-22T01:36:13.719 INFO:teuthology.orchestra.run.smithi018.stdout:3572 read 0x80c1d61 thru 0x80c83a3 (0x6643 bytes) 2024-09-22T01:36:13.720 INFO:teuthology.orchestra.run.smithi018.stdout:3573 trunc from 0x9c92aa0 to 0xa721fdf 2024-09-22T01:36:13.729 INFO:teuthology.orchestra.run.smithi018.stdout:3575 writesame 0x396c98e thru 0x39798d9 data_size 0x2(0xcf4c bytes) 2024-09-22T01:36:13.746 INFO:teuthology.orchestra.run.smithi018.stdout:3576 writesame 0x45e40f7 thru 0x45e630d data_size 0x1(0x2217 bytes) 2024-09-22T01:36:13.768 INFO:teuthology.orchestra.run.smithi018.stdout:3577 trunc from 0xa721fdf to 0x167827b 2024-09-22T01:36:13.782 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: "success": "" 2024-09-22T01:36:13.782 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:13.784 INFO:teuthology.orchestra.run.smithi018.stdout:3578 punch from 0x11f12ba to 0x11f4fb8, (0x3cfe bytes) 2024-09-22T01:36:13.798 INFO:teuthology.orchestra.run.smithi018.stdout:3579 trunc from 0x167827b to 0xa7db19c 2024-09-22T01:36:13.807 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:13.809 INFO:teuthology.orchestra.run.smithi018.stdout:3581 trunc from 0xa7db19c to 0xbe8b3a7 2024-09-22T01:36:13.817 INFO:teuthology.orchestra.run.smithi018.stdout:3583 punch from 0xc170a6 to 0xc1a9e5, (0x393f bytes) 2024-09-22T01:36:13.827 INFO:teuthology.orchestra.run.smithi018.stdout:3584 trunc from 0xbe8b3a7 to 0x678718a 2024-09-22T01:36:13.842 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:13.839+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:13.842 INFO:teuthology.orchestra.run.smithi018.stdout:3587 write 0x708f877 thru 0x70975ac (0x7d36 bytes) 2024-09-22T01:36:13.846 INFO:teuthology.orchestra.run.smithi018.stdout:3588 read 0x187fd2c thru 0x188226c (0x2541 bytes) 2024-09-22T01:36:13.846 INFO:teuthology.orchestra.run.smithi018.stdout:3589 read 0x3ca0133 thru 0x3ca37c8 (0x3696 bytes) 2024-09-22T01:36:13.846 INFO:teuthology.orchestra.run.smithi018.stdout:3590 clone 26 order 23 su 4194304 sc 11 2024-09-22T01:36:13.871 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:13.872 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:13.885 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:13.926 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:13.923+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:14.007 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:14.001+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:14.048 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:14.048 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:14.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:14.108 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:14.103+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:14.188 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:14.188 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:14.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:14.208 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:14.203+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:14.309 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:14.303+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:14.330 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:14.331 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:14.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:14.410 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:14.405+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:14.464 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:14.464 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:14.478 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:14.520 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:14.517+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:14.613 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:14.611+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:14.649 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:14.649 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:14.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:14.669 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:36:14.714 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:14.711+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:14.798 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone25 from 0x70975ad (overlap 0x42fab2) to 0x35955b 2024-09-22T01:36:14.803 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:14.803 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:14.815 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:14.809+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:14.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:14.915 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:14.911+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:14.927 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-22T01:36:15.007 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:15.008 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:15.016 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:15.011+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:15.025 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:15.117 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:15.111+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:15.176 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:15.176 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:15.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:15.240 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:15.237+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:15.313 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:15.313 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:15.319 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:15.313+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:15.329 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:15.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:15.363 INFO:teuthology.orchestra.run.smithi018.stdout:3593 write 0x4e23c1 thru 0x4e714b (0x4d8b bytes) 2024-09-22T01:36:15.380 INFO:teuthology.orchestra.run.smithi018.stdout:3594 read 0x47d1da9 thru 0x47dad21 (0x8f79 bytes) 2024-09-22T01:36:15.380 INFO:teuthology.orchestra.run.smithi018.stdout:3595 write 0x19b4356 thru 0x19baff6 (0x6ca1 bytes) 2024-09-22T01:36:15.387 INFO:teuthology.orchestra.run.smithi018.stdout:3596 read 0x4d6821e thru 0x4d73e20 (0xbc03 bytes) 2024-09-22T01:36:15.387 INFO:teuthology.orchestra.run.smithi018.stdout:3597 read 0x4d2c74f thru 0x4d3ac5e (0xe510 bytes) 2024-09-22T01:36:15.387 INFO:teuthology.orchestra.run.smithi018.stdout:3598 writesame 0x5310149 thru 0x531926e data_size 0x21(0x9126 bytes) 2024-09-22T01:36:15.394 INFO:teuthology.orchestra.run.smithi018.stdout:3599 read 0x5f89fc thru 0x601283 (0x8888 bytes) 2024-09-22T01:36:15.395 INFO:teuthology.orchestra.run.smithi018.stdout:3600 read 0xf855eb thru 0xf8d6b2 (0x80c8 bytes) 2024-09-22T01:36:15.395 INFO:teuthology.orchestra.run.smithi018.stdout:3602 write 0x191d5ee thru 0x192d3c6 (0xfdd9 bytes) 2024-09-22T01:36:15.399 INFO:teuthology.orchestra.run.smithi018.stdout:3603 read 0x6c9f547 thru 0x6caa0e9 (0xaba3 bytes) 2024-09-22T01:36:15.415 INFO:teuthology.orchestra.run.smithi018.stdout:3604 write 0xb7a37b8 thru 0xb7af913 (0xc15c bytes) 2024-09-22T01:36:15.419 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:15.415+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:15.432 INFO:teuthology.orchestra.run.smithi018.stdout:3605 write 0xc6f1acb thru 0xc6f7471 (0x59a7 bytes) 2024-09-22T01:36:15.438 INFO:teuthology.orchestra.run.smithi018.stdout:3606 write 0x1f887c thru 0x1ffdf6 (0x757b bytes) 2024-09-22T01:36:15.464 INFO:teuthology.orchestra.run.smithi018.stdout:3608 write 0xe05ee4f thru 0xe06c16e (0xd320 bytes) 2024-09-22T01:36:15.483 INFO:teuthology.orchestra.run.smithi018.stdout:3609 trunc from 0xe06c16f to 0x4883493 2024-09-22T01:36:15.494 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:15.494 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:15.512 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:15.531 INFO:teuthology.orchestra.run.smithi018.stdout:3612 write 0xb3521ba thru 0xb355a9b (0x38e2 bytes) 2024-09-22T01:36:15.531 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:15.525+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:15.535 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:15.535 INFO:teuthology.orchestra.run.smithi018.stdout:3614 punch from 0x450fcae to 0x451e240, (0xe592 bytes) 2024-09-22T01:36:15.535 INFO:teuthology.orchestra.run.smithi018.stdout:3615 writesame 0xadafbd9 thru 0xadb3121 data_size 0x1(0x3549 bytes) 2024-09-22T01:36:15.537 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:15.537 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:15.554 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:15.554 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:15.558 INFO:teuthology.orchestra.run.smithi018.stdout:3616 punch from 0x7bdaec8 to 0x7bea042, (0xf17a bytes) 2024-09-22T01:36:15.558 INFO:teuthology.orchestra.run.smithi018.stdout:3617 writesame 0x131ce28 thru 0x132340e data_size 0x1(0x65e7 bytes) 2024-09-22T01:36:15.571 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:15.571 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:15.588 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:15.588 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:15.609 INFO:teuthology.orchestra.run.smithi018.stdout:3619 trunc from 0xb355a9c to 0x54985c9 2024-09-22T01:36:15.609 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:15.609 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:15.621 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:15.615+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:15.632 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:15.632 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:15.652 INFO:teuthology.orchestra.run.smithi018.stdout:3620 write 0xe65dcd4 thru 0xe66af24 (0xd251 bytes) 2024-09-22T01:36:15.653 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:15.654 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:15.656 INFO:teuthology.orchestra.run.smithi018.stdout:3621 writesame 0x46ee6e5 thru 0x46fd8d0 data_size 0xd(0xf1ec bytes) 2024-09-22T01:36:15.665 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:15.665 INFO:teuthology.orchestra.run.smithi018.stdout:3623 read 0x22d4202 thru 0x22d5637 (0x1436 bytes) 2024-09-22T01:36:15.665 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:15.666 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:15.666 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:15.666 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:15.666 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:15.666 INFO:teuthology.orchestra.run.smithi018.stdout:3625 write 0x520654c thru 0x52066c1 (0x176 bytes) 2024-09-22T01:36:15.668 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:15.668 INFO:teuthology.orchestra.run.smithi018.stdout:3628 write 0x142590a thru 0x142d2f9 (0x79f0 bytes) 2024-09-22T01:36:15.675 INFO:teuthology.orchestra.run.smithi018.stdout:3630 write 0x6c178ba thru 0x6c26b3a (0xf281 bytes) 2024-09-22T01:36:15.678 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:15.678 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:15.681 INFO:teuthology.orchestra.run.smithi018.stdout:3631 read 0x71f3bc thru 0x72c9b0 (0xd5f5 bytes) 2024-09-22T01:36:15.682 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:15.683 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:15.683 INFO:teuthology.orchestra.run.smithi018.stdout:3634 punch from 0xcec20cb to 0xceca243, (0x8178 bytes) 2024-09-22T01:36:15.683 INFO:teuthology.orchestra.run.smithi018.stdout:3635 read 0x2520bda thru 0x252f8a2 (0xecc9 bytes) 2024-09-22T01:36:15.683 INFO:teuthology.orchestra.run.smithi018.stdout:3636 write 0x6b9607e thru 0x6b9634a (0x2cd bytes) 2024-09-22T01:36:15.688 INFO:teuthology.orchestra.run.smithi018.stdout:3637 clone 27 order 25 su 131072 sc 5 2024-09-22T01:36:15.723 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:15.719+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:15.792 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:15.792 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:15.792 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:15.792 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:15.792 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:15.804 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:15.848 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:15.845+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:15.924 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:15.919+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:15.930 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:15.930 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.797128916000005, 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.931 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:15.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.797103179999993, 2024-09-22T01:36:15.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.797077397999999, 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.939 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.942 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.797032478999995, 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.943 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:36:15.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.797000323000006, 2024-09-22T01:36:15.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:36:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.949 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796972590999999, 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:36:15.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:36:15.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:36:15.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.953 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796936767000005, 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:15.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:15.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796900622999999, 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.957 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:36:15.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796864417999998, 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.964 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796837065999995, 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796799988000004, 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:15.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796776450999999, 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:36:15.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12683 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796286452000004, 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058771337, 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.975 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12683 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126557+0000", 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126558+0000", 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6399999999999998e-07 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126559+0000", 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8360000000000001e-06 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126567+0000", 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4189999999999996e-06 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126578+0000", 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1439e-05 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185320+0000", 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058741987000000002 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185329+0000", 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2919999999999996e-06 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.978 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796229251, 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796201494000002, 2024-09-22T01:36:15.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:36:15.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:36:15.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796179428000002, 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:36:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.796149267999994, 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.795728777999997, 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:36:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.795702997000006, 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:36:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 70.795681728999995, 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:36:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:36:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:16.004 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:16.005 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:16.048 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:16.045+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:16.126 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:16.121+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:16.135 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:16.135 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:16.135 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:16.135 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:16.149 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:16.226 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:16.221+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:16.271 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:16.271 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:16.271 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:16.271 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:16.272 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:16.285 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:16.327 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:16.321+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19458 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1417216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.957804522999993, 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.056428816, 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.419 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19458 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:16.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7700000000000005e-07 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457940+0000", 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4329999999999998e-06 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457947+0000", 2024-09-22T01:36:16.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9029999999999998e-06 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457953+0000", 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8900000000000004e-06 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512121+0000", 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054168717999999998 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512221+0000", 2024-09-22T01:36:16.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9279999999999998e-05 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514366+0000", 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002145115 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19464 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1949696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.957293300999993, 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055080249999999997, 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.423 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19464 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:16.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459822+0000", 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013738540000000001 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459827+0000", 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1630000000000004e-06 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459840+0000", 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2775000000000001e-05 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459847+0000", 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8360000000000003e-06 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513362+0000", 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053515442000000003 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513441+0000", 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8708000000000006e-05 2024-09-22T01:36:16.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513528+0000", 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7472000000000005e-05 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19484 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1437696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.955751907000007, 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055077586999999997, 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.427 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19484 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7e-07 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459993+0000", 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8380000000000002e-06 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460000+0000", 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460005+0000", 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3680000000000001e-06 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514879+0000", 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054874038999999999 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514965+0000", 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5574000000000004e-05 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515067+0000", 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010228100000000001 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19485 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1796096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.955729110999997, 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055255209, 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19485 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460300+0000", 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028730299999999998 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460304+0000", 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460314+0000", 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7119999999999995e-06 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460321+0000", 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6710000000000002e-06 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515101+0000", 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054780263000000003 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515180+0000", 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9074999999999998e-05 2024-09-22T01:36:16.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515268+0000", 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7416999999999993e-05 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19486 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1970176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.955377229000007, 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055098253, 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.435 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19486 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460365+0000", 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9599999999999999e-07 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460369+0000", 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460382+0000", 2024-09-22T01:36:16.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3478999999999999e-05 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460390+0000", 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5340000000000002e-06 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515297+0000", 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054907665000000001 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515373+0000", 2024-09-22T01:36:16.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5721000000000002e-05 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515463+0000", 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9653000000000004e-05 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19487 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1980416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.955328855999994, 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055238787999999997, 2024-09-22T01:36:16.439 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19487 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460764+0000", 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035164799999999998 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460769+0000", 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.169e-06 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460779+0000", 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3239999999999992e-06 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460786+0000", 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0500000000000003e-06 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515497+0000", 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054711098 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515576+0000", 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9085999999999995e-05 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515651+0000", 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5413000000000005e-05 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19501 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1089536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.954922151999995, 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055065846000000002, 2024-09-22T01:36:16.443 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19501 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460820+0000", 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000005e-07 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460823+0000", 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9459999999999998e-06 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460831+0000", 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6839999999999996e-06 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460837+0000", 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9479999999999996e-06 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515696+0000", 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054859053999999997 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515783+0000", 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7705000000000001e-05 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515885+0000", 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101908 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19502 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1263616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:16.447 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.954895993999997, 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055304409999999998, 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19502 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461917+0000", 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0010713960000000001 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461923+0000", 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7030000000000003e-06 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461936+0000", 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2903e-05 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461944+0000", 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4169999999999992e-06 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515939+0000", 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053995026000000002 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516037+0000", 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8462999999999996e-05 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516150+0000", 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000112502 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19507 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1806336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:16.451 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.953657222000004, 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055141745999999998, 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19507 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462085+0000", 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462087+0000", 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.418e-06 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462095+0000", 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0460000000000006e-06 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462101+0000", 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1150000000000002e-06 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517103+0000", 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055002874 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517153+0000", 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9888000000000001e-05 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517226+0000", 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2775999999999996e-05 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19508 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1816576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.953634500000007, 2024-09-22T01:36:16.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055377692999999999, 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19508 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462497+0000", 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038960900000000002 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462501+0000", 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2640000000000002e-06 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462513+0000", 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1643e-05 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462520+0000", 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.148e-06 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517286+0000", 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054766269999999999 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517378+0000", 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1853000000000003e-05 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517485+0000", 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106906 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19509 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1990656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.459 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.953203670999997, 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055183229, 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19509 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462541+0000", 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6460000000000002e-06 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462550+0000", 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3440000000000007e-06 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462556+0000", 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5330000000000002e-06 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517517+0000", 2024-09-22T01:36:16.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054960822999999999 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517620+0000", 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010306600000000001 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517721+0000", 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010129299999999999 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19524 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1099776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.953176597999999, 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055394339000000001, 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19524 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462933+0000", 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00036762399999999999 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462937+0000", 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5580000000000002e-06 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462946+0000", 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3179999999999996e-06 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462953+0000", 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8560000000000001e-06 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517759+0000", 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054806133 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517856+0000", 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7048999999999999e-05 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517959+0000", 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010280099999999999 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19525 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1110016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.952773781999994, 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055216300000000003, 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19525 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463068+0000", 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100511 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463072+0000", 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.563e-06 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463081+0000", 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.816e-06 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463087+0000", 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5910000000000001e-06 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517994+0000", 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054906644999999997 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518084+0000", 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9806e-05 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518184+0000", 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100368 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19526 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1284096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.952645133999994, 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.05530989, 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19526 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463491+0000", 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00039443699999999998 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463497+0000", 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463508+0000", 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1685000000000001e-05 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463517+0000", 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2479999999999996e-06 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518222+0000", 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054705548 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518317+0000", 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4660999999999994e-05 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518406+0000", 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9580999999999995e-05 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19527 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1458176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.952166492999993, 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055079491000000001, 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19527 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463576+0000", 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3099999999999997e-07 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463579+0000", 2024-09-22T01:36:16.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5719999999999999e-06 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463589+0000", 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4020000000000008e-06 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463595+0000", 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1140000000000002e-06 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518459+0000", 2024-09-22T01:36:16.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054863737000000003 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518543+0000", 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4690000000000004e-05 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518655+0000", 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111345 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19528 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1468416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.952136058999997, 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.059935753000000001, 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19528 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463794+0000", 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018894199999999999 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463798+0000", 2024-09-22T01:36:16.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7000000000000002e-06 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463808+0000", 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0045e-05 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463814+0000", 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518732+0000", 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054917796999999997 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518812+0000", 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9759999999999995e-05 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.523541+0000", 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0047297270000000004 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.483 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19529 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1642496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.951917700999999, 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055275522000000001, 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19529 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:16.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465588+0000", 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017641309999999999 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465593+0000", 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7350000000000004e-06 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465602+0000", 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.329e-06 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465608+0000", 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6779999999999997e-06 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518932+0000", 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053324085 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519006+0000", 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4072000000000005e-05 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519099+0000", 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3492000000000005e-05 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.619360997000001, 2024-09-22T01:36:16.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:36:16.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:36:16.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:36:16.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.493 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop(client.4367.0:90338 3.f e63/22 3:f57ef966:::rbd_data.110f82290689.0000000000000000:head v 63'283, mlcod=62'280)", 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 31.619835381000001, 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.057883599000000001, 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795910+0000", 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9230000000000004e-06 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813541+0000", 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.017631371 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813592+0000", 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1038999999999997e-05 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813620+0000", 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7169e-05 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813793+0000", 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017370600000000001 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813857+0000", 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3540999999999994e-05 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.853698+0000", 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.039841255999999999 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.853790+0000", 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1594000000000004e-05 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.497 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 18.907218278999999, 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:36:16.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:36:16.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:36:16.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.504 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.504 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:16.505 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:16.505 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:16.501+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:16.606 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:16.601+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:16.633 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:16.633 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:16.633 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:16.633 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:16.647 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:16.692 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:36:16.740 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:16.737+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:16.776 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:16.776 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:16.776 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:16.776 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:16.776 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:16.791 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:16.807 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:16.801+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:16.816 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone26 from 0xe66af25 (overlap 0x4883493) to 0x2b81f8b 2024-09-22T01:36:16.908 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:16.903+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:16.916 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:16.916 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:16.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:16.916 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:16.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.916 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85503 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2535424~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.916 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:16.916 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.468044265000003, 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093530897000000002, 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85503 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2899999999999999e-07 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446999+0000", 2024-09-22T01:36:16.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.916e-06 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447004+0000", 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0799999999999996e-06 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447009+0000", 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4020000000000004e-06 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540204+0000", 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093195373999999997 2024-09-22T01:36:16.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540345+0000", 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000140381 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540528+0000", 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000183415 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.920 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85504 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2547712~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.468025922999999, 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093891557, 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85504 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447016+0000", 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5199999999999998e-07 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447018+0000", 2024-09-22T01:36:16.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9039999999999999e-06 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447023+0000", 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2750000000000003e-06 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447027+0000", 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4530000000000004e-06 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540594+0000", 2024-09-22T01:36:16.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093566496999999998 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540737+0000", 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014323299999999999 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540907+0000", 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016984300000000001 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.924 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.468008204999997, 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.925 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:36:16.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85514 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1789952~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.464058909999999, 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093579774000000004, 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85514 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.929 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450983+0000", 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7999999999999996e-07 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.930 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450985+0000", 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1849999999999998e-06 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450991+0000", 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2129999999999996e-06 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450996+0000", 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4610000000000001e-06 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.931 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544381+0000", 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093384923999999994 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544456+0000", 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5506999999999994e-05 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544562+0000", 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106004 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.932 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.464039978999999, 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.933 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:36:16.934 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:36:16.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:36:16.936 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.464020918999999, 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.937 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.938 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:36:16.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:36:16.940 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.463795056000002, 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.941 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:36:16.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85526 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2732032~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.460018128999998, 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093423637000000004, 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.945 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85526 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455024+0000", 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2500000000000001e-07 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455025+0000", 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8959999999999999e-06 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455031+0000", 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0780000000000003e-06 2024-09-22T01:36:16.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455035+0000", 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4580000000000003e-06 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548127+0000", 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093091561000000003 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548220+0000", 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3262000000000003e-05 2024-09-22T01:36:16.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548447+0000", 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022705699999999999 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85527 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2744320~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.460000968999999, 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093760895999999996, 2024-09-22T01:36:16.949 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85527 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.950 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458570+0000", 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035298489999999998 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458576+0000", 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3229999999999997e-06 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458585+0000", 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5410000000000006e-06 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458591+0000", 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.285e-06 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548485+0000", 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089893197999999994 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548570+0000", 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5853000000000006e-05 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548801+0000", 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023084700000000001 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85536 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2818048~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:16.953 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.45629014, 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093657773999999999, 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85536 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:16.954 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458752+0000", 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2500000000000001e-07 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458759+0000", 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0759999999999997e-06 2024-09-22T01:36:16.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458766+0000", 2024-09-22T01:36:16.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6329999999999996e-06 2024-09-22T01:36:16.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458771+0000", 2024-09-22T01:36:16.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5900000000000001e-06 2024-09-22T01:36:16.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552107+0000", 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093335687000000001 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552246+0000", 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013969399999999999 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552409+0000", 2024-09-22T01:36:16.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000162769 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.456264713000003, 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.959 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.962 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85546 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2904064~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.452317899000001, 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093702627999999996, 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.963 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85546 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:16.964 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462724+0000", 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.27e-07 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462726+0000", 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9099999999999999e-06 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462731+0000", 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0969999999999996e-06 2024-09-22T01:36:16.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462735+0000", 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5410000000000002e-06 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556116+0000", 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093380303999999997 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556261+0000", 2024-09-22T01:36:16.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000145353 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556426+0000", 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016509599999999999 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85547 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1912832~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.452300389999998, 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093927398999999995, 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.967 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85547 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.968 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4299999999999999e-07 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462743+0000", 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.815e-06 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462748+0000", 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1930000000000001e-06 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462752+0000", 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1269999999999996e-06 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556484+0000", 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093731223000000002 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556561+0000", 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7082999999999994e-05 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556668+0000", 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010761500000000001 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:16.971 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.452283418, 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:36:16.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:36:16.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85558 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3002368~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.448101496, 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093611833000000005, 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85558 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3700000000000001e-07 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466942+0000", 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6509999999999999e-06 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466947+0000", 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466951+0000", 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3460000000000004e-06 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560282+0000", 2024-09-22T01:36:16.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093330294999999994 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560404+0000", 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012278500000000001 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560552+0000", 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014742100000000001 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.979 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85559 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1961984~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.448084629999997, 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093835707000000004, 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85559 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:16.980 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6699999999999999e-07 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466959+0000", 2024-09-22T01:36:16.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.516e-06 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466965+0000", 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0610000000000001e-06 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466970+0000", 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6930000000000004e-06 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560608+0000", 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093637915000000002 2024-09-22T01:36:16.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560688+0000", 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0139e-05 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560792+0000", 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000104016 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.983 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.448065335000003, 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.984 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:36:16.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85570 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3100672~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:16.987 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.444131945999999, 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093416421999999999, 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85570 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470910+0000", 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.46e-07 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470912+0000", 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.829e-06 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470917+0000", 2024-09-22T01:36:16.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0749999999999997e-06 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470923+0000", 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6340000000000003e-06 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564045+0000", 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093121588000000005 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564169+0000", 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000124311 2024-09-22T01:36:16.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564326+0000", 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156639 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85571 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2011136~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.444110817999999, 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093598939000000006, 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.991 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85571 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:16.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470979+0000", 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8327e-05 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470982+0000", 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470999+0000", 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6305999999999999e-05 2024-09-22T01:36:16.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471005+0000", 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0059999999999998e-06 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564351+0000", 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093346425999999996 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564436+0000", 2024-09-22T01:36:16.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4425000000000006e-05 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564530+0000", 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3890999999999999e-05 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85572 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3112960~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 36.444026794999999, 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093850133000000002, 2024-09-22T01:36:16.995 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85572 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:16.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474653+0000", 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036386040000000001 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474662+0000", 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9330000000000007e-06 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:16.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474674+0000", 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2054e-05 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474680+0000", 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000001e-06 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564595+0000", 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089914358999999999 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:16.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564715+0000", 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012013700000000001 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564865+0000", 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015003600000000001 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:16.999 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:17.000 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-22T01:36:17.000 INFO:teuthology.orchestra.run.smithi018.stdout:3640 write 0xc864656 thru 0xc86de86 (0x9831 bytes) 2024-09-22T01:36:17.000 INFO:teuthology.orchestra.run.smithi018.stdout:3641 trunc from 0xe66af25 to 0x49c460b 2024-09-22T01:36:17.001 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:17.008 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:17.005+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:17.092 INFO:teuthology.orchestra.run.smithi018.stdout:3642 write 0x3185765 thru 0x318d196 (0x7a32 bytes) 2024-09-22T01:36:17.093 INFO:teuthology.orchestra.run.smithi018.stdout:3644 read 0x31ba27b thru 0x31bbfeb (0x1d71 bytes) 2024-09-22T01:36:17.110 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:17.105+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:17.114 INFO:teuthology.orchestra.run.smithi018.stdout:3645 write 0xbe5a6ae thru 0xbe5c2cf (0x1c22 bytes) 2024-09-22T01:36:17.118 INFO:teuthology.orchestra.run.smithi018.stdout:3646 punch from 0x8630a38 to 0x863eb77, (0xe13f bytes) 2024-09-22T01:36:17.131 INFO:teuthology.orchestra.run.smithi018.stdout:3647 writesame 0xd50c36e thru 0xd515051 data_size 0x4(0x8ce4 bytes) 2024-09-22T01:36:17.131 INFO:teuthology.orchestra.run.smithi018.stdout:3648 write 0xb1bf431 thru 0xb1c5b3e (0x670e bytes) 2024-09-22T01:36:17.136 INFO:teuthology.orchestra.run.smithi018.stdout:3649 write 0xadb6663 thru 0xadbb92a (0x52c8 bytes) 2024-09-22T01:36:17.140 INFO:teuthology.orchestra.run.smithi018.stdout:3650 read 0x5e1a64a thru 0x5e23fc9 (0x9980 bytes) 2024-09-22T01:36:17.141 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:17.141 INFO:teuthology.orchestra.run.smithi018.stdout:3653 write 0x95bcfe5 thru 0x95ca05d (0xd079 bytes) 2024-09-22T01:36:17.144 INFO:teuthology.orchestra.run.smithi018.stdout:3654 write 0x7148694 thru 0x7154cb6 (0xc623 bytes) 2024-09-22T01:36:17.147 INFO:teuthology.orchestra.run.smithi018.stdout:3655 write 0xba81d3d thru 0xba83f8c (0x2250 bytes) 2024-09-22T01:36:17.149 INFO:teuthology.orchestra.run.smithi018.stdout:3657 read 0xab19175 thru 0xab235f9 (0xa485 bytes) 2024-09-22T01:36:17.150 INFO:teuthology.orchestra.run.smithi018.stdout:3658 punch from 0x67d448f to 0x67e2986, (0xe4f7 bytes) 2024-09-22T01:36:17.160 INFO:teuthology.orchestra.run.smithi018.stdout:3659 trunc from 0xd515052 to 0x8d45347 2024-09-22T01:36:17.177 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:17.177 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:17.177 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:17.178 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:17.186 INFO:teuthology.orchestra.run.smithi018.stdout:3660 read 0xd8a881 thru 0xd8ce77 (0x25f7 bytes) 2024-09-22T01:36:17.187 INFO:teuthology.orchestra.run.smithi018.stdout:3661 write 0x5924b9d thru 0x592c545 (0x79a9 bytes) 2024-09-22T01:36:17.190 INFO:teuthology.orchestra.run.smithi018.stdout:3662 writesame 0x78ebf46 thru 0x78f4911 data_size 0x2(0x89cc bytes) 2024-09-22T01:36:17.192 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:17.210 INFO:teuthology.orchestra.run.smithi018.stdout:3663 punch from 0x7d0797e to 0x7d116bb, (0x9d3d bytes) 2024-09-22T01:36:17.226 INFO:teuthology.orchestra.run.smithi018.stdout:3666 trunc from 0x8d45347 to 0x34b0d2a 2024-09-22T01:36:17.238 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:17.235+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:17.243 INFO:teuthology.orchestra.run.smithi018.stdout:3667 read 0x32213ca thru 0x322e0c5 (0xccfc bytes) 2024-09-22T01:36:17.246 INFO:teuthology.orchestra.run.smithi018.stdout:3668 trunc from 0x34b0d2a to 0x2c1d938 2024-09-22T01:36:17.263 INFO:teuthology.orchestra.run.smithi018.stdout:3669 punch from 0xd4b767 to 0xd5963e, (0xded7 bytes) 2024-09-22T01:36:17.263 INFO:teuthology.orchestra.run.smithi018.stdout:3670 read 0x280468f thru 0x280da2b (0x939d bytes) 2024-09-22T01:36:17.264 INFO:teuthology.orchestra.run.smithi018.stdout:3673 write 0xc9e7cb thru 0xca5237 (0x6a6d bytes) 2024-09-22T01:36:17.269 INFO:teuthology.orchestra.run.smithi018.stdout:3674 punch from 0x2a6bf24 to 0x2a6e03a, (0x2116 bytes) 2024-09-22T01:36:17.269 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:17.269 INFO:teuthology.orchestra.run.smithi018.stdout:3676 write 0x6ad445 thru 0x6b32b4 (0x5e70 bytes) 2024-09-22T01:36:17.273 INFO:teuthology.orchestra.run.smithi018.stdout:3677 punch from 0x135041a to 0x135e5e7, (0xe1cd bytes) 2024-09-22T01:36:17.273 INFO:teuthology.orchestra.run.smithi018.stdout:3678 punch from 0x2927949 to 0x293184a, (0x9f01 bytes) 2024-09-22T01:36:17.273 INFO:teuthology.orchestra.run.smithi018.stdout:3681 read 0x361fa6 thru 0x363e74 (0x1ecf bytes) 2024-09-22T01:36:17.293 INFO:teuthology.orchestra.run.smithi018.stdout:3682 write 0x59b0c6a thru 0x59b2ab3 (0x1e4a bytes) 2024-09-22T01:36:17.311 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:17.307+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:17.315 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:17.316 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:17.316 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:17.316 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:17.316 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:17.324 INFO:teuthology.orchestra.run.smithi018.stdout:3683 write 0xbf77e03 thru 0xbf7e5e1 (0x67df bytes) 2024-09-22T01:36:17.331 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:17.331 INFO:teuthology.orchestra.run.smithi018.stdout:3685 write 0x4a3db66 thru 0x4a43071 (0x550c bytes) 2024-09-22T01:36:17.338 INFO:teuthology.orchestra.run.smithi018.stdout:3686 trunc from 0xbf7e5e2 to 0xd0fa07f 2024-09-22T01:36:17.351 INFO:teuthology.orchestra.run.smithi018.stdout:3688 read 0x1ef6d76 thru 0x1f02b51 (0xbddc bytes) 2024-09-22T01:36:17.352 INFO:teuthology.orchestra.run.smithi018.stdout:3691 write 0x3e6eff5 thru 0x3e798a5 (0xa8b1 bytes) 2024-09-22T01:36:17.356 INFO:teuthology.orchestra.run.smithi018.stdout:3692 write 0x39490bc thru 0x3955b91 (0xcad6 bytes) 2024-09-22T01:36:17.361 INFO:teuthology.orchestra.run.smithi018.stdout:3695 punch from 0x1d1d51f to 0x1d1ed36, (0x1817 bytes) 2024-09-22T01:36:17.361 INFO:teuthology.orchestra.run.smithi018.stdout:3696 write 0x438e043 thru 0x43981ce (0xa18c bytes) 2024-09-22T01:36:17.363 INFO:teuthology.orchestra.run.smithi018.stdout:3697 write 0xcd04f1d thru 0xcd14969 (0xfa4d bytes) 2024-09-22T01:36:17.370 INFO:teuthology.orchestra.run.smithi018.stdout:3698 write 0x9ee1e65 thru 0x9ee9008 (0x71a4 bytes) 2024-09-22T01:36:17.373 INFO:teuthology.orchestra.run.smithi018.stdout:3701 punch from 0x3796d4b to 0x379d80f, (0x6ac4 bytes) 2024-09-22T01:36:17.373 INFO:teuthology.orchestra.run.smithi018.stdout:3702 write 0x8ba10a7 thru 0x8ba160e (0x568 bytes) 2024-09-22T01:36:17.375 INFO:teuthology.orchestra.run.smithi018.stdout:3704 write 0x58294c9 thru 0x5834269 (0xada1 bytes) 2024-09-22T01:36:17.378 INFO:teuthology.orchestra.run.smithi018.stdout:3705 read 0x529783a thru 0x52a420b (0xc9d2 bytes) 2024-09-22T01:36:17.399 INFO:teuthology.orchestra.run.smithi018.stdout:3706 trunc from 0xd0fa07f to 0x5d91bef 2024-09-22T01:36:17.412 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:17.409+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:17.423 INFO:teuthology.orchestra.run.smithi018.stdout:3707 read 0x48da96a thru 0x48e45dc (0x9c73 bytes) 2024-09-22T01:36:17.424 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:17.424 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:17.424 INFO:teuthology.orchestra.run.smithi018.stdout:3713 writesame 0x29be295 thru 0x29c80bc data_size 0x38(0x9e28 bytes) 2024-09-22T01:36:17.449 INFO:teuthology.orchestra.run.smithi018.stdout:3714 write 0x88ecdf7 thru 0x88f69e3 (0x9bed bytes) 2024-09-22T01:36:17.452 INFO:teuthology.orchestra.run.smithi018.stdout:3715 read 0x39d00d4 thru 0x39df056 (0xef83 bytes) 2024-09-22T01:36:17.453 INFO:teuthology.orchestra.run.smithi018.stdout:3716 write 0x6886f8 thru 0x696329 (0xdc32 bytes) 2024-09-22T01:36:17.456 INFO:teuthology.orchestra.run.smithi018.stdout:3717 punch from 0x1901b17 to 0x1910540, (0xea29 bytes) 2024-09-22T01:36:17.487 INFO:teuthology.orchestra.run.smithi018.stdout:3718 write 0xede15d6 thru 0xede4f32 (0x395d bytes) 2024-09-22T01:36:17.504 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:17.504 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.426270654, 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.505 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:36:17.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.426233625999998, 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:36:17.509 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.414683166000003, 2024-09-22T01:36:17.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.414649159, 2024-09-22T01:36:17.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.410781808999999, 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:36:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:36:17.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.410736260999997, 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.525 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:17.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:36:17.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:36:17.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.410691053000001, 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.529 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:17.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:36:17.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:36:17.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.410656461000002, 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.533 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:36:17.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.410622813000003, 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.537 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:36:17.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.406893322999998, 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.541 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.406856820000002, 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.545 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:17.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:36:17.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.406812180999999, 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.549 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:36:17.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.406761955, 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.553 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:36:17.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.406723513000003, 2024-09-22T01:36:17.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:36:17.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:36:17.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.561 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.406679517999997, 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.406640367999998, 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.402797200000002, 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.570 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:36:17.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.573 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.402716873999999, 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.574 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 48.698163577999999, 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:36:17.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:36:17.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.704022010000003, 2024-09-22T01:36:17.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.584 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:17.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.588 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.589 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:17.590 INFO:teuthology.orchestra.run.smithi018.stdout:3720 trunc from 0xede4f33 to 0x53ee1e9 2024-09-22T01:36:17.590 INFO:teuthology.orchestra.run.smithi018.stdout:3721 writesame 0x51ea577 thru 0x51ec1e0 data_size 0x1(0x1c6a bytes) 2024-09-22T01:36:17.590 INFO:teuthology.orchestra.run.smithi018.stdout:3723 writesame 0xd5de4f8 thru 0xd5e6a3e data_size 0x33(0x8547 bytes) 2024-09-22T01:36:17.590 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:17.590 INFO:teuthology.orchestra.run.smithi018.stdout:3726 read 0xc70fc23 thru 0xc7145aa (0x4988 bytes) 2024-09-22T01:36:17.591 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:17.591 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:17.587+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:17.606 INFO:teuthology.orchestra.run.smithi018.stdout:3728 trunc from 0xd5e6a3f to 0x7348cf7 2024-09-22T01:36:17.622 INFO:teuthology.orchestra.run.smithi018.stdout:3729 write 0xbd6453 thru 0xbd8025 (0x1bd3 bytes) 2024-09-22T01:36:17.626 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:17.626 INFO:teuthology.orchestra.run.smithi018.stdout:3732 write 0x5b4904e thru 0x5b4d88d (0x4840 bytes) 2024-09-22T01:36:17.629 INFO:teuthology.orchestra.run.smithi018.stdout:3733 read 0x4d6a5b4 thru 0x4d6b20c (0xc59 bytes) 2024-09-22T01:36:17.631 INFO:teuthology.orchestra.run.smithi018.stdout:3734 punch from 0x5ffaa2 to 0x607a2b, (0x7f89 bytes) 2024-09-22T01:36:17.631 INFO:teuthology.orchestra.run.smithi018.stdout:3735 read 0xc5a5ca thru 0xc61d77 (0x77ae bytes) 2024-09-22T01:36:17.632 INFO:teuthology.orchestra.run.smithi018.stdout:3736 punch from 0x22dab3f to 0x22e0b0a, (0x5fcb bytes) 2024-09-22T01:36:17.632 INFO:teuthology.orchestra.run.smithi018.stdout:3737 read 0x2681f4b thru 0x2688cb0 (0x6d66 bytes) 2024-09-22T01:36:17.660 INFO:teuthology.orchestra.run.smithi018.stdout:3738 writesame 0xbcdbbe2 thru 0xbcde3f0 data_size 0x7(0x280f bytes) 2024-09-22T01:36:17.660 INFO:teuthology.orchestra.run.smithi018.stdout:3739 punch from 0x9d4c8fb to 0x9d4e77e, (0x1e83 bytes) 2024-09-22T01:36:17.679 INFO:teuthology.orchestra.run.smithi018.stdout:3740 writesame 0xde050d3 thru 0xde06cfd data_size 0x1(0x1c2b bytes) 2024-09-22T01:36:17.679 INFO:teuthology.orchestra.run.smithi018.stdout:3741 writesame 0x4c33d4b thru 0x4c3f828 data_size 0x86(0xbade bytes) 2024-09-22T01:36:17.685 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:36:17.691 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:17.687+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:17.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:17.698 INFO:teuthology.orchestra.run.smithi018.stdout:3742 write 0xe6f85ff thru 0xe702933 (0xa335 bytes) 2024-09-22T01:36:17.706 INFO:teuthology.orchestra.run.smithi018.stdout:3745 punch from 0x3e08a28 to 0x3e134b4, (0xaa8c bytes) 2024-09-22T01:36:17.707 INFO:teuthology.orchestra.run.smithi018.stdout:3746 read 0xd2e3019 thru 0xd2eb5e7 (0x85cf bytes) 2024-09-22T01:36:17.707 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:17.707 INFO:teuthology.orchestra.run.smithi018.stdout:3748 writesame 0xbe7b7f5 thru 0xbe87bf0 data_size 0x94(0xc3fc bytes) 2024-09-22T01:36:17.712 INFO:teuthology.orchestra.run.smithi018.stdout:3749 trunc from 0xe702934 to 0xecbbe54 2024-09-22T01:36:17.720 INFO:teuthology.orchestra.run.smithi018.stdout:3751 read 0x993e202 thru 0x9947f80 (0x9d7f bytes) 2024-09-22T01:36:17.721 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:17.740 INFO:teuthology.orchestra.run.smithi018.stdout:3753 trunc from 0xecbbe54 to 0x35b013e 2024-09-22T01:36:17.773 INFO:teuthology.orchestra.run.smithi018.stdout:3754 write 0x4541069 thru 0x454e0cd (0xd065 bytes) 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:97755 3.15 3:ae5d0d47:::rbd_data.110fe4dbe1e4.0000000000000004:head [stat out=16b,write 14422121~53349 in=53349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:17.774526+0000", 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00073757300000000005, 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00075801799999999995, 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "waiting for sub ops", 2024-09-22T01:36:17.775 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:17.776 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:17.777 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:17.777 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 97755 2024-09-22T01:36:17.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.777 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:17.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.777 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:17.777 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:17.774526+0000", 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:17.774526+0000", 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:17.774528+0000", 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1569999999999998e-06 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:17.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:17.774582+0000", 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4162000000000001e-05 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:17.774611+0000", 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9448999999999999e-05 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:17.774626+0000", 2024-09-22T01:36:17.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4456e-05 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:17.774766+0000", 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014045299999999999 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:17.774902+0000", 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013579900000000001 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:17.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 3", 2024-09-22T01:36:17.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:17.775110+0000", 2024-09-22T01:36:17.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000207908 2024-09-22T01:36:17.781 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.781 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:17.781 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.781 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:17.781 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:36:17.781 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 1 2024-09-22T01:36:17.781 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:17.782 INFO:teuthology.orchestra.run.smithi018.stdout:3755 read 0x1518cd2 thru 0x151bb57 (0x2e86 bytes) 2024-09-22T01:36:17.782 INFO:teuthology.orchestra.run.smithi018.stdout:3757 read 0x32d5416 thru 0x32de7ad (0x9398 bytes) 2024-09-22T01:36:17.782 INFO:teuthology.orchestra.run.smithi018.stdout:3758 trunc from 0x454e0ce to 0x6b8d256 2024-09-22T01:36:17.789 INFO:teuthology.orchestra.run.smithi018.stdout:3759 read 0x61b6ceb thru 0x61b9291 (0x25a7 bytes) 2024-09-22T01:36:17.790 INFO:teuthology.orchestra.run.smithi018.stdout:3760 punch from 0x18f657f to 0x18ffb6c, (0x95ed bytes) 2024-09-22T01:36:17.790 INFO:teuthology.orchestra.run.smithi018.stdout:3761 read 0x659fdf3 thru 0x65a9959 (0x9b67 bytes) 2024-09-22T01:36:17.791 INFO:teuthology.orchestra.run.smithi018.stdout:3762 read 0x1ec0c9e thru 0x1ec4f95 (0x42f8 bytes) 2024-09-22T01:36:17.791 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:17.805 INFO:teuthology.orchestra.run.smithi018.stdout:3763 writesame 0xb2778eb thru 0xb277ea5 data_size 0x3(0x5bb bytes) 2024-09-22T01:36:17.805 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:17.806 INFO:teuthology.orchestra.run.smithi018.stdout:3767 punch from 0x24bd9c9 to 0x24c1392, (0x39c9 bytes) 2024-09-22T01:36:17.806 INFO:teuthology.orchestra.run.smithi018.stdout:3768 write 0x69fff29 thru 0x6a04560 (0x4638 bytes) 2024-09-22T01:36:17.807 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:17.807 INFO:teuthology.orchestra.run.smithi018.stdout:3770 clone 28 order 22 su 1048576 sc 4 2024-09-22T01:36:17.834 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:17.831+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:17.858 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:17.874 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:17.890 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:17.891 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:17.892 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:17.889+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:17.908 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:17.926 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:17.926 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:17.944 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:17.944 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:17.956 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:17.957 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:17.957 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:17.957 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:17.957 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:17.964 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:17.964 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:17.971 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:17.982 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:17.982 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:17.993 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:17.989+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:18.091 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:18.091 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:18.094 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:18.089+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:18.105 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:18.196 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:18.191+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:18.233 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:18.233 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:18.249 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:18.300 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:18.297+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:18.375 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:18.376 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:18.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:18.437 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:18.433+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:18.498 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:18.493+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:18.564 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:18.564 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:18.578 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:18.599 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:18.599+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:18.700 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:18.695+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:18.745 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:18.745 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:18.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:18.799 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7, 0, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:36:18.799 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:36:18.799 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-22T01:36:18.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-22T01:36:18.808 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:18.805+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:18.859 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone27 from 0xb277ea6 (overlap 0x2c1d938) to 0xd3c12a 2024-09-22T01:36:18.897 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:18.897 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:18.901 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:18.895+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:18.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:18.995 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-22T01:36:19.002 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:18.997+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:19.052 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:19.052 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:19.067 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:19.112 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:19.109+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:19.115 INFO:teuthology.orchestra.run.smithi018.stdout:3771 trunc from 0xb277ea6 to 0x19b3e3c 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 94, 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "2d4626ba-577e-46d9-ad53-8451e5733f43", 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-22T01:34:18.722829+0000", 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-22T01:36:18.693526+0000", 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-22T01:34:31.284224+0000", 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-22T01:36:08.612770+0000", 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5804032, 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-22T01:36:19.136 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 3, 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-22T01:36:19.137 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:31.452919+0000", 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:36:19.138 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:36:19.139 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "16", 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:36:19.140 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:36:19.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-22T01:36:19.142 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:36:19.143 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "rbd", 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:36.960578+0000", 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:36:19.144 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:36:19.145 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "20", 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 2, 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 20, 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:36:19.146 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:36:19.147 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:36:19.148 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.9900000095367432, 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.9900000095367432, 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.87999999523162842, 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.149 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "pool_client.0", 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:46.686791+0000", 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:36:19.150 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "94", 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:36:19.151 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 30, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 94, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:36:19.152 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:36:19.153 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-22T01:36:19.154 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "8de621b1-0a3b-4b8b-b982-70e8db073085", 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:19.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 89, 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-22T01:36:19.156 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.157 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/1213730345", 2024-09-22T01:36:19.159 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/1213730345", 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/1213730345", 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/1213730345", 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "798cbd57-ebd4-461a-9bbf-68e683d1049e", 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.4805145263671875, 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:19.160 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 88, 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:19.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:19.162 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3361514324", 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3361514324", 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3361514324", 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3361514324", 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9294585f-3dc9-4b04-8cae-f8d78c92791e", 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:19.165 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 89, 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-22T01:36:19.166 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-22T01:36:19.167 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.168 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/4002178714", 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/4002178714", 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/4002178714", 2024-09-22T01:36:19.170 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/4002178714", 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "1ff1abf7-fdbb-4f8a-85e5-90f102abcec2", 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:19.171 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 84, 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.172 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-22T01:36:19.173 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-22T01:36:19.174 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-22T01:36:19.175 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/2610959301", 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/2610959301", 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/2610959301", 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/2610959301", 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:36:19.176 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9aa2579a-ada1-45f3-9341-f46697c28212", 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 89, 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.177 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6824", 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6825", 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6826", 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:19.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6827", 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6830", 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6831", 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6828", 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.180 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6829", 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6825/482886379", 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6827/482886379", 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6831/482886379", 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6829/482886379", 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:36:19.181 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4a6678eb-28ca-4b05-96ae-e9deeb60ca96", 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 86, 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.182 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6816", 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6817", 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6818", 2024-09-22T01:36:19.183 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6819", 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6822", 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6823", 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6820", 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6821", 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6817/2695689817", 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6819/2695689817", 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6823/2695689817", 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6821/2695689817", 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "775b01e8-5705-4b98-a3ab-f15a78271355", 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 84, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:19.187 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6808", 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6809", 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6810", 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6811", 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6814", 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6815", 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.190 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6812", 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6813", 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6809/1840779137", 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6811/1840779137", 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6815/1840779137", 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6813/1840779137", 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:19.191 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "15f6d6c1-8a16-42c6-9e43-f3a92e511735", 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 83, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:19.192 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6800", 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6801", 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:19.193 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6802", 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6803", 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6806", 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6807", 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6804", 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6805", 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6801/4222842386", 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6803/4222842386", 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6807/4222842386", 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6805/4222842386", 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:19.196 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.339566+0000", 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.197 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.065958+0000", 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:19.198 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.261750+0000", 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.463117+0000", 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:19.199 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.557372+0000", 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.195553+0000", 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.008891+0000", 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:19.201 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:27.839466+0000", 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [ 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "3.8", 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: 0, 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: 2 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-09-22T01:36:19.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "3.3", 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 4, 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 6 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-22T01:36:19.203 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-22T01:36:19.204 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-22T01:36:19.205 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-22T01:36:19.205 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-22T01:36:19.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:19.205 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:19.207 INFO:tasks.thrashosds.thrasher:j is {'epoch': 94, 'fsid': '2d4626ba-577e-46d9-ad53-8451e5733f43', 'created': '2024-09-22T01:34:18.722829+0000', 'modified': '2024-09-22T01:36:18.693526+0000', 'last_up_change': '2024-09-22T01:34:31.284224+0000', 'last_in_change': '2024-09-22T01:36:08.612770+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-22T01:34:31.452919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-22T01:34:36.960578+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-22T01:34:46.686791+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 30, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}], 'osds': [{'osd': 0, 'uuid': '8de621b1-0a3b-4b8b-b982-70e8db073085', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6824', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6825', 'nonce': 1213730345}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6826', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6827', 'nonce': 1213730345}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6830', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6831', 'nonce': 1213730345}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6828', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6829', 'nonce': 1213730345}]}, 'public_addr': '172.21.15.18:6825/1213730345', 'cluster_addr': '172.21.15.18:6827/1213730345', 'heartbeat_back_addr': '172.21.15.18:6831/1213730345', 'heartbeat_front_addr': '172.21.15.18:6829/1213730345', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '798cbd57-ebd4-461a-9bbf-68e683d1049e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.4805145263671875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 88, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6800', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6801', 'nonce': 3361514324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6803', 'nonce': 3361514324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6807', 'nonce': 3361514324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6805', 'nonce': 3361514324}]}, 'public_addr': '172.21.15.18:6801/3361514324', 'cluster_addr': '172.21.15.18:6803/3361514324', 'heartbeat_back_addr': '172.21.15.18:6807/3361514324', 'heartbeat_front_addr': '172.21.15.18:6805/3361514324', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '9294585f-3dc9-4b04-8cae-f8d78c92791e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6817', 'nonce': 4002178714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6818', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6819', 'nonce': 4002178714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6822', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6823', 'nonce': 4002178714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6820', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6821', 'nonce': 4002178714}]}, 'public_addr': '172.21.15.18:6817/4002178714', 'cluster_addr': '172.21.15.18:6819/4002178714', 'heartbeat_back_addr': '172.21.15.18:6823/4002178714', 'heartbeat_front_addr': '172.21.15.18:6821/4002178714', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1ff1abf7-fdbb-4f8a-85e5-90f102abcec2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6809', 'nonce': 2610959301}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6811', 'nonce': 2610959301}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6815', 'nonce': 2610959301}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6813', 'nonce': 2610959301}]}, 'public_addr': '172.21.15.18:6809/2610959301', 'cluster_addr': '172.21.15.18:6811/2610959301', 'heartbeat_back_addr': '172.21.15.18:6815/2610959301', 'heartbeat_front_addr': '172.21.15.18:6813/2610959301', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '9aa2579a-ada1-45f3-9341-f46697c28212', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6824', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6825', 'nonce': 482886379}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6826', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6827', 'nonce': 482886379}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6830', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6831', 'nonce': 482886379}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6828', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6829', 'nonce': 482886379}]}, 'public_addr': '172.21.15.179:6825/482886379', 'cluster_addr': '172.21.15.179:6827/482886379', 'heartbeat_back_addr': '172.21.15.179:6831/482886379', 'heartbeat_front_addr': '172.21.15.179:6829/482886379', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4a6678eb-28ca-4b05-96ae-e9deeb60ca96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6816', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6817', 'nonce': 2695689817}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6818', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6819', 'nonce': 2695689817}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6822', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6823', 'nonce': 2695689817}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6820', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6821', 'nonce': 2695689817}]}, 'public_addr': '172.21.15.179:6817/2695689817', 'cluster_addr': '172.21.15.179:6819/2695689817', 'heartbeat_back_addr': '172.21.15.179:6823/2695689817', 'heartbeat_front_addr': '172.21.15.179:6821/2695689817', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '775b01e8-5705-4b98-a3ab-f15a78271355', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6808', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6809', 'nonce': 1840779137}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6810', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6811', 'nonce': 1840779137}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6814', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6815', 'nonce': 1840779137}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6812', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6813', 'nonce': 1840779137}]}, 'public_addr': '172.21.15.179:6809/1840779137', 'cluster_addr': '172.21.15.179:6811/1840779137', 'heartbeat_back_addr': '172.21.15.179:6815/1840779137', 'heartbeat_front_addr': '172.21.15.179:6813/1840779137', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '15f6d6c1-8a16-42c6-9e43-f3a92e511735', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6800', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6801', 'nonce': 4222842386}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6802', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6803', 'nonce': 4222842386}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6806', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6807', 'nonce': 4222842386}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6804', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6805', 'nonce': 4222842386}]}, 'public_addr': '172.21.15.179:6801/4222842386', 'cluster_addr': '172.21.15.179:6803/4222842386', 'heartbeat_back_addr': '172.21.15.179:6807/4222842386', 'heartbeat_front_addr': '172.21.15.179:6805/4222842386', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.339566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.065958+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.261750+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.463117+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.557372+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.195553+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.008891+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:27.839466+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.8', 'osds': [0, 2]}], 'pg_upmap_items': [{'pgid': '3.3', 'mappings': [{'from': 4, 'to': 6}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-22T01:36:19.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:36:19.207 INFO:teuthology.orchestra.run.smithi018.stdout:3772 write 0x7a88960 thru 0x7a942d6 (0xb977 bytes) 2024-09-22T01:36:19.208 INFO:teuthology.orchestra.run.smithi018.stdout:3773 write 0xa1774e7 thru 0xa182e10 (0xb92a bytes) 2024-09-22T01:36:19.208 INFO:teuthology.orchestra.run.smithi018.stdout:3774 read 0x2346c42 thru 0x234d0ee (0x64ad bytes) 2024-09-22T01:36:19.208 INFO:teuthology.orchestra.run.smithi018.stdout:3776 read 0x45352ac thru 0x453c681 (0x73d6 bytes) 2024-09-22T01:36:19.208 INFO:teuthology.orchestra.run.smithi018.stdout:3777 punch from 0x61ccac5 to 0x61d644c, (0x9987 bytes) 2024-09-22T01:36:19.208 INFO:teuthology.orchestra.run.smithi018.stdout:3778 write 0x6c1f587 thru 0x6c29a3f (0xa4b9 bytes) 2024-09-22T01:36:19.208 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:19.203+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:19.212 INFO:teuthology.orchestra.run.smithi018.stdout:3780 trunc from 0xa182e11 to 0x61973d4 2024-09-22T01:36:19.233 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:19.233 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:19.234 INFO:teuthology.orchestra.run.smithi018.stdout:3785 read 0xf57605 thru 0xf5763a (0x36 bytes) 2024-09-22T01:36:19.249 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:19.249 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:19.256 INFO:teuthology.orchestra.run.smithi018.stdout:3786 write 0xb4f4eb2 thru 0xb4fdd95 (0x8ee4 bytes) 2024-09-22T01:36:19.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:19.267 INFO:teuthology.orchestra.run.smithi018.stdout:3787 trunc from 0xb4fdd96 to 0x7d81258 2024-09-22T01:36:19.288 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:19.288 INFO:teuthology.orchestra.run.smithi018.stdout:3790 read 0x5e0bfe5 thru 0x5e17321 (0xb33d bytes) 2024-09-22T01:36:19.288 INFO:teuthology.orchestra.run.smithi018.stdout:3791 read 0x71caf51 thru 0x71cb06f (0x11f bytes) 2024-09-22T01:36:19.288 INFO:teuthology.orchestra.run.smithi018.stdout:3792 punch from 0x24af900 to 0x24baa87, (0xb187 bytes) 2024-09-22T01:36:19.294 INFO:teuthology.orchestra.run.smithi018.stdout:3793 trunc from 0x7d81258 to 0xbf2a4d1 2024-09-22T01:36:19.306 INFO:teuthology.orchestra.run.smithi018.stdout:3794 read 0x2221b9c thru 0x2225284 (0x36e9 bytes) 2024-09-22T01:36:19.306 INFO:teuthology.orchestra.run.smithi018.stdout:3796 read 0x4ab87e2 thru 0x4abb9cb (0x31ea bytes) 2024-09-22T01:36:19.306 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:19.306 INFO:teuthology.orchestra.run.smithi018.stdout:3799 writesame 0x9ee5907 thru 0x9ef0ab5 data_size 0x1(0xb1af bytes) 2024-09-22T01:36:19.307 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:19.301+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:19.371 INFO:teuthology.orchestra.run.smithi018.stdout:3801 read 0x34066e2 thru 0x340d16b (0x6a8a bytes) 2024-09-22T01:36:19.371 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:19.379 INFO:teuthology.orchestra.run.smithi018.stdout:3803 trunc from 0xbf2a4d1 to 0x6ea1770 2024-09-22T01:36:19.394 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:19.394 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:19.401 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:19.408 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:19.405+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:19.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:19.424 INFO:teuthology.orchestra.run.smithi018.stdout:3806 write 0xc6449f4 thru 0xc64742a (0x2a37 bytes) 2024-09-22T01:36:19.431 INFO:teuthology.orchestra.run.smithi018.stdout:3808 read 0x26d22d7 thru 0x26dea06 (0xc730 bytes) 2024-09-22T01:36:19.431 INFO:teuthology.orchestra.run.smithi018.stdout:3810 read 0x16536d2 thru 0x1661612 (0xdf41 bytes) 2024-09-22T01:36:19.432 INFO:teuthology.orchestra.run.smithi018.stdout:3811 writesame 0xb7951a6 thru 0xb7a03cc data_size 0x1(0xb227 bytes) 2024-09-22T01:36:19.467 INFO:teuthology.orchestra.run.smithi018.stdout:3813 write 0x6c7558c thru 0x6c82e57 (0xd8cc bytes) 2024-09-22T01:36:19.469 INFO:teuthology.orchestra.run.smithi018.stdout:3814 writesame 0x617a34b thru 0x6185c39 data_size 0x3(0xb8ef bytes) 2024-09-22T01:36:19.484 INFO:teuthology.orchestra.run.smithi018.stdout:3815 read 0x57f7208 thru 0x5804a2c (0xd825 bytes) 2024-09-22T01:36:19.493 INFO:teuthology.orchestra.run.smithi018.stdout:3816 trunc from 0xc64742b to 0x8572451 2024-09-22T01:36:19.508 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:19.503+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:19.515 INFO:teuthology.orchestra.run.smithi018.stdout:3817 read 0x39063e7 thru 0x390aebb (0x4ad5 bytes) 2024-09-22T01:36:19.515 INFO:teuthology.orchestra.run.smithi018.stdout:3818 write 0x80ee8d4 thru 0x80fcfae (0xe6db bytes) 2024-09-22T01:36:19.522 INFO:teuthology.orchestra.run.smithi018.stdout:3819 punch from 0x499480b to 0x4994bec, (0x3e1 bytes) 2024-09-22T01:36:19.522 INFO:teuthology.orchestra.run.smithi018.stdout:3820 writesame 0x6794040 thru 0x6797e36 data_size 0x1(0x3df7 bytes) 2024-09-22T01:36:19.538 INFO:teuthology.orchestra.run.smithi018.stdout:3822 punch from 0x5d033ce to 0x5d12aa1, (0xf6d3 bytes) 2024-09-22T01:36:19.538 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:19.538 INFO:teuthology.orchestra.run.smithi018.stdout:3824 read 0x60068fa thru 0x600b668 (0x4d6f bytes) 2024-09-22T01:36:19.539 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:19.539 INFO:teuthology.orchestra.run.smithi018.stdout:3828 punch from 0x7baa2ac to 0x7bad4ed, (0x3241 bytes) 2024-09-22T01:36:19.539 INFO:teuthology.orchestra.run.smithi018.stdout:3829 punch from 0x1777428 to 0x1782c5b, (0xb833 bytes) 2024-09-22T01:36:19.539 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:19.554 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:36:19.555 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:36:19.556 INFO:teuthology.orchestra.run.smithi018.stdout:3831 writesame 0xa8bbc5c thru 0xa8c641f data_size 0x12(0xa7c4 bytes) 2024-09-22T01:36:19.558 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:19.558 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:19.571 INFO:teuthology.orchestra.run.smithi018.stdout:3832 write 0xc094222 thru 0xc099656 (0x5435 bytes) 2024-09-22T01:36:19.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:19.577 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-22T01:36:19.404601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190465257,"num_objects":1135,"num_object_clones":391,"num_object_copies":2270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1135,"num_whiteouts":338,"num_read":117893,"num_read_kb":380596,"num_write":10569,"num_write_kb":189796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2207,"num_bytes_recovered":148398555,"num_keys_recovered":430,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8808,"ondisk_log_size":8808,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":525984,"kb_used_data":245952,"kb_used_omap":12,"kb_used_meta":279859,"kb_avail":754448736,"statfs":{"total":773094113280,"available":772555505664,"internally_reserved":0,"allocated":251854848,"data_stored":343728940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":286576176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":58894356,"num_objects":37,"num_object_clones":21,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":5,"num_read":2421,"num_read_kb":5917,"num_write":603,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.735038"},"pg_stats":[{"pgid":"3.1f","version":"90'236","reported_seq":2608,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.686637+0000","last_change":"2024-09-22T01:36:06.627109+0000","last_active":"2024-09-22T01:36:16.686637+0000","last_peered":"2024-09-22T01:36:16.686637+0000","last_clean":"2024-09-22T01:36:16.686637+0000","last_became_active":"2024-09-22T01:36:06.623922+0000","last_became_peered":"2024-09-22T01:36:06.623922+0000","last_unstale":"2024-09-22T01:36:16.686637+0000","last_undegraded":"2024-09-22T01:36:16.686637+0000","last_fullsized":"2024-09-22T01:36:16.686637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:25:20.069960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001437504,"stat_sum":{"num_bytes":6929553,"num_objects":25,"num_object_clones":9,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":8,"num_read":2782,"num_read_kb":4863,"num_write":322,"num_write_kb":2699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3071623,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"91'293","reported_seq":1984,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.680269+0000","last_change":"2024-09-22T01:34:50.528432+0000","last_active":"2024-09-22T01:36:16.680269+0000","last_peered":"2024-09-22T01:36:16.680269+0000","last_clean":"2024-09-22T01:36:16.680269+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:36:16.680269+0000","last_undegraded":"2024-09-22T01:36:16.680269+0000","last_fullsized":"2024-09-22T01:36:16.680269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:14:29.365141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00178118,"stat_sum":{"num_bytes":43733034,"num_objects":31,"num_object_clones":10,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":6,"num_read":3321,"num_read_kb":6044,"num_write":309,"num_write_kb":3265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"91'259","reported_seq":737,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.692561+0000","last_change":"2024-09-22T01:34:50.542416+0000","last_active":"2024-09-22T01:36:16.692561+0000","last_peered":"2024-09-22T01:36:16.692561+0000","last_clean":"2024-09-22T01:36:16.692561+0000","last_became_active":"2024-09-22T01:34:48.547909+0000","last_became_peered":"2024-09-22T01:34:48.547909+0000","last_unstale":"2024-09-22T01:36:16.692561+0000","last_undegraded":"2024-09-22T01:36:16.692561+0000","last_fullsized":"2024-09-22T01:36:16.692561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:33:08.776710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031538109999999999,"stat_sum":{"num_bytes":44290828,"num_objects":33,"num_object_clones":12,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":10,"num_read":1008,"num_read_kb":9829,"num_write":333,"num_write_kb":5109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"92'128","reported_seq":801,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.751193+0000","last_change":"2024-09-22T01:34:50.541509+0000","last_active":"2024-09-22T01:36:16.751193+0000","last_peered":"2024-09-22T01:36:16.751193+0000","last_clean":"2024-09-22T01:36:16.751193+0000","last_became_active":"2024-09-22T01:34:48.546869+0000","last_became_peered":"2024-09-22T01:34:48.546869+0000","last_unstale":"2024-09-22T01:36:16.751193+0000","last_undegraded":"2024-09-22T01:36:16.751193+0000","last_fullsized":"2024-09-22T01:36:16.751193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:17:50.943545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025435940000000001,"stat_sum":{"num_bytes":13146474,"num_objects":17,"num_object_clones":6,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":5,"num_read":584,"num_read_kb":2252,"num_write":122,"num_write_kb":1407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"92'882","reported_seq":3149,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.850437+0000","last_change":"2024-09-22T01:36:07.627276+0000","last_active":"2024-09-22T01:36:16.850437+0000","last_peered":"2024-09-22T01:36:16.850437+0000","last_clean":"2024-09-22T01:36:16.850437+0000","last_became_active":"2024-09-22T01:36:07.623588+0000","last_became_peered":"2024-09-22T01:36:07.623588+0000","last_unstale":"2024-09-22T01:36:16.850437+0000","last_undegraded":"2024-09-22T01:36:16.850437+0000","last_fullsized":"2024-09-22T01:36:16.850437+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:52:01.758187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015758949999999999,"stat_sum":{"num_bytes":48041271,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":13,"num_read":6998,"num_read_kb":10436,"num_write":1405,"num_write_kb":8614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":13691067,"num_keys_recovered":116,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"91'263","reported_seq":2722,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.814341+0000","last_change":"2024-09-22T01:34:50.527581+0000","last_active":"2024-09-22T01:36:16.814341+0000","last_peered":"2024-09-22T01:36:16.814341+0000","last_clean":"2024-09-22T01:36:16.814341+0000","last_became_active":"2024-09-22T01:34:48.539769+0000","last_became_peered":"2024-09-22T01:34:48.539769+0000","last_unstale":"2024-09-22T01:36:16.814341+0000","last_undegraded":"2024-09-22T01:36:16.814341+0000","last_fullsized":"2024-09-22T01:36:16.814341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:48:05.685403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088464700000000002,"stat_sum":{"num_bytes":36484872,"num_objects":54,"num_object_clones":18,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":2920,"num_read_kb":12676,"num_write":318,"num_write_kb":6645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"92'674","reported_seq":8164,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.678591+0000","last_change":"2024-09-22T01:34:50.534647+0000","last_active":"2024-09-22T01:36:16.678591+0000","last_peered":"2024-09-22T01:36:16.678591+0000","last_clean":"2024-09-22T01:36:16.678591+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:36:16.678591+0000","last_undegraded":"2024-09-22T01:36:16.678591+0000","last_fullsized":"2024-09-22T01:36:16.678591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:00:14.994365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039451500000000001,"stat_sum":{"num_bytes":86749750,"num_objects":48,"num_object_clones":18,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":10,"num_read":9696,"num_read_kb":52198,"num_write":987,"num_write_kb":17115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"92'103","reported_seq":1072,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.679612+0000","last_change":"2024-09-22T01:36:03.611788+0000","last_active":"2024-09-22T01:36:16.679612+0000","last_peered":"2024-09-22T01:36:16.679612+0000","last_clean":"2024-09-22T01:36:16.679612+0000","last_became_active":"2024-09-22T01:36:03.522736+0000","last_became_peered":"2024-09-22T01:36:03.522736+0000","last_unstale":"2024-09-22T01:36:16.679612+0000","last_undegraded":"2024-09-22T01:36:16.679612+0000","last_fullsized":"2024-09-22T01:36:16.679612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:43:47.448303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133074,"stat_sum":{"num_bytes":29378566,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":8,"num_read":701,"num_read_kb":6340,"num_write":95,"num_write_kb":1277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1215906,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"92'250","reported_seq":3784,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.686274+0000","last_change":"2024-09-22T01:36:06.627125+0000","last_active":"2024-09-22T01:36:16.686274+0000","last_peered":"2024-09-22T01:36:16.686274+0000","last_clean":"2024-09-22T01:36:16.686274+0000","last_became_active":"2024-09-22T01:36:06.623688+0000","last_became_peered":"2024-09-22T01:36:06.623688+0000","last_unstale":"2024-09-22T01:36:16.686274+0000","last_undegraded":"2024-09-22T01:36:16.686274+0000","last_fullsized":"2024-09-22T01:36:16.686274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:57:19.826972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015742040000000001,"stat_sum":{"num_bytes":19307711,"num_objects":42,"num_object_clones":15,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":4291,"num_read_kb":18767,"num_write":220,"num_write_kb":11233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":9440366,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"92'379","reported_seq":12537,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.692578+0000","last_change":"2024-09-22T01:36:00.567710+0000","last_active":"2024-09-22T01:36:16.692578+0000","last_peered":"2024-09-22T01:36:16.692578+0000","last_clean":"2024-09-22T01:36:16.692578+0000","last_became_active":"2024-09-22T01:36:00.566214+0000","last_became_peered":"2024-09-22T01:36:00.566214+0000","last_unstale":"2024-09-22T01:36:16.692578+0000","last_undegraded":"2024-09-22T01:36:16.692578+0000","last_fullsized":"2024-09-22T01:36:16.692578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:00:15.942375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000879137,"stat_sum":{"num_bytes":75276895,"num_objects":56,"num_object_clones":23,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":16,"num_read":12500,"num_read_kb":27520,"num_write":437,"num_write_kb":7069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":10027868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"91'128","reported_seq":3734,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.735070+0000","last_change":"2024-09-22T01:36:00.575390+0000","last_active":"2024-09-22T01:36:16.735070+0000","last_peered":"2024-09-22T01:36:16.735070+0000","last_clean":"2024-09-22T01:36:16.735070+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:36:16.735070+0000","last_undegraded":"2024-09-22T01:36:16.735070+0000","last_fullsized":"2024-09-22T01:36:16.735070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:09:01.260493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016832139999999999,"stat_sum":{"num_bytes":24137538,"num_objects":35,"num_object_clones":14,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":13,"num_read":3304,"num_read_kb":15225,"num_write":106,"num_write_kb":2501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"92'216","reported_seq":4306,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.677739+0000","last_change":"2024-09-22T01:36:00.566907+0000","last_active":"2024-09-22T01:36:16.677739+0000","last_peered":"2024-09-22T01:36:16.677739+0000","last_clean":"2024-09-22T01:36:16.677739+0000","last_became_active":"2024-09-22T01:36:00.564509+0000","last_became_peered":"2024-09-22T01:36:00.564509+0000","last_unstale":"2024-09-22T01:36:16.677739+0000","last_undegraded":"2024-09-22T01:36:16.677739+0000","last_fullsized":"2024-09-22T01:36:16.677739+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:01:47.479723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092607900000000001,"stat_sum":{"num_bytes":18880238,"num_objects":37,"num_object_clones":12,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":4679,"num_read_kb":16441,"num_write":193,"num_write_kb":3721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":5198452,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.796441+0000","last_change":"2024-09-22T01:35:57.529367+0000","last_active":"2024-09-22T01:36:16.796441+0000","last_peered":"2024-09-22T01:36:16.796441+0000","last_clean":"2024-09-22T01:36:16.796441+0000","last_became_active":"2024-09-22T01:35:57.528484+0000","last_became_peered":"2024-09-22T01:35:57.528484+0000","last_unstale":"2024-09-22T01:36:16.796441+0000","last_undegraded":"2024-09-22T01:36:16.796441+0000","last_fullsized":"2024-09-22T01:36:16.796441+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:00.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"91'217","reported_seq":3508,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.685678+0000","last_change":"2024-09-22T01:36:06.619666+0000","last_active":"2024-09-22T01:36:16.685678+0000","last_peered":"2024-09-22T01:36:16.685678+0000","last_clean":"2024-09-22T01:36:16.685678+0000","last_became_active":"2024-09-22T01:36:06.618495+0000","last_became_peered":"2024-09-22T01:36:06.618495+0000","last_unstale":"2024-09-22T01:36:16.685678+0000","last_undegraded":"2024-09-22T01:36:16.685678+0000","last_fullsized":"2024-09-22T01:36:16.685678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:22:11.348684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014179189999999999,"stat_sum":{"num_bytes":73971986,"num_objects":50,"num_object_clones":21,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":18,"num_read":3280,"num_read_kb":24315,"num_write":190,"num_write_kb":22445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":25063433,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":163,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.678657+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:36:16.678657+0000","last_peered":"2024-09-22T01:36:16.678657+0000","last_clean":"2024-09-22T01:36:16.678657+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:36:16.678657+0000","last_undegraded":"2024-09-22T01:36:16.678657+0000","last_fullsized":"2024-09-22T01:36:16.678657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"92'180","reported_seq":1403,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.680041+0000","last_change":"2024-09-22T01:36:00.568511+0000","last_active":"2024-09-22T01:36:16.680041+0000","last_peered":"2024-09-22T01:36:16.680041+0000","last_clean":"2024-09-22T01:36:16.680041+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:36:16.680041+0000","last_undegraded":"2024-09-22T01:36:16.680041+0000","last_fullsized":"2024-09-22T01:36:16.680041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:18:48.832911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001738353,"stat_sum":{"num_bytes":26502191,"num_objects":29,"num_object_clones":7,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":6,"num_read":1182,"num_read_kb":3973,"num_write":195,"num_write_kb":1496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.734714+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:36:16.734714+0000","last_peered":"2024-09-22T01:36:16.734714+0000","last_clean":"2024-09-22T01:36:16.734714+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:36:16.734714+0000","last_undegraded":"2024-09-22T01:36:16.734714+0000","last_fullsized":"2024-09-22T01:36:16.734714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"92'212","reported_seq":1490,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.697196+0000","last_change":"2024-09-22T01:36:12.662809+0000","last_active":"2024-09-22T01:36:16.697196+0000","last_peered":"2024-09-22T01:36:16.697196+0000","last_clean":"2024-09-22T01:36:16.697196+0000","last_became_active":"2024-09-22T01:36:12.660207+0000","last_became_peered":"2024-09-22T01:36:12.660207+0000","last_unstale":"2024-09-22T01:36:16.697196+0000","last_undegraded":"2024-09-22T01:36:16.697196+0000","last_fullsized":"2024-09-22T01:36:16.697196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:10:17.379677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078463999999999997,"stat_sum":{"num_bytes":46985336,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":9,"num_read":1947,"num_read_kb":9807,"num_write":226,"num_write_kb":6700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.685034+0000","last_change":"2024-09-22T01:36:03.520390+0000","last_active":"2024-09-22T01:36:16.685034+0000","last_peered":"2024-09-22T01:36:16.685034+0000","last_clean":"2024-09-22T01:36:16.685034+0000","last_became_active":"2024-09-22T01:36:03.519493+0000","last_became_peered":"2024-09-22T01:36:03.519493+0000","last_unstale":"2024-09-22T01:36:16.685034+0000","last_undegraded":"2024-09-22T01:36:16.685034+0000","last_fullsized":"2024-09-22T01:36:16.685034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:25:49.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"92'211","reported_seq":3964,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.839153+0000","last_change":"2024-09-22T01:34:50.542664+0000","last_active":"2024-09-22T01:36:16.839153+0000","last_peered":"2024-09-22T01:36:16.839153+0000","last_clean":"2024-09-22T01:36:16.839153+0000","last_became_active":"2024-09-22T01:34:48.544812+0000","last_became_peered":"2024-09-22T01:34:48.544812+0000","last_unstale":"2024-09-22T01:36:16.839153+0000","last_undegraded":"2024-09-22T01:36:16.839153+0000","last_fullsized":"2024-09-22T01:36:16.839153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:53:58.125899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032535960000000001,"stat_sum":{"num_bytes":47980605,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":11,"num_read":3999,"num_read_kb":12347,"num_write":237,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"88'115","reported_seq":436,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.796435+0000","last_change":"2024-09-22T01:36:07.624756+0000","last_active":"2024-09-22T01:36:16.796435+0000","last_peered":"2024-09-22T01:36:16.796435+0000","last_clean":"2024-09-22T01:36:16.796435+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:36:16.796435+0000","last_undegraded":"2024-09-22T01:36:16.796435+0000","last_fullsized":"2024-09-22T01:36:16.796435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:00.036432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010842180000000001,"stat_sum":{"num_bytes":4244156,"num_objects":29,"num_object_clones":10,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":10,"num_read":778,"num_read_kb":4864,"num_write":109,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":165,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.692347+0000","last_change":"2024-09-22T01:34:40.376225+0000","last_active":"2024-09-22T01:36:16.692347+0000","last_peered":"2024-09-22T01:36:16.692347+0000","last_clean":"2024-09-22T01:36:16.692347+0000","last_became_active":"2024-09-22T01:34:38.360269+0000","last_became_peered":"2024-09-22T01:34:38.360269+0000","last_unstale":"2024-09-22T01:36:16.692347+0000","last_undegraded":"2024-09-22T01:36:16.692347+0000","last_fullsized":"2024-09-22T01:36:16.692347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:12:20.227363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023923949999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"90'143","reported_seq":1517,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.697048+0000","last_change":"2024-09-22T01:36:12.664313+0000","last_active":"2024-09-22T01:36:16.697048+0000","last_peered":"2024-09-22T01:36:16.697048+0000","last_clean":"2024-09-22T01:36:16.697048+0000","last_became_active":"2024-09-22T01:36:12.660339+0000","last_became_peered":"2024-09-22T01:36:12.660339+0000","last_unstale":"2024-09-22T01:36:16.697048+0000","last_undegraded":"2024-09-22T01:36:16.697048+0000","last_fullsized":"2024-09-22T01:36:16.697048+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:48:35.254293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050027299999999997,"stat_sum":{"num_bytes":6209141,"num_objects":28,"num_object_clones":10,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":12,"num_read":1426,"num_read_kb":1684,"num_write":150,"num_write_kb":2016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.696965+0000","last_change":"2024-09-22T01:36:09.627096+0000","last_active":"2024-09-22T01:36:16.696965+0000","last_peered":"2024-09-22T01:36:16.696965+0000","last_clean":"2024-09-22T01:36:16.696965+0000","last_became_active":"2024-09-22T01:36:09.626669+0000","last_became_peered":"2024-09-22T01:36:09.626669+0000","last_unstale":"2024-09-22T01:36:16.696965+0000","last_undegraded":"2024-09-22T01:36:16.696965+0000","last_fullsized":"2024-09-22T01:36:16.696965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:35.787005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"90'353","reported_seq":1597,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.685027+0000","last_change":"2024-09-22T01:36:07.626478+0000","last_active":"2024-09-22T01:36:16.685027+0000","last_peered":"2024-09-22T01:36:16.685027+0000","last_clean":"2024-09-22T01:36:16.685027+0000","last_became_active":"2024-09-22T01:36:07.624550+0000","last_became_peered":"2024-09-22T01:36:07.624550+0000","last_unstale":"2024-09-22T01:36:16.685027+0000","last_undegraded":"2024-09-22T01:36:16.685027+0000","last_fullsized":"2024-09-22T01:36:16.685027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:51:10.692047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00150643,"stat_sum":{"num_bytes":23356436,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":12,"num_read":2881,"num_read_kb":9667,"num_write":406,"num_write_kb":4071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":4737369,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.734703+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:36:16.734703+0000","last_peered":"2024-09-22T01:36:16.734703+0000","last_clean":"2024-09-22T01:36:16.734703+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:36:16.734703+0000","last_undegraded":"2024-09-22T01:36:16.734703+0000","last_fullsized":"2024-09-22T01:36:16.734703+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"90'134","reported_seq":624,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.679648+0000","last_change":"2024-09-22T01:34:50.527359+0000","last_active":"2024-09-22T01:36:16.679648+0000","last_peered":"2024-09-22T01:36:16.679648+0000","last_clean":"2024-09-22T01:36:16.679648+0000","last_became_active":"2024-09-22T01:34:48.535726+0000","last_became_peered":"2024-09-22T01:34:48.535726+0000","last_unstale":"2024-09-22T01:36:16.679648+0000","last_undegraded":"2024-09-22T01:36:16.679648+0000","last_fullsized":"2024-09-22T01:36:16.679648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:27:02.393042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075466699999999999,"stat_sum":{"num_bytes":17614652,"num_objects":36,"num_object_clones":13,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":15,"num_read":379,"num_read_kb":5022,"num_write":115,"num_write_kb":2392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":200,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.692350+0000","last_change":"2024-09-22T01:36:09.635008+0000","last_active":"2024-09-22T01:36:16.692350+0000","last_peered":"2024-09-22T01:36:16.692350+0000","last_clean":"2024-09-22T01:36:16.692350+0000","last_became_active":"2024-09-22T01:36:09.630836+0000","last_became_peered":"2024-09-22T01:36:09.630836+0000","last_unstale":"2024-09-22T01:36:16.692350+0000","last_undegraded":"2024-09-22T01:36:16.692350+0000","last_fullsized":"2024-09-22T01:36:16.692350+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:55:23.262665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":292,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.734540+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:36:16.734540+0000","last_peered":"2024-09-22T01:36:16.734540+0000","last_clean":"2024-09-22T01:36:16.734540+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:36:16.734540+0000","last_undegraded":"2024-09-22T01:36:16.734540+0000","last_fullsized":"2024-09-22T01:36:16.734540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"92'430","reported_seq":836,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.793838+0000","last_change":"2024-09-22T01:36:12.660724+0000","last_active":"2024-09-22T01:36:16.793838+0000","last_peered":"2024-09-22T01:36:16.793838+0000","last_clean":"2024-09-22T01:36:16.793838+0000","last_became_active":"2024-09-22T01:36:12.656444+0000","last_became_peered":"2024-09-22T01:36:12.656444+0000","last_unstale":"2024-09-22T01:36:16.793838+0000","last_undegraded":"2024-09-22T01:36:16.793838+0000","last_fullsized":"2024-09-22T01:36:16.793838+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:56:03.191567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001463764,"stat_sum":{"num_bytes":27958786,"num_objects":34,"num_object_clones":12,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":5452,"num_read_kb":11879,"num_write":630,"num_write_kb":3298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":3997078,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"92'289","reported_seq":2270,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.677739+0000","last_change":"2024-09-22T01:36:12.659736+0000","last_active":"2024-09-22T01:36:16.677739+0000","last_peered":"2024-09-22T01:36:16.677739+0000","last_clean":"2024-09-22T01:36:16.677739+0000","last_became_active":"2024-09-22T01:36:12.658535+0000","last_became_peered":"2024-09-22T01:36:12.658535+0000","last_unstale":"2024-09-22T01:36:16.677739+0000","last_undegraded":"2024-09-22T01:36:16.677739+0000","last_fullsized":"2024-09-22T01:36:16.677739+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:00:43.944748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093062799999999997,"stat_sum":{"num_bytes":40081065,"num_objects":38,"num_object_clones":14,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":12,"num_read":1682,"num_read_kb":3141,"num_write":307,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2982858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"92'298","reported_seq":12477,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.796527+0000","last_change":"2024-09-22T01:34:50.552879+0000","last_active":"2024-09-22T01:36:16.796527+0000","last_peered":"2024-09-22T01:36:16.796527+0000","last_clean":"2024-09-22T01:36:16.796527+0000","last_became_active":"2024-09-22T01:34:48.551682+0000","last_became_peered":"2024-09-22T01:34:48.551682+0000","last_unstale":"2024-09-22T01:36:16.796527+0000","last_undegraded":"2024-09-22T01:36:16.796527+0000","last_fullsized":"2024-09-22T01:36:16.796527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:39:32.185297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013073900000000001,"stat_sum":{"num_bytes":83418140,"num_objects":42,"num_object_clones":13,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":13,"num_read":13946,"num_read_kb":17141,"num_write":303,"num_write_kb":10702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"90'220","reported_seq":1422,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.679636+0000","last_change":"2024-09-22T01:36:07.624543+0000","last_active":"2024-09-22T01:36:16.679636+0000","last_peered":"2024-09-22T01:36:16.679636+0000","last_clean":"2024-09-22T01:36:16.679636+0000","last_became_active":"2024-09-22T01:36:07.622932+0000","last_became_peered":"2024-09-22T01:36:07.622932+0000","last_unstale":"2024-09-22T01:36:16.679636+0000","last_undegraded":"2024-09-22T01:36:16.679636+0000","last_fullsized":"2024-09-22T01:36:16.679636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:14.425267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000665578,"stat_sum":{"num_bytes":18933722,"num_objects":25,"num_object_clones":8,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":8,"num_read":1694,"num_read_kb":5559,"num_write":270,"num_write_kb":4685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":4742308,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"91'266","reported_seq":2234,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.692621+0000","last_change":"2024-09-22T01:34:50.541507+0000","last_active":"2024-09-22T01:36:16.692621+0000","last_peered":"2024-09-22T01:36:16.692621+0000","last_clean":"2024-09-22T01:36:16.692621+0000","last_became_active":"2024-09-22T01:34:48.544792+0000","last_became_peered":"2024-09-22T01:34:48.544792+0000","last_unstale":"2024-09-22T01:36:16.692621+0000","last_undegraded":"2024-09-22T01:36:16.692621+0000","last_fullsized":"2024-09-22T01:36:16.692621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:06:13.025702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002331039,"stat_sum":{"num_bytes":67669327,"num_objects":41,"num_object_clones":15,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":13,"num_read":2653,"num_read_kb":6842,"num_write":282,"num_write_kb":3098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"92'293","reported_seq":2497,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.839932+0000","last_change":"2024-09-22T01:36:00.573813+0000","last_active":"2024-09-22T01:36:16.839932+0000","last_peered":"2024-09-22T01:36:16.839932+0000","last_clean":"2024-09-22T01:36:16.839932+0000","last_became_active":"2024-09-22T01:36:00.571500+0000","last_became_peered":"2024-09-22T01:36:00.571500+0000","last_unstale":"2024-09-22T01:36:16.839932+0000","last_undegraded":"2024-09-22T01:36:16.839932+0000","last_fullsized":"2024-09-22T01:36:16.839932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:43:58.070376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015841550000000001,"stat_sum":{"num_bytes":43037541,"num_objects":35,"num_object_clones":13,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":8,"num_read":3492,"num_read_kb":6053,"num_write":360,"num_write_kb":3270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":3937469,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"92'231","reported_seq":2005,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.734795+0000","last_change":"2024-09-22T01:36:00.569408+0000","last_active":"2024-09-22T01:36:16.734795+0000","last_peered":"2024-09-22T01:36:16.734795+0000","last_clean":"2024-09-22T01:36:16.734795+0000","last_became_active":"2024-09-22T01:36:00.566088+0000","last_became_peered":"2024-09-22T01:36:00.566088+0000","last_unstale":"2024-09-22T01:36:16.734795+0000","last_undegraded":"2024-09-22T01:36:16.734795+0000","last_fullsized":"2024-09-22T01:36:16.734795+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:07:29.772414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016331309999999999,"stat_sum":{"num_bytes":13103183,"num_objects":39,"num_object_clones":14,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":15,"num_read":1978,"num_read_kb":5970,"num_write":295,"num_write_kb":6572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":4264442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"91'317","reported_seq":695,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.734869+0000","last_change":"2024-09-22T01:36:01.570787+0000","last_active":"2024-09-22T01:36:16.734869+0000","last_peered":"2024-09-22T01:36:16.734869+0000","last_clean":"2024-09-22T01:36:16.734869+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:36:16.734869+0000","last_undegraded":"2024-09-22T01:36:16.734869+0000","last_fullsized":"2024-09-22T01:36:16.734869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:34.691923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010627220000000001,"stat_sum":{"num_bytes":70338865,"num_objects":30,"num_object_clones":9,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":5,"num_read":1288,"num_read_kb":3536,"num_write":491,"num_write_kb":13141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"92'385","reported_seq":1557,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.796479+0000","last_change":"2024-09-22T01:36:06.621453+0000","last_active":"2024-09-22T01:36:16.796479+0000","last_peered":"2024-09-22T01:36:16.796479+0000","last_clean":"2024-09-22T01:36:16.796479+0000","last_became_active":"2024-09-22T01:36:06.619734+0000","last_became_peered":"2024-09-22T01:36:06.619734+0000","last_unstale":"2024-09-22T01:36:16.796479+0000","last_undegraded":"2024-09-22T01:36:16.796479+0000","last_fullsized":"2024-09-22T01:36:16.796479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:15:17.406116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000712264,"stat_sum":{"num_bytes":24677526,"num_objects":33,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":11,"num_read":3126,"num_read_kb":7007,"num_write":476,"num_write_kb":11581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":4400829,"num_keys_recovered":58,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"92'220","reported_seq":3228,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.734598+0000","last_change":"2024-09-22T01:36:01.564545+0000","last_active":"2024-09-22T01:36:16.734598+0000","last_peered":"2024-09-22T01:36:16.734598+0000","last_clean":"2024-09-22T01:36:16.734598+0000","last_became_active":"2024-09-22T01:36:01.562260+0000","last_became_peered":"2024-09-22T01:36:01.562260+0000","last_unstale":"2024-09-22T01:36:16.734598+0000","last_undegraded":"2024-09-22T01:36:16.734598+0000","last_fullsized":"2024-09-22T01:36:16.734598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:06:32.214227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002148418,"stat_sum":{"num_bytes":42093795,"num_objects":45,"num_object_clones":17,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":13,"num_read":2795,"num_read_kb":16291,"num_write":185,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"90'162","reported_seq":3871,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.685234+0000","last_change":"2024-09-22T01:36:07.627824+0000","last_active":"2024-09-22T01:36:16.685234+0000","last_peered":"2024-09-22T01:36:16.685234+0000","last_clean":"2024-09-22T01:36:16.685234+0000","last_became_active":"2024-09-22T01:36:07.626370+0000","last_became_peered":"2024-09-22T01:36:07.626370+0000","last_unstale":"2024-09-22T01:36:16.685234+0000","last_undegraded":"2024-09-22T01:36:16.685234+0000","last_fullsized":"2024-09-22T01:36:16.685234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:40:43.652312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086911499999999995,"stat_sum":{"num_bytes":14904901,"num_objects":19,"num_object_clones":7,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":7,"num_read":4107,"num_read_kb":12790,"num_write":149,"num_write_kb":2629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":5846025,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"92'201","reported_seq":7186,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-22T01:36:16.839385+0000","last_change":"2024-09-22T01:36:01.568141+0000","last_active":"2024-09-22T01:36:16.839385+0000","last_peered":"2024-09-22T01:36:16.839385+0000","last_clean":"2024-09-22T01:36:16.839385+0000","last_became_active":"2024-09-22T01:36:01.565891+0000","last_became_peered":"2024-09-22T01:36:01.565891+0000","last_unstale":"2024-09-22T01:36:16.839385+0000","last_undegraded":"2024-09-22T01:36:16.839385+0000","last_fullsized":"2024-09-22T01:36:16.839385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:16:25.884200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095816200000000003,"stat_sum":{"num_bytes":50436786,"num_objects":34,"num_object_clones":11,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":6,"num_read":6908,"num_read_kb":30017,"num_write":185,"num_write_kb":4974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":5871820,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1189874870,"num_objects":1131,"num_object_clones":391,"num_object_copies":2262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1131,"num_whiteouts":338,"num_read":117777,"num_read_kb":380496,"num_write":10408,"num_write_kb":187378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2199,"num_bytes_recovered":147217819,"num_keys_recovered":430,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":242065408,"data_stored":340900008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8688,"ondisk_log_size":8688,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64372,"kb_used_data":37348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94307468,"statfs":{"total":96636764160,"available":96570847232,"internally_reserved":0,"allocated":38244352,"data_stored":50392995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47132,"kb_used_data":11788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324708,"statfs":{"total":96636764160,"available":96588500992,"internally_reserved":0,"allocated":12070912,"data_stored":14993412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66408,"kb_used_data":26904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94305432,"statfs":{"total":96636764160,"available":96568762368,"internally_reserved":0,"allocated":27549696,"data_stored":39866321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91100,"kb_used_data":46028,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94280740,"statfs":{"total":96636764160,"available":96543477760,"internally_reserved":0,"allocated":47132672,"data_stored":67395978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58180,"kb_used_data":31156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94313660,"statfs":{"total":96636764160,"available":96577187840,"internally_reserved":0,"allocated":31903744,"data_stored":41990660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45644,"kb_used_data":10284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326196,"statfs":{"total":96636764160,"available":96590024704,"internally_reserved":0,"allocated":10530816,"data_stored":12912771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85392,"kb_used_data":41728,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94286448,"statfs":{"total":96636764160,"available":96549322752,"internally_reserved":0,"allocated":42729472,"data_stored":57337656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67756,"kb_used_data":40716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94304084,"statfs":{"total":96636764160,"available":96567382016,"internally_reserved":0,"allocated":41693184,"data_stored":58839147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40026112,"data_stored":57746661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41648128,"data_stored":57850000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9457664,"data_stored":13425177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30830592,"data_stored":41488515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46059520,"data_stored":66919941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26472448,"data_stored":39508012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10993664,"data_stored":14491251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36577280,"data_stored":49470451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:36:19.579 INFO:tasks.thrashosds.thrasher:Setting 2.2 to [4, 7, 2, 1] 2024-09-22T01:36:19.580 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.2', '4', '7', '2', '1'] 2024-09-22T01:36:19.580 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.2 4 7 2 1 2024-09-22T01:36:19.591 INFO:teuthology.orchestra.run.smithi018.stdout:3833 writesame 0xc808e32 thru 0xc80c8f9 data_size 0x4c(0x3ac8 bytes) 2024-09-22T01:36:19.593 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:19.594 INFO:teuthology.orchestra.run.smithi018.stdout:3837 writesame 0xaefab28 thru 0xaf07bef data_size 0x88(0xd0c8 bytes) 2024-09-22T01:36:19.602 INFO:teuthology.orchestra.run.smithi018.stdout:3839 clone 29 order 25 su 16777216 sc 10 2024-09-22T01:36:19.609 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:19.603+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:19.710 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:19.707+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:19.710 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:19.711 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:19.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:36:19.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:19.811 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:19.807+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:19.866 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone28 from 0xc80c8fa (overlap 0x19b3e3c) to 0x11fdec3 2024-09-22T01:36:19.901 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:19.902 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:19.912 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:19.907+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:19.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:20.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:20.041 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:20.042 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:20.042 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:20.037+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:20.057 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:20.065 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-22T01:36:20.089 INFO:teuthology.orchestra.run.smithi018.stdout:3840 read 0x893e32a thru 0x8944554 (0x622b bytes) 2024-09-22T01:36:20.104 INFO:teuthology.orchestra.run.smithi018.stdout:3841 writesame 0xddb779e thru 0xddbce02 data_size 0x1(0x5665 bytes) 2024-09-22T01:36:20.108 INFO:teuthology.orchestra.run.smithi018.stdout:3843 write 0xb4b6f8d thru 0xb4c2f59 (0xbfcd bytes) 2024-09-22T01:36:20.113 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:20.107+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:20.116 INFO:teuthology.orchestra.run.smithi018.stdout:3844 trunc from 0xddbce03 to 0xd7647a4 2024-09-22T01:36:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:3846 write 0x2511190 thru 0x2517ca2 (0x6b13 bytes) 2024-09-22T01:36:20.130 INFO:teuthology.orchestra.run.smithi018.stdout:3847 writesame 0x559bf89 thru 0x55a0833 data_size 0xd(0x48ab bytes) 2024-09-22T01:36:20.135 INFO:teuthology.orchestra.run.smithi018.stdout:3848 read 0x6136741 thru 0x6137d52 (0x1612 bytes) 2024-09-22T01:36:20.137 INFO:teuthology.orchestra.run.smithi018.stdout:3849 trunc from 0xd7647a4 to 0xc04d771 2024-09-22T01:36:20.147 INFO:teuthology.orchestra.run.smithi018.stdout:3851 read 0x9f73351 thru 0x9f754d2 (0x2182 bytes) 2024-09-22T01:36:20.150 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:20.150 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:20.156 INFO:teuthology.orchestra.run.smithi018.stdout:3852 write 0xdd220e9 thru 0xdd31183 (0xf09b bytes) 2024-09-22T01:36:20.158 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.158 INFO:teuthology.orchestra.run.smithi018.stdout:3854 write 0x9c320e6 thru 0x9c346a3 (0x25be bytes) 2024-09-22T01:36:20.161 INFO:teuthology.orchestra.run.smithi018.stdout:3855 write 0xc7e1f0 thru 0xc7fcf4 (0x1b05 bytes) 2024-09-22T01:36:20.170 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:20.187 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:20.187 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:20.199 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:20.199 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:20.204 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:20.204 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:20.215 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:20.211+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:20.218 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:20.228 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:20.229 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:20.249 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:20.249 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:20.250 INFO:teuthology.orchestra.run.smithi018.stdout:3858 read 0x289ae3f thru 0x28a4791 (0x9953 bytes) 2024-09-22T01:36:20.250 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.251 INFO:teuthology.orchestra.run.smithi018.stdout:3860 punch from 0xd7824b3 to 0xd78e07c, (0xbbc9 bytes) 2024-09-22T01:36:20.251 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.251 INFO:teuthology.orchestra.run.smithi018.stdout:3863 write 0xab94321 thru 0xaba2901 (0xe5e1 bytes) 2024-09-22T01:36:20.253 INFO:teuthology.orchestra.run.smithi018.stdout:3864 write 0xab3689c thru 0xab37eff (0x1664 bytes) 2024-09-22T01:36:20.255 INFO:teuthology.orchestra.run.smithi018.stdout:3865 read 0x8dd6a44 thru 0x8dd7665 (0xc22 bytes) 2024-09-22T01:36:20.255 INFO:teuthology.orchestra.run.smithi018.stdout:3866 read 0x315f66c thru 0x316140d (0x1da2 bytes) 2024-09-22T01:36:20.256 INFO:teuthology.orchestra.run.smithi018.stdout:3867 punch from 0x8b274c7 to 0x8b34fe1, (0xdb1a bytes) 2024-09-22T01:36:20.257 INFO:teuthology.orchestra.run.smithi018.stdout:3869 trunc from 0xdd31184 to 0xd28feaf 2024-09-22T01:36:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:3870 writesame 0xbe451bb thru 0xbe4d7f3 data_size 0x1(0x8639 bytes) 2024-09-22T01:36:20.268 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:20.286 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:20.286 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:20.289 INFO:teuthology.orchestra.run.smithi018.stdout:3871 write 0x6ec5602 thru 0x6ec63aa (0xda9 bytes) 2024-09-22T01:36:20.295 INFO:teuthology.orchestra.run.smithi018.stdout:3872 read 0x86fc8fe thru 0x8706d47 (0xa44a bytes) 2024-09-22T01:36:20.295 INFO:teuthology.orchestra.run.smithi018.stdout:3873 punch from 0xab2b768 to 0xab329bf, (0x7257 bytes) 2024-09-22T01:36:20.295 INFO:teuthology.orchestra.run.smithi018.stdout:3874 read 0x4cc0ba4 thru 0x4cc371f (0x2b7c bytes) 2024-09-22T01:36:20.295 INFO:teuthology.orchestra.run.smithi018.stdout:3875 read 0xcec6e26 thru 0xcecde1b (0x6ff6 bytes) 2024-09-22T01:36:20.296 INFO:teuthology.orchestra.run.smithi018.stdout:3876 writesame 0xc7f7fb3 thru 0xc801458 data_size 0x35(0x94a6 bytes) 2024-09-22T01:36:20.298 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.298 INFO:teuthology.orchestra.run.smithi018.stdout:3879 write 0xa12700e thru 0xa12a201 (0x31f4 bytes) 2024-09-22T01:36:20.312 INFO:teuthology.orchestra.run.smithi018.stdout:3880 trunc from 0xd28feaf to 0x273bc7e 2024-09-22T01:36:20.315 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:20.311+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:20.336 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.336 INFO:teuthology.orchestra.run.smithi018.stdout:3882 read 0x1c85215 thru 0x1c85e12 (0xbfe bytes) 2024-09-22T01:36:20.355 INFO:teuthology.orchestra.run.smithi018.stdout:3883 write 0x7d30e16 thru 0x7d350f5 (0x42e0 bytes) 2024-09-22T01:36:20.360 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.360 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.360 INFO:teuthology.orchestra.run.smithi018.stdout:3887 read 0x24c454b thru 0x24d3856 (0xf30c bytes) 2024-09-22T01:36:20.374 INFO:teuthology.orchestra.run.smithi018.stdout:3890 trunc from 0x7d350f6 to 0x178c6c2 2024-09-22T01:36:20.385 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:20.385 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:20.385 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:20.385 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:20.385 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:20.399 INFO:teuthology.orchestra.run.smithi018.stdout:3891 punch from 0x750f31 to 0x7570cd, (0x619c bytes) 2024-09-22T01:36:20.399 INFO:teuthology.orchestra.run.smithi018.stdout:3893 trunc from 0x178c6c2 to 0x1d26f5c 2024-09-22T01:36:20.400 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:20.410 INFO:teuthology.orchestra.run.smithi018.stdout:3894 punch from 0x12194d to 0x12c63d, (0xacf0 bytes) 2024-09-22T01:36:20.416 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:20.413+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:20.432 INFO:teuthology.orchestra.run.smithi018.stdout:3895 write 0x6d88e7a thru 0x6d8e608 (0x578f bytes) 2024-09-22T01:36:20.437 INFO:teuthology.orchestra.run.smithi018.stdout:3896 write 0x65174fc thru 0x651c422 (0x4f27 bytes) 2024-09-22T01:36:20.439 INFO:teuthology.orchestra.run.smithi018.stdout:3897 punch from 0x5fe87e3 to 0x5ff6864, (0xe081 bytes) 2024-09-22T01:36:20.439 INFO:teuthology.orchestra.run.smithi018.stdout:3898 read 0x559522 thru 0x56514e (0xbc2d bytes) 2024-09-22T01:36:20.457 INFO:teuthology.orchestra.run.smithi018.stdout:3899 writesame 0x9a5b50c thru 0x9a67025 data_size 0x2(0xbb1a bytes) 2024-09-22T01:36:20.457 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.457 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.457 INFO:teuthology.orchestra.run.smithi018.stdout:3902 read 0x42521fb thru 0x42542ba (0x20c0 bytes) 2024-09-22T01:36:20.471 INFO:teuthology.orchestra.run.smithi018.stdout:3904 write 0xc1948df thru 0xc19687f (0x1fa1 bytes) 2024-09-22T01:36:20.476 INFO:teuthology.orchestra.run.smithi018.stdout:3905 read 0xbb6be51 thru 0xbb7366d (0x781d bytes) 2024-09-22T01:36:20.477 INFO:teuthology.orchestra.run.smithi018.stdout:3906 write 0x7e4aaef thru 0x7e4f1fd (0x470f bytes) 2024-09-22T01:36:20.484 INFO:teuthology.orchestra.run.smithi018.stdout:3907 writesame 0x27860ce thru 0x278ee50 data_size 0x1(0x8d83 bytes) 2024-09-22T01:36:20.512 INFO:teuthology.orchestra.run.smithi018.stdout:3909 read 0x5a18f0e thru 0x5a2379a (0xa88d bytes) 2024-09-22T01:36:20.517 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:20.511+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:20.534 INFO:teuthology.orchestra.run.smithi018.stdout:3910 trunc from 0xc196880 to 0x3ac868f 2024-09-22T01:36:20.552 INFO:teuthology.orchestra.run.smithi018.stdout:3913 punch from 0x1061222 to 0x10612c5, (0xa3 bytes) 2024-09-22T01:36:20.552 INFO:teuthology.orchestra.run.smithi018.stdout:3914 read 0x1877c40 thru 0x187ffa6 (0x8367 bytes) 2024-09-22T01:36:20.553 INFO:teuthology.orchestra.run.smithi018.stdout:3915 write 0x14d81f2 thru 0x14e6750 (0xe55f bytes) 2024-09-22T01:36:20.556 INFO:teuthology.orchestra.run.smithi018.stdout:3916 write 0x358057 thru 0x367299 (0xf243 bytes) 2024-09-22T01:36:20.583 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19458 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1417216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.122512237999999, 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.056428816, 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19458 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457937+0000", 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7700000000000005e-07 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457940+0000", 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4329999999999998e-06 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457947+0000", 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9029999999999998e-06 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.457953+0000", 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8900000000000004e-06 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512121+0000", 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054168717999999998 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.512221+0000", 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9279999999999998e-05 2024-09-22T01:36:20.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514366+0000", 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002145115 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19464 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1949696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.122001015999999, 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055080249999999997, 2024-09-22T01:36:20.588 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19464 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.458448+0000", 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459822+0000", 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0013738540000000001 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459827+0000", 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1630000000000004e-06 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459840+0000", 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2775000000000001e-05 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459847+0000", 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8360000000000003e-06 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513362+0000", 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053515442000000003 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513441+0000", 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8708000000000006e-05 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.513528+0000", 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7472000000000005e-05 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19484 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1437696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.592 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.120459621999998, 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055077586999999997, 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19484 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:20.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459990+0000", 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7e-07 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.459993+0000", 2024-09-22T01:36:20.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8380000000000002e-06 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460000+0000", 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0169999999999999e-06 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460005+0000", 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3680000000000001e-06 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514879+0000", 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054874038999999999 2024-09-22T01:36:20.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.514965+0000", 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5574000000000004e-05 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515067+0000", 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010228100000000001 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19485 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1796096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.596 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.120436826000002, 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055255209, 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19485 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460012+0000", 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460300+0000", 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028730299999999998 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460304+0000", 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460314+0000", 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7119999999999995e-06 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460321+0000", 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6710000000000002e-06 2024-09-22T01:36:20.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515101+0000", 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054780263000000003 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515180+0000", 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9074999999999998e-05 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515268+0000", 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7416999999999993e-05 2024-09-22T01:36:20.600 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19486 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1970176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.120084943999998, 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055098253, 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.601 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19486 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460364+0000", 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460365+0000", 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9599999999999999e-07 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460369+0000", 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460382+0000", 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3478999999999999e-05 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460390+0000", 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5340000000000002e-06 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515297+0000", 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054907665000000001 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515373+0000", 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5721000000000002e-05 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515463+0000", 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9653000000000004e-05 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19487 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1980416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.120036571, 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055238787999999997, 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.605 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19487 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460413+0000", 2024-09-22T01:36:20.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460764+0000", 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035164799999999998 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460769+0000", 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.169e-06 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460779+0000", 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3239999999999992e-06 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460786+0000", 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0500000000000003e-06 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515497+0000", 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054711098 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515576+0000", 2024-09-22T01:36:20.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9085999999999995e-05 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515651+0000", 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5413000000000005e-05 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19501 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1089536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.119629867, 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055065846000000002, 2024-09-22T01:36:20.609 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19501 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460819+0000", 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460820+0000", 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000005e-07 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460823+0000", 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9459999999999998e-06 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460831+0000", 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6839999999999996e-06 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460837+0000", 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9479999999999996e-06 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515696+0000", 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054859053999999997 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515783+0000", 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7705000000000001e-05 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515885+0000", 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101908 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19502 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1263616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:20.613 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.119603709000003, 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055304409999999998, 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19502 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.460846+0000", 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461917+0000", 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0010713960000000001 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461923+0000", 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7030000000000003e-06 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461936+0000", 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2903e-05 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.461944+0000", 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4169999999999992e-06 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.515939+0000", 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053995026000000002 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516037+0000", 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8462999999999996e-05 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.516150+0000", 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000112502 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.617 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19507 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1806336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.118364936999996, 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055141745999999998, 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19507 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462084+0000", 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462085+0000", 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462087+0000", 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.418e-06 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462095+0000", 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0460000000000006e-06 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462101+0000", 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1150000000000002e-06 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517103+0000", 2024-09-22T01:36:20.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055002874 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517153+0000", 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9888000000000001e-05 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517226+0000", 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2775999999999996e-05 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19508 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1816576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.118342214999998, 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055377692999999999, 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19508 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462107+0000", 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462497+0000", 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038960900000000002 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462501+0000", 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2640000000000002e-06 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462513+0000", 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1643e-05 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462520+0000", 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.148e-06 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517286+0000", 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054766269999999999 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517378+0000", 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1853000000000003e-05 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517485+0000", 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106906 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.625 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19509 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1990656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.117911386000003, 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055183229, 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.626 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19509 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462538+0000", 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2399999999999998e-07 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462541+0000", 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6460000000000002e-06 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462550+0000", 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3440000000000007e-06 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462556+0000", 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5330000000000002e-06 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517517+0000", 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054960822999999999 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517620+0000", 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010306600000000001 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517721+0000", 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010129299999999999 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19524 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1099776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.117884313000005, 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055394339000000001, 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.630 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19524 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462565+0000", 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462933+0000", 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00036762399999999999 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462937+0000", 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5580000000000002e-06 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462946+0000", 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3179999999999996e-06 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462953+0000", 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8560000000000001e-06 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517759+0000", 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054806133 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517856+0000", 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7048999999999999e-05 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517959+0000", 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010280099999999999 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19525 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1110016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.117481497, 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055216300000000003, 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.634 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19525 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.462968+0000", 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463068+0000", 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100511 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463072+0000", 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.563e-06 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463081+0000", 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.816e-06 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463087+0000", 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5910000000000001e-06 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.517994+0000", 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054906644999999997 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518084+0000", 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9806e-05 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518184+0000", 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000100368 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19526 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1284096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.117352849, 2024-09-22T01:36:20.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.05530989, 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19526 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463096+0000", 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463491+0000", 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00039443699999999998 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463497+0000", 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463508+0000", 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1685000000000001e-05 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463517+0000", 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2479999999999996e-06 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518222+0000", 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054705548 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518317+0000", 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4660999999999994e-05 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518406+0000", 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9580999999999995e-05 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19527 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1458176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.642 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.116874207999999, 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055079491000000001, 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19527 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:20.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463575+0000", 2024-09-22T01:36:20.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463576+0000", 2024-09-22T01:36:20.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3099999999999997e-07 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463579+0000", 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5719999999999999e-06 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463589+0000", 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4020000000000008e-06 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463595+0000", 2024-09-22T01:36:20.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1140000000000002e-06 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518459+0000", 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054863737000000003 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518543+0000", 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4690000000000004e-05 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518655+0000", 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111345 2024-09-22T01:36:20.647 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19528 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1468416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.116843774000003, 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.059935753000000001, 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.648 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19528 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463605+0000", 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463794+0000", 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018894199999999999 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463798+0000", 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7000000000000002e-06 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463808+0000", 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0045e-05 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463814+0000", 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518732+0000", 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.054917796999999997 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518812+0000", 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9759999999999995e-05 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.523541+0000", 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0047297270000000004 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:19529 3.14 3:2d5fc71c:::rbd_data.110f880def8d.0000000000000006:7 [read 1642496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.116625416000005, 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.055275522000000001, 2024-09-22T01:36:20.652 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 19529 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.463824+0000", 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465588+0000", 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017641309999999999 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465593+0000", 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7350000000000004e-06 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465602+0000", 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.329e-06 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.465608+0000", 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6779999999999997e-06 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.518932+0000", 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.053324085 2024-09-22T01:36:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519006+0000", 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4072000000000005e-05 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:05.519099+0000", 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3492000000000005e-05 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.656 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.784068712, 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:20.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:36:20.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:36:20.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:36:20.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_repop(client.4367.0:90338 3.f e63/22 3:f57ef966:::rbd_data.110f82290689.0000000000000000:head v 63'283, mlcod=62'280)", 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 35.784543096, 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.057883599000000001, 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.663 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795906+0000", 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.795910+0000", 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9230000000000004e-06 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813541+0000", 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.017631371 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813592+0000", 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1038999999999997e-05 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813620+0000", 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7169e-05 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813793+0000", 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017370600000000001 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.813857+0000", 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3540999999999994e-05 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.853698+0000", 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.039841255999999999 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:44.853790+0000", 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1594000000000004e-05 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:36:20.667 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.071925994000001, 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:20.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:20.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.673 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:20.674 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:20.674 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:20.676 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:20.676 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:20.671+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:20.678 INFO:teuthology.orchestra.run.smithi018.stdout:3917 trunc from 0x3ac868f to 0xdd46194 2024-09-22T01:36:20.678 INFO:teuthology.orchestra.run.smithi018.stdout:3918 read 0x9b8d6a6 thru 0x9b9ae30 (0xd78b bytes) 2024-09-22T01:36:20.678 INFO:teuthology.orchestra.run.smithi018.stdout:3922 write 0x3a56f36 thru 0x3a635b1 (0xc67c bytes) 2024-09-22T01:36:20.678 INFO:teuthology.orchestra.run.smithi018.stdout:3923 write 0xd9505e6 thru 0xd956430 (0x5e4b bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3924 punch from 0x2348b8a to 0x2353928, (0xad9e bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3925 trunc from 0xdd46194 to 0xd9fc229 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3928 writesame 0x37c2865 thru 0x37d1f8d data_size 0x83(0xf729 bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3929 read 0x1c326c5 thru 0x1c3374d (0x1089 bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3930 writesame 0xc16c5ae thru 0xc172742 data_size 0xb(0x6195 bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3931 read 0x72562c4 thru 0x725b8ae (0x55eb bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3933 write 0x1ab1c52 thru 0x1ab7bbc (0x5f6b bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3934 read 0xb807936 thru 0xb80b94e (0x4019 bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3936 punch from 0xae55eca to 0xae642ba, (0xe3f0 bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3937 writesame 0x9571d21 thru 0x95800be data_size 0x5(0xe39e bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3938 write 0x730009 thru 0x735c85 (0x5c7d bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3939 punch from 0x2cf653a to 0x2d01637, (0xb0fd bytes) 2024-09-22T01:36:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:3942 write 0x5b9c95 thru 0x5c5863 (0xbbcf bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3943 read 0x90943b9 thru 0x90a157a (0xd1c2 bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3944 write 0xb0bfd72 thru 0xb0cb18b (0xb41a bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3947 write 0x68100ca thru 0x6819e8a (0x9dc1 bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3948 read 0xa535ff9 thru 0xa5401a1 (0xa1a9 bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3949 punch from 0x6004ed5 to 0x6006da7, (0x1ed2 bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3950 write 0x419b1aa thru 0x419bf05 (0xd5c bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3954 write 0xae88e64 thru 0xae91854 (0x89f1 bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3955 read 0x3a3259d thru 0x3a3389d (0x1301 bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3956 punch from 0x76c726e to 0x76d6ead, (0xfc3f bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3958 read 0x23823f thru 0x23ac93 (0x2a55 bytes) 2024-09-22T01:36:20.680 INFO:teuthology.orchestra.run.smithi018.stdout:3959 writesame 0xb88a3a0 thru 0xb890465 data_size 0x3(0x60c6 bytes) 2024-09-22T01:36:20.684 INFO:teuthology.orchestra.run.smithi018.stdout:3960 read 0x33689aa thru 0x336e251 (0x58a8 bytes) 2024-09-22T01:36:20.686 INFO:teuthology.orchestra.run.smithi018.stdout:3961 write 0x49b582e thru 0x49bd6c6 (0x7e99 bytes) 2024-09-22T01:36:20.689 INFO:teuthology.orchestra.run.smithi018.stdout:3962 write 0xd2f5258 thru 0xd2fc28e (0x7037 bytes) 2024-09-22T01:36:20.692 INFO:teuthology.orchestra.run.smithi018.stdout:3963 punch from 0x9118b32 to 0x911dacd, (0x4f9b bytes) 2024-09-22T01:36:20.692 INFO:teuthology.orchestra.run.smithi018.stdout:3965 punch from 0x51951e1 to 0x51964bd, (0x12dc bytes) 2024-09-22T01:36:20.703 INFO:teuthology.orchestra.run.smithi018.stdout:3966 trunc from 0xd9fc229 to 0x9f72576 2024-09-22T01:36:20.720 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:36:20.731 INFO:teuthology.orchestra.run.smithi018.stderr:set 2.2 pg_upmap_items mapping to [4->7,2->1] 2024-09-22T01:36:20.743 INFO:teuthology.orchestra.run.smithi018.stdout:3967 write 0xd90fe98 thru 0xd911643 (0x17ac bytes) 2024-09-22T01:36:20.748 INFO:teuthology.orchestra.run.smithi018.stdout:3968 punch from 0x334317 to 0x336825, (0x250e bytes) 2024-09-22T01:36:20.748 INFO:teuthology.orchestra.run.smithi018.stdout:3969 read 0x769d23d thru 0x76ab75f (0xe523 bytes) 2024-09-22T01:36:20.748 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.766 INFO:teuthology.orchestra.run.smithi018.stdout:3971 trunc from 0xd911644 to 0x48530ec 2024-09-22T01:36:20.776 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:20.773+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:20.787 INFO:teuthology.orchestra.run.smithi018.stdout:3972 read 0x961872 thru 0x96b3ac (0x9b3b bytes) 2024-09-22T01:36:20.788 INFO:teuthology.orchestra.run.smithi018.stdout:3973 read 0x3b1ea58 thru 0x3b20d12 (0x22bb bytes) 2024-09-22T01:36:20.789 INFO:teuthology.orchestra.run.smithi018.stdout:3974 writesame 0x270730b thru 0x27170a6 data_size 0x2(0xfd9c bytes) 2024-09-22T01:36:20.831 INFO:teuthology.orchestra.run.smithi018.stdout:3975 trunc from 0x48530ec to 0xb5b54c 2024-09-22T01:36:20.869 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:20.869 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:20.869 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:20.869 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:20.877 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:20.873+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:20.883 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:20.892 INFO:teuthology.orchestra.run.smithi018.stdout:3977 write 0x9b96b69 thru 0x9ba27e4 (0xbc7c bytes) 2024-09-22T01:36:20.898 INFO:teuthology.orchestra.run.smithi018.stdout:3978 punch from 0x9488a2c to 0x948b5d2, (0x2ba6 bytes) 2024-09-22T01:36:20.898 INFO:teuthology.orchestra.run.smithi018.stdout:3979 read 0x9b1416c thru 0x9b2073e (0xc5d3 bytes) 2024-09-22T01:36:20.899 INFO:teuthology.orchestra.run.smithi018.stdout:3980 punch from 0x39becf2 to 0x39c5882, (0x6b90 bytes) 2024-09-22T01:36:20.899 INFO:teuthology.orchestra.run.smithi018.stdout:3981 punch from 0x739cbfd to 0x739f54d, (0x2950 bytes) 2024-09-22T01:36:20.914 INFO:teuthology.orchestra.run.smithi018.stdout:3982 trunc from 0x9ba27e5 to 0x3bb35f5 2024-09-22T01:36:20.962 INFO:teuthology.orchestra.run.smithi018.stdout:3983 writesame 0x9c053ef thru 0x9c0cd79 data_size 0x31(0x798b bytes) 2024-09-22T01:36:20.977 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:20.971+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:20.985 INFO:teuthology.orchestra.run.smithi018.stdout:3984 write 0xdd9c0a2 thru 0xddabfcd (0xff2c bytes) 2024-09-22T01:36:20.992 INFO:teuthology.orchestra.run.smithi018.stdout:3986 read 0x65a9c38 thru 0x65b81c0 (0xe589 bytes) 2024-09-22T01:36:20.992 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:20.992 INFO:teuthology.orchestra.run.smithi018.stdout:3989 read 0x3b2b0bc thru 0x3b2cee9 (0x1e2e bytes) 2024-09-22T01:36:21.009 INFO:teuthology.orchestra.run.smithi018.stdout:3990 writesame 0xedbc189 thru 0xedc1289 data_size 0x1(0x5101 bytes) 2024-09-22T01:36:21.010 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:21.011 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:21.011 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:21.011 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:21.011 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:21.025 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:21.032 INFO:teuthology.orchestra.run.smithi018.stdout:3991 trunc from 0xedc128a to 0x5ebcfe4 2024-09-22T01:36:21.066 INFO:teuthology.orchestra.run.smithi018.stdout:3993 write 0x9698971 thru 0x969898d (0x1d bytes) 2024-09-22T01:36:21.072 INFO:teuthology.orchestra.run.smithi018.stdout:3994 read 0x7203ea2 thru 0x7204679 (0x7d8 bytes) 2024-09-22T01:36:21.072 INFO:teuthology.orchestra.run.smithi018.stdout:3995 write 0x3675c3e thru 0x367be71 (0x6234 bytes) 2024-09-22T01:36:21.078 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:21.073+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:21.092 INFO:teuthology.orchestra.run.smithi018.stdout:3996 writesame 0xbecba56 thru 0xbed39ae data_size 0x1(0x7f59 bytes) 2024-09-22T01:36:21.093 INFO:teuthology.orchestra.run.smithi018.stdout:3997 punch from 0x83562c5 to 0x8363cfc, (0xda37 bytes) 2024-09-22T01:36:21.108 INFO:teuthology.orchestra.run.smithi018.stdout:3999 writesame 0xe56a663 thru 0xe571e2d data_size 0xd(0x77cb bytes) 2024-09-22T01:36:21.108 INFO:teuthology.orchestra.run.smithi018.stdout:4000 write 0xce177da thru 0xce1ae08 (0x362f bytes) 2024-09-22T01:36:21.112 INFO:teuthology.orchestra.run.smithi018.stdout:4002 write 0xc985de3 thru 0xc98ed2e (0x8f4c bytes) 2024-09-22T01:36:21.140 INFO:teuthology.orchestra.run.smithi018.stdout:4003 trunc from 0xe571e2e to 0x4cd97e3 2024-09-22T01:36:21.164 INFO:teuthology.orchestra.run.smithi018.stdout:4007 writesame 0x415c569 thru 0x415d23a data_size 0x3(0xcd2 bytes) 2024-09-22T01:36:21.178 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:21.175+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:21.195 INFO:teuthology.orchestra.run.smithi018.stdout:4009 writesame 0x8de97be thru 0x8df420c data_size 0x1(0xaa4f bytes) 2024-09-22T01:36:21.195 INFO:teuthology.orchestra.run.smithi018.stdout:4012 write 0x19ef131 thru 0x19f8275 (0x9145 bytes) 2024-09-22T01:36:21.202 INFO:teuthology.orchestra.run.smithi018.stdout:4013 punch from 0x482e12a to 0x4835297, (0x716d bytes) 2024-09-22T01:36:21.203 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85503 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2535424~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.753673403000001, 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093530897000000002, 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.204 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85503 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2899999999999999e-07 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446999+0000", 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.916e-06 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447004+0000", 2024-09-22T01:36:21.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0799999999999996e-06 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447009+0000", 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4020000000000004e-06 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540204+0000", 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093195373999999997 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540345+0000", 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000140381 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540528+0000", 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000183415 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85504 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2547712~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:21.208 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.753655061000003, 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093891557, 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85504 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:21.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.210 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.210 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.210 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.210 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:21.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447016+0000", 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5199999999999998e-07 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447018+0000", 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9039999999999999e-06 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447023+0000", 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2750000000000003e-06 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447027+0000", 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4530000000000004e-06 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540594+0000", 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093566496999999998 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540737+0000", 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014323299999999999 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540907+0000", 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016984300000000001 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.753637343000001, 2024-09-22T01:36:21.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.214 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:36:21.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:36:21.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.217 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85514 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1789952~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.749688048000003, 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093579774000000004, 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85514 2024-09-22T01:36:21.218 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450983+0000", 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7999999999999996e-07 2024-09-22T01:36:21.219 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450985+0000", 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1849999999999998e-06 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450991+0000", 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2129999999999996e-06 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450996+0000", 2024-09-22T01:36:21.220 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4610000000000001e-06 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544381+0000", 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093384923999999994 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544456+0000", 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5506999999999994e-05 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544562+0000", 2024-09-22T01:36:21.221 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106004 2024-09-22T01:36:21.222 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.222 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.222 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.222 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.222 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.222 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.222 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:21.222 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.749669117000003, 2024-09-22T01:36:21.222 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:36:21.222 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.223 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.226 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:36:21.226 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:36:21.226 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.226 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.226 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.226 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:36:21.226 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:36:21.227 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.227 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.227 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.227 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.227 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.227 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.227 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:21.228 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.749650056999997, 2024-09-22T01:36:21.228 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:36:21.228 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.228 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.228 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.228 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.228 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.228 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.229 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:36:21.229 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.229 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.229 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.229 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:21.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.230 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.230 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.230 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.230 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:21.230 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.230 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.231 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.231 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:36:21.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:36:21.231 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.231 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:36:21.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:36:21.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:36:21.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:36:21.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:36:21.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:36:21.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:36:21.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:36:21.234 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.235 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:36:21.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:36:21.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.235 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.235 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:36:21.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:36:21.236 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.236 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.236 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.236 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.236 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:21.237 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.749424193999999, 2024-09-22T01:36:21.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:36:21.237 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.237 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.237 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.237 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.238 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.238 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.238 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:36:21.238 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.238 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.238 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.238 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:21.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:21.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:36:21.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:36:21.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:36:21.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:36:21.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:36:21.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:21.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.242 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.242 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.242 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:36:21.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:36:21.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85526 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2732032~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.745647267000003, 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093423637000000004, 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.244 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85526 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:21.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455024+0000", 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2500000000000001e-07 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455025+0000", 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8959999999999999e-06 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455031+0000", 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0780000000000003e-06 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455035+0000", 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4580000000000003e-06 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548127+0000", 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093091561000000003 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548220+0000", 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3262000000000003e-05 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548447+0000", 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022705699999999999 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85527 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2744320~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:21.248 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.745630106999997, 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093760895999999996, 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85527 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458570+0000", 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035298489999999998 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458576+0000", 2024-09-22T01:36:21.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3229999999999997e-06 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458585+0000", 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5410000000000006e-06 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458591+0000", 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.285e-06 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548485+0000", 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089893197999999994 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548570+0000", 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5853000000000006e-05 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548801+0000", 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023084700000000001 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.252 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85536 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2818048~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.741919277999997, 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093657773999999999, 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85536 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.253 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458752+0000", 2024-09-22T01:36:21.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2500000000000001e-07 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458759+0000", 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0759999999999997e-06 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458766+0000", 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6329999999999996e-06 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458771+0000", 2024-09-22T01:36:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5900000000000001e-06 2024-09-22T01:36:21.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552107+0000", 2024-09-22T01:36:21.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093335687000000001 2024-09-22T01:36:21.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552246+0000", 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013969399999999999 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552409+0000", 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000162769 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.741893851, 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:36:21.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:36:21.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:36:21.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:36:21.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85546 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2904064~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.737947036999998, 2024-09-22T01:36:21.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093702627999999996, 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85546 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462724+0000", 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.27e-07 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462726+0000", 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9099999999999999e-06 2024-09-22T01:36:21.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462731+0000", 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0969999999999996e-06 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462735+0000", 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5410000000000002e-06 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556116+0000", 2024-09-22T01:36:21.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093380303999999997 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556261+0000", 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000145353 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556426+0000", 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016509599999999999 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85547 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1912832~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.737929528000002, 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093927398999999995, 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85547 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4299999999999999e-07 2024-09-22T01:36:21.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462743+0000", 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.815e-06 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462748+0000", 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1930000000000001e-06 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462752+0000", 2024-09-22T01:36:21.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1269999999999996e-06 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556484+0000", 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093731223000000002 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556561+0000", 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7082999999999994e-05 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556668+0000", 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010761500000000001 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.737912555999998, 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.272 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:21.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85558 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3002368~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.733730633999997, 2024-09-22T01:36:21.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093611833000000005, 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85558 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:21.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:21.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3700000000000001e-07 2024-09-22T01:36:21.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466942+0000", 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6509999999999999e-06 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466947+0000", 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466951+0000", 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3460000000000004e-06 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560282+0000", 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093330294999999994 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560404+0000", 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012278500000000001 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560552+0000", 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014742100000000001 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.280 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85559 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1961984~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.733713768000001, 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093835707000000004, 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85559 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.281 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:21.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6699999999999999e-07 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466959+0000", 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.516e-06 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466965+0000", 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0610000000000001e-06 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466970+0000", 2024-09-22T01:36:21.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6930000000000004e-06 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560608+0000", 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093637915000000002 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560688+0000", 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0139e-05 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560792+0000", 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000104016 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.733694473, 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:36:21.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:36:21.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85570 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3100672~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.729761084000003, 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093416421999999999, 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.289 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85570 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:21.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470910+0000", 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.46e-07 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470912+0000", 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.829e-06 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470917+0000", 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0749999999999997e-06 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470923+0000", 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6340000000000003e-06 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564045+0000", 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093121588000000005 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564169+0000", 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000124311 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564326+0000", 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156639 2024-09-22T01:36:21.293 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85571 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2011136~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.729739956000003, 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093598939000000006, 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.294 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.295 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85571 2024-09-22T01:36:21.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.295 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:21.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:21.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470979+0000", 2024-09-22T01:36:21.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8327e-05 2024-09-22T01:36:21.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470982+0000", 2024-09-22T01:36:21.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:21.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470999+0000", 2024-09-22T01:36:21.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6305999999999999e-05 2024-09-22T01:36:21.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471005+0000", 2024-09-22T01:36:21.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0059999999999998e-06 2024-09-22T01:36:21.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564351+0000", 2024-09-22T01:36:21.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093346425999999996 2024-09-22T01:36:21.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564436+0000", 2024-09-22T01:36:21.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4425000000000006e-05 2024-09-22T01:36:21.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564530+0000", 2024-09-22T01:36:21.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3890999999999999e-05 2024-09-22T01:36:21.301 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.302 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.302 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.302 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85572 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3112960~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:21.302 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:21.303 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 40.729655932999997, 2024-09-22T01:36:21.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093850133000000002, 2024-09-22T01:36:21.303 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.303 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.303 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.303 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.303 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.304 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.304 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85572 2024-09-22T01:36:21.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.304 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:21.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:21.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474653+0000", 2024-09-22T01:36:21.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036386040000000001 2024-09-22T01:36:21.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474662+0000", 2024-09-22T01:36:21.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9330000000000007e-06 2024-09-22T01:36:21.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474674+0000", 2024-09-22T01:36:21.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2054e-05 2024-09-22T01:36:21.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474680+0000", 2024-09-22T01:36:21.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000001e-06 2024-09-22T01:36:21.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564595+0000", 2024-09-22T01:36:21.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089914358999999999 2024-09-22T01:36:21.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564715+0000", 2024-09-22T01:36:21.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012013700000000001 2024-09-22T01:36:21.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564865+0000", 2024-09-22T01:36:21.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015003600000000001 2024-09-22T01:36:21.311 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.311 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.311 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.311 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.312 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.312 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:21.315 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:21.316 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:21.307+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:21.318 INFO:teuthology.orchestra.run.smithi018.stdout:4014 trunc from 0x8df420d to 0x7191bd3 2024-09-22T01:36:21.319 INFO:teuthology.orchestra.run.smithi018.stdout:4015 read 0x1f26b90 thru 0x1f31a41 (0xaeb2 bytes) 2024-09-22T01:36:21.319 INFO:teuthology.orchestra.run.smithi018.stdout:4016 read 0x4004518 thru 0x4005201 (0xcea bytes) 2024-09-22T01:36:21.319 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:21.319 INFO:teuthology.orchestra.run.smithi018.stdout:4018 read 0x310ccb1 thru 0x311b565 (0xe8b5 bytes) 2024-09-22T01:36:21.319 INFO:teuthology.orchestra.run.smithi018.stdout:4019 writesame 0x422cd05 thru 0x423b41c data_size 0x66(0xe718 bytes) 2024-09-22T01:36:21.319 INFO:teuthology.orchestra.run.smithi018.stdout:4020 write 0x324c14c thru 0x325653d (0xa3f2 bytes) 2024-09-22T01:36:21.319 INFO:teuthology.orchestra.run.smithi018.stdout:4021 punch from 0x18ba20 to 0x18e108, (0x26e8 bytes) 2024-09-22T01:36:21.320 INFO:teuthology.orchestra.run.smithi018.stdout:4022 punch from 0x26fdb2d to 0x2704c20, (0x70f3 bytes) 2024-09-22T01:36:21.320 INFO:teuthology.orchestra.run.smithi018.stdout:4023 read 0xaab8e6 thru 0xaaee62 (0x357d bytes) 2024-09-22T01:36:21.320 INFO:teuthology.orchestra.run.smithi018.stdout:4024 trunc from 0x7191bd3 to 0xca3da09 2024-09-22T01:36:21.320 INFO:teuthology.orchestra.run.smithi018.stdout:4025 write 0xb0c08e4 thru 0xb0cfd60 (0xf47d bytes) 2024-09-22T01:36:21.320 INFO:teuthology.orchestra.run.smithi018.stdout:4028 punch from 0x2a6de54 to 0x2a7bd05, (0xdeb1 bytes) 2024-09-22T01:36:21.320 INFO:teuthology.orchestra.run.smithi018.stdout:4029 writesame 0x41bc08e thru 0x41bc670 data_size 0x1(0x5e3 bytes) 2024-09-22T01:36:21.321 INFO:teuthology.orchestra.run.smithi018.stdout:4030 write 0x913ca12 thru 0x9140857 (0x3e46 bytes) 2024-09-22T01:36:21.321 INFO:teuthology.orchestra.run.smithi018.stdout:4031 read 0x89e0489 thru 0x89eb89d (0xb415 bytes) 2024-09-22T01:36:21.321 INFO:teuthology.orchestra.run.smithi018.stdout:4032 trunc from 0xca3da09 to 0x498abb3 2024-09-22T01:36:21.321 INFO:teuthology.orchestra.run.smithi018.stdout:4037 read 0x3268d9e thru 0x326c1af (0x3412 bytes) 2024-09-22T01:36:21.321 INFO:teuthology.orchestra.run.smithi018.stdout:4040 punch from 0x3184113 to 0x318d2ad, (0x919a bytes) 2024-09-22T01:36:21.321 INFO:teuthology.orchestra.run.smithi018.stdout:4041 punch from 0x3706bd0 to 0x3716703, (0xfb33 bytes) 2024-09-22T01:36:21.321 INFO:teuthology.orchestra.run.smithi018.stdout:4042 read 0x27ec5bc thru 0x27f25ea (0x602f bytes) 2024-09-22T01:36:21.351 INFO:teuthology.orchestra.run.smithi018.stdout:4043 write 0x9ef86d2 thru 0x9f00502 (0x7e31 bytes) 2024-09-22T01:36:21.359 INFO:teuthology.orchestra.run.smithi018.stdout:4044 writesame 0x4950099 thru 0x495d025 data_size 0x59(0xcf8d bytes) 2024-09-22T01:36:21.364 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:21.364 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:21.383 INFO:teuthology.orchestra.run.smithi018.stdout:4048 write 0xcca8eed thru 0xccabad3 (0x2be7 bytes) 2024-09-22T01:36:21.386 INFO:teuthology.orchestra.run.smithi018.stdout:4049 trunc from 0xccabad4 to 0xc6a1cc5 2024-09-22T01:36:21.398 INFO:teuthology.orchestra.run.smithi018.stdout:4051 write 0x7a3019e thru 0x7a37a06 (0x7869 bytes) 2024-09-22T01:36:21.405 INFO:teuthology.orchestra.run.smithi018.stdout:4052 read 0x2b5b92d thru 0x2b64c43 (0x9317 bytes) 2024-09-22T01:36:21.406 INFO:teuthology.orchestra.run.smithi018.stdout:4053 read 0xa5350ce thru 0xa5351d0 (0x103 bytes) 2024-09-22T01:36:21.406 INFO:teuthology.orchestra.run.smithi018.stdout:4056 write 0x80b2cb2 thru 0x80ba2aa (0x75f9 bytes) 2024-09-22T01:36:21.412 INFO:teuthology.orchestra.run.smithi018.stdout:4057 read 0x122683a thru 0x122d911 (0x70d8 bytes) 2024-09-22T01:36:21.413 INFO:teuthology.orchestra.run.smithi018.stdout:4058 read 0x146f3b7 thru 0x147ee3f (0xfa89 bytes) 2024-09-22T01:36:21.413 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:21.409+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:21.414 INFO:teuthology.orchestra.run.smithi018.stdout:4059 punch from 0x1a4a937 to 0x1a51c75, (0x733e bytes) 2024-09-22T01:36:21.414 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:21.415 INFO:teuthology.orchestra.run.smithi018.stdout:4061 trunc from 0xc6a1cc5 to 0xbe236d9 2024-09-22T01:36:21.448 INFO:teuthology.orchestra.run.smithi018.stdout:4063 write 0xe580b89 thru 0xe58dadf (0xcf57 bytes) 2024-09-22T01:36:21.451 INFO:teuthology.orchestra.run.smithi018.stdout:4064 write 0x588a380 thru 0x5899ec9 (0xfb4a bytes) 2024-09-22T01:36:21.461 INFO:teuthology.orchestra.run.smithi018.stdout:4065 write 0xbee0d96 thru 0xbee7451 (0x66bc bytes) 2024-09-22T01:36:21.462 INFO:teuthology.orchestra.run.smithi018.stdout:4066 read 0x5bf05dc thru 0x5bf9915 (0x933a bytes) 2024-09-22T01:36:21.463 INFO:teuthology.orchestra.run.smithi018.stdout:4067 write 0xc263e31 thru 0xc2681bb (0x438b bytes) 2024-09-22T01:36:21.466 INFO:teuthology.orchestra.run.smithi018.stdout:4068 punch from 0xb995d8e to 0xb99a911, (0x4b83 bytes) 2024-09-22T01:36:21.466 INFO:teuthology.orchestra.run.smithi018.stdout:4069 write 0x3d03a7e thru 0x3d099fa (0x5f7d bytes) 2024-09-22T01:36:21.470 INFO:teuthology.orchestra.run.smithi018.stdout:4071 read 0x5292b74 thru 0x52984a5 (0x5932 bytes) 2024-09-22T01:36:21.471 INFO:teuthology.orchestra.run.smithi018.stdout:4072 writesame 0x6153123 thru 0x61607ab data_size 0x1(0xd689 bytes) 2024-09-22T01:36:21.493 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:21.493 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:21.493 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:21.493 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:21.509 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:21.514 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:21.508+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:21.525 INFO:teuthology.orchestra.run.smithi018.stdout:4073 read 0x1065f93 thru 0x1073fdd (0xe04b bytes) 2024-09-22T01:36:21.527 INFO:teuthology.orchestra.run.smithi018.stdout:4075 punch from 0x6524205 to 0x652f4d3, (0xb2ce bytes) 2024-09-22T01:36:21.527 INFO:teuthology.orchestra.run.smithi018.stdout:4076 write 0x82d75d5 thru 0x82d9dfa (0x2826 bytes) 2024-09-22T01:36:21.539 INFO:teuthology.orchestra.run.smithi018.stdout:4077 write 0xea4c76e thru 0xea51263 (0x4af6 bytes) 2024-09-22T01:36:21.541 INFO:teuthology.orchestra.run.smithi018.stdout:4078 punch from 0x504a0c8 to 0x504ad95, (0xccd bytes) 2024-09-22T01:36:21.541 INFO:teuthology.orchestra.run.smithi018.stdout:4079 write 0x169dd52 thru 0x16a060d (0x28bc bytes) 2024-09-22T01:36:21.544 INFO:teuthology.orchestra.run.smithi018.stdout:4080 write 0xc212f3d thru 0xc21897f (0x5a43 bytes) 2024-09-22T01:36:21.546 INFO:teuthology.orchestra.run.smithi018.stdout:4081 write 0x21e1fe9 thru 0x21f1307 (0xf31f bytes) 2024-09-22T01:36:21.548 INFO:teuthology.orchestra.run.smithi018.stdout:4083 read 0xab4585 thru 0xabb6da (0x7156 bytes) 2024-09-22T01:36:21.564 INFO:teuthology.orchestra.run.smithi018.stdout:4084 trunc from 0xea51264 to 0x949bb26 2024-09-22T01:36:21.577 INFO:teuthology.orchestra.run.smithi018.stdout:4085 read 0x499967 thru 0x49f4b3 (0x5b4d bytes) 2024-09-22T01:36:21.606 INFO:teuthology.orchestra.run.smithi018.stdout:4086 write 0xe4a214e thru 0xe4aac5c (0x8b0f bytes) 2024-09-22T01:36:21.615 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:21.608+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:21.621 INFO:teuthology.orchestra.run.smithi018.stdout:4087 trunc from 0xe4aac5d to 0x9c0653f 2024-09-22T01:36:21.638 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:21.638 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:21.653 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:21.654 INFO:teuthology.orchestra.run.smithi018.stdout:4088 writesame 0x9cc97ff thru 0x9cd4fc8 data_size 0x19(0xb7ca bytes) 2024-09-22T01:36:21.658 INFO:teuthology.orchestra.run.smithi018.stdout:4089 trunc from 0x9cd4fc9 to 0x907f467 2024-09-22T01:36:21.671 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:21.671 INFO:teuthology.orchestra.run.smithi018.stdout:4091 read 0x8781135 thru 0x878766d (0x6539 bytes) 2024-09-22T01:36:21.672 INFO:teuthology.orchestra.run.smithi018.stdout:4092 punch from 0x1588ace to 0x1588de4, (0x316 bytes) 2024-09-22T01:36:21.683 INFO:teuthology.orchestra.run.smithi018.stdout:4093 write 0x98cc3ed thru 0x98d457c (0x8190 bytes) 2024-09-22T01:36:21.686 INFO:teuthology.orchestra.run.smithi018.stdout:4095 read 0x8cb2ccb thru 0x8cc28eb (0xfc21 bytes) 2024-09-22T01:36:21.686 INFO:teuthology.orchestra.run.smithi018.stdout:4096 read 0x5f78f75 thru 0x5f875ef (0xe67b bytes) 2024-09-22T01:36:21.687 INFO:teuthology.orchestra.run.smithi018.stdout:4099 write 0x39d1cca thru 0x39d6c81 (0x4fb8 bytes) 2024-09-22T01:36:21.691 INFO:teuthology.orchestra.run.smithi018.stdout:4100 read 0x25c4a05 thru 0x25c75f6 (0x2bf2 bytes) 2024-09-22T01:36:21.692 INFO:teuthology.orchestra.run.smithi018.stdout:4101 read 0x97f0a4c thru 0x97ff399 (0xe94e bytes) 2024-09-22T01:36:21.693 INFO:teuthology.orchestra.run.smithi018.stdout:4102 read 0x8205007 thru 0x820b789 (0x6783 bytes) 2024-09-22T01:36:21.693 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:21.693 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:21.693 INFO:teuthology.orchestra.run.smithi018.stdout:4107 read 0x81990d8 thru 0x81a8dca (0xfcf3 bytes) 2024-09-22T01:36:21.694 INFO:teuthology.orchestra.run.smithi018.stdout:4109 read 0x5d0d06f thru 0x5d11b1d (0x4aaf bytes) 2024-09-22T01:36:21.695 INFO:teuthology.orchestra.run.smithi018.stdout:4110 writesame 0x5655dfc thru 0x565cced data_size 0xb(0x6ef2 bytes) 2024-09-22T01:36:21.697 INFO:teuthology.orchestra.run.smithi018.stdout:4111 writesame 0x2ce4353 thru 0x2ce7a39 data_size 0x5(0x36e7 bytes) 2024-09-22T01:36:21.716 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:21.712+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:21.722 INFO:teuthology.orchestra.run.smithi018.stdout:4112 trunc from 0x98d457d to 0xe8dee8 2024-09-22T01:36:21.767 INFO:teuthology.orchestra.run.smithi018.stdout:4113 read 0x9c79e6 thru 0x9d1662 (0x9c7d bytes) 2024-09-22T01:36:21.785 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:21.785 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:21.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:21.785 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:21.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.785 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.785 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:21.785 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.707617919, 2024-09-22T01:36:21.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:36:21.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:36:21.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.789 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.707580890999999, 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:21.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.696030430999997, 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.794 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.795 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:21.798 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.695996424000001, 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.803 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.803 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:21.803 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.692129074, 2024-09-22T01:36:21.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:36:21.803 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.803 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.803 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.692083525999998, 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.807 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:21.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:36:21.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.692038318000002, 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:36:21.811 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:36:21.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:36:21.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.692003726000003, 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.819 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.691970077999997, 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.820 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:36:21.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:36:21.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.823 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.688240587999999, 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:36:21.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.688204085000002, 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.828 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.688159446, 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.832 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:21.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:36:21.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.688109220000001, 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:36:21.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:36:21.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.688070777999997, 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:36:21.840 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.688026782999998, 2024-09-22T01:36:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:21.848 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.687987632999999, 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:36:21.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:36:21.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.852 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.684144465000003, 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.856 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.684064139, 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 52.979510843, 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.861 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:36:21.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:21.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.985369274999996, 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.867 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:21.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:21.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:21.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:21.872 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:21.874 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:21.875 INFO:teuthology.orchestra.run.smithi018.stdout:4114 write 0x2e00777 thru 0x2e09485 (0x8d0f bytes) 2024-09-22T01:36:21.875 INFO:teuthology.orchestra.run.smithi018.stdout:4115 write 0x7611b88 thru 0x7619ad5 (0x7f4e bytes) 2024-09-22T01:36:21.875 INFO:teuthology.orchestra.run.smithi018.stdout:4116 read 0x4707b2f thru 0x470d8a0 (0x5d72 bytes) 2024-09-22T01:36:21.875 INFO:teuthology.orchestra.run.smithi018.stdout:4117 trunc from 0x7619ad6 to 0x6427a34 2024-09-22T01:36:21.875 INFO:teuthology.orchestra.run.smithi018.stdout:4118 read 0x520fbb6 thru 0x521217c (0x25c7 bytes) 2024-09-22T01:36:21.875 INFO:teuthology.orchestra.run.smithi018.stdout:4119 punch from 0x2dee60 to 0x2e7724, (0x88c4 bytes) 2024-09-22T01:36:21.875 INFO:teuthology.orchestra.run.smithi018.stdout:4120 punch from 0x43403f7 to 0x434418c, (0x3d95 bytes) 2024-09-22T01:36:21.875 INFO:teuthology.orchestra.run.smithi018.stdout:4121 trunc from 0x6427a34 to 0x104fe8e 2024-09-22T01:36:21.875 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:21.868+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:21.924 INFO:teuthology.orchestra.run.smithi018.stdout:4124 writesame 0xcd63248 thru 0xcd64b6b data_size 0x1(0x1924 bytes) 2024-09-22T01:36:21.936 INFO:teuthology.orchestra.run.smithi018.stdout:4125 write 0xda20c1a thru 0xda2d87b (0xcc62 bytes) 2024-09-22T01:36:21.942 INFO:teuthology.orchestra.run.smithi018.stdout:4127 write 0x60519be thru 0x6054302 (0x2945 bytes) 2024-09-22T01:36:21.946 INFO:teuthology.orchestra.run.smithi018.stdout:4129 read 0xd88973f thru 0xd8969c7 (0xd289 bytes) 2024-09-22T01:36:21.947 INFO:teuthology.orchestra.run.smithi018.stdout:4130 punch from 0x52a2e01 to 0x52a55b5, (0x27b4 bytes) 2024-09-22T01:36:21.965 INFO:teuthology.orchestra.run.smithi018.stdout:4131 trunc from 0xda2d87c to 0x74ec25e 2024-09-22T01:36:21.974 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:21.971+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:22.000 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:99462 3.f 3:f4da1e38:::rbd_header.110f6d2c01dc:head [call rbd.set_size in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:22.000325+0000", 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.000421004, 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00044047900000000002, 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.001 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 99462 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:22.000325+0000", 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:22.000325+0000", 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:22.000326+0000", 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1149999999999999e-06 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:22.000332+0000", 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4219999999999999e-06 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:22.000347+0000", 2024-09-22T01:36:22.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5398999999999999e-05 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:22.000357+0000", 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0051000000000001e-05 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:22.000478+0000", 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012094100000000001 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:22.000620+0000", 2024-09-22T01:36:22.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141724 2024-09-22T01:36:22.005 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.005 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.005 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.005 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.005 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:36:22.005 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 1 2024-09-22T01:36:22.005 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:22.009 INFO:teuthology.orchestra.run.smithi018.stdout:4132 writesame 0xcf9f8d9 thru 0xcfa3718 data_size 0x53(0x3e40 bytes) 2024-09-22T01:36:22.009 INFO:teuthology.orchestra.run.smithi018.stdout:4135 clone 30 order 25 su 262144 sc 8 2024-09-22T01:36:22.016 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:22.075 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:22.072+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:22.176 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:22.172+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:22.180 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:22.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:22.277 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:22.276+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:22.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:22.321 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 109.00964400300001, 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:36:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:36:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.478871307000006, 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.478644027000001, 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.475475743000004, 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:22.340 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.475391478999995, 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:22.344 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.475339982999998, 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.348 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.475294663, 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:22.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:36:22.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:36:22.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.352 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.471814405999993, 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:22.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:36:22.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:36:22.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.471509593999997, 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.357 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.358 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.360 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.471460149999999, 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.361 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:36:22.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:22.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.471415596, 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.365 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.471371946000005, 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:36:22.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.471324725000002, 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.373 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:36:22.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.471129719000004, 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:36:22.377 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.381 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.471080232000006, 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:22.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:36:22.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:36:22.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.385 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.467929173000002, 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.467583544999997, 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.390 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:36:22.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:36:22.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.393 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.467488122000006, 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:36:22.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.467435542999993, 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.397 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:36:22.400 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 77.467393775999994, 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:22.401 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.404 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.405 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.405 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:22.405 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:22.405 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:22.406 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:22.403+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:22.406 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:22.462 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:22.462 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:22.480 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:22.497 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:22.497 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:22.507 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:22.500+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:22.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:22.514 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:22.535 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:22.535 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:22.542 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:22.542 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:22.555 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:22.556 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:22.557 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:22.578 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:22.578 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:22.599 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:22.599 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:22.608 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:22.604+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:22.710 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:22.707+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:22.713 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:22.713 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:22.728 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:22.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:36:22.816 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:22.812+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:22.864 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:22.864 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:22.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:22.912 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:22.907+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:22.917 INFO:teuthology.orchestra.run.smithi018.stdout:leaving image image_client.0-clone29 intact 2024-09-22T01:36:23.012 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:23.007+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:23.039 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:23.039 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:23.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:23.113 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:23.108+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:23.177 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:23.178 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:23.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:23.205 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-22T01:36:23.214 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:23.211+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:23.250 INFO:teuthology.orchestra.run.smithi018.stdout:4136 write 0x382219 thru 0x390da1 (0xeb89 bytes) 2024-09-22T01:36:23.295 INFO:teuthology.orchestra.run.smithi018.stdout:4137 write 0xe04e22c thru 0xe05cc4e (0xea23 bytes) 2024-09-22T01:36:23.315 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:23.311+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:23.325 INFO:teuthology.orchestra.run.smithi018.stdout:4138 read 0xc67ac1b thru 0xc6834ab (0x8891 bytes) 2024-09-22T01:36:23.326 INFO:teuthology.orchestra.run.smithi018.stdout:4139 read 0x4f8825 thru 0x4fd54e (0x4d2a bytes) 2024-09-22T01:36:23.328 INFO:teuthology.orchestra.run.smithi018.stdout:4140 punch from 0x62045c0 to 0x62084d0, (0x3f10 bytes) 2024-09-22T01:36:23.328 INFO:teuthology.orchestra.run.smithi018.stdout:4141 punch from 0x801ed2e to 0x80264fd, (0x77cf bytes) 2024-09-22T01:36:23.328 INFO:teuthology.orchestra.run.smithi018.stdout:4145 punch from 0x89ac1e to 0x8a136b, (0x674d bytes) 2024-09-22T01:36:23.328 INFO:teuthology.orchestra.run.smithi018.stdout:4146 trunc from 0xe05cc4f to 0xe262c9a 2024-09-22T01:36:23.339 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:23.339 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:23.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:23.366 INFO:teuthology.orchestra.run.smithi018.stdout:4147 trunc from 0xe262c9a to 0x29bb7d2 2024-09-22T01:36:23.416 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:23.411+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:23.504 INFO:teuthology.orchestra.run.smithi018.stdout:4148 write 0xd30289b thru 0xd308d7a (0x64e0 bytes) 2024-09-22T01:36:23.513 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:23.514 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:23.517 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:23.511+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:23.519 INFO:teuthology.orchestra.run.smithi018.stdout:4149 writesame 0xed5afdf thru 0xed67adb data_size 0x13(0xcafd bytes) 2024-09-22T01:36:23.522 INFO:teuthology.orchestra.run.smithi018.stdout:4151 read 0xba2a32b thru 0xba349fe (0xa6d4 bytes) 2024-09-22T01:36:23.524 INFO:teuthology.orchestra.run.smithi018.stdout:4152 trunc from 0xed67adc to 0xec6b8c9 2024-09-22T01:36:23.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:23.536 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:23.536 INFO:teuthology.orchestra.run.smithi018.stdout:4155 read 0xc5e96fc thru 0xc5f0fde (0x78e3 bytes) 2024-09-22T01:36:23.536 INFO:teuthology.orchestra.run.smithi018.stdout:4156 write 0xc9797ab thru 0xc984c7b (0xb4d1 bytes) 2024-09-22T01:36:23.540 INFO:teuthology.orchestra.run.smithi018.stdout:4157 read 0x69807cc thru 0x6980bca (0x3ff bytes) 2024-09-22T01:36:23.540 INFO:teuthology.orchestra.run.smithi018.stdout:4158 write 0x323ae3 thru 0x32c651 (0x8b6f bytes) 2024-09-22T01:36:23.543 INFO:teuthology.orchestra.run.smithi018.stdout:4159 read 0x849beda thru 0x84abc2a (0xfd51 bytes) 2024-09-22T01:36:23.544 INFO:teuthology.orchestra.run.smithi018.stdout:4160 punch from 0x365e196 to 0x366d763, (0xf5cd bytes) 2024-09-22T01:36:23.544 INFO:teuthology.orchestra.run.smithi018.stdout:4161 read 0xa678cd7 thru 0xa6843ed (0xb717 bytes) 2024-09-22T01:36:23.545 INFO:teuthology.orchestra.run.smithi018.stdout:4163 writesame 0xb315638 thru 0xb3217d4 data_size 0x17(0xc19d bytes) 2024-09-22T01:36:23.548 INFO:teuthology.orchestra.run.smithi018.stdout:4164 writesame 0x709f98a thru 0x70a7537 data_size 0x9(0x7bae bytes) 2024-09-22T01:36:23.555 INFO:teuthology.orchestra.run.smithi018.stdout:4165 writesame 0x7e29f6d thru 0x7e30178 data_size 0x32(0x620c bytes) 2024-09-22T01:36:23.559 INFO:teuthology.orchestra.run.smithi018.stdout:4166 write 0x124e944 thru 0x12572e9 (0x89a6 bytes) 2024-09-22T01:36:23.562 INFO:teuthology.orchestra.run.smithi018.stdout:4167 writesame 0xbfe4155 thru 0xbfec487 data_size 0x1(0x8333 bytes) 2024-09-22T01:36:23.588 INFO:teuthology.orchestra.run.smithi018.stdout:4168 clone 31 order 25 su 524288 sc 5 2024-09-22T01:36:23.618 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:23.612+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:23.667 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:23.667 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:23.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:23.724 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:23.720+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:36:23.819 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:23.815+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:23.853 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:23.853 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:23.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:23.887 INFO:teuthology.orchestra.run.smithi018.stdout:flattening image image_client.0-clone30 2024-09-22T01:36:23.920 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:23.916+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:23.999 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:23.999 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:24.017 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:24.064 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:24.060+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:24.122 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:24.119+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:24.128 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-22T01:36:24.187 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:24.187 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:24.206 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:24.256 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:24.252+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:24.325 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:24.319+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:24.338 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:24.338 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:24.355 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:24.426 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:24.420+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:24.484 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:24.485 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:24.498 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:24.506 INFO:teuthology.orchestra.run.smithi018.stdout:4169 write 0x440237f thru 0x440c5f0 (0xa272 bytes) 2024-09-22T01:36:24.526 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:24.520+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:24.541 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:24.541 INFO:teuthology.orchestra.run.smithi018.stdout:4171 read 0xa042acf thru 0xa04830d (0x583f bytes) 2024-09-22T01:36:24.542 INFO:teuthology.orchestra.run.smithi018.stdout:4172 writesame 0x395de8f thru 0x3968594 data_size 0x1(0xa706 bytes) 2024-09-22T01:36:24.587 INFO:teuthology.orchestra.run.smithi018.stdout:4173 read 0x6190dc5 thru 0x6194325 (0x3561 bytes) 2024-09-22T01:36:24.588 INFO:teuthology.orchestra.run.smithi018.stdout:4174 punch from 0x768c74c to 0x7695ca1, (0x9555 bytes) 2024-09-22T01:36:24.588 INFO:teuthology.orchestra.run.smithi018.stdout:4176 write 0xa2c7f12 thru 0xa2d7c6a (0xfd59 bytes) 2024-09-22T01:36:24.600 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:24.620 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:24.621 INFO:teuthology.orchestra.run.smithi018.stdout:4178 trunc from 0xec6b8c9 to 0x30e88d1 2024-09-22T01:36:24.630 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:24.631 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:24.652 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:24.664 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:24.660+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:24.707 INFO:teuthology.orchestra.run.smithi018.stdout:4181 trunc from 0x30e88d1 to 0xc41a757 2024-09-22T01:36:24.715 INFO:teuthology.orchestra.run.smithi018.stdout:4182 write 0x3a7d951 thru 0x3a8c6a9 (0xed59 bytes) 2024-09-22T01:36:24.718 INFO:teuthology.orchestra.run.smithi018.stdout:4183 write 0x7093185 thru 0x709fe2c (0xcca8 bytes) 2024-09-22T01:36:24.720 INFO:teuthology.orchestra.run.smithi018.stdout:4185 read 0x7f60e3f thru 0x7f6dc17 (0xcdd9 bytes) 2024-09-22T01:36:24.720 INFO:teuthology.orchestra.run.smithi018.stdout:4187 write 0xa5afe55 thru 0xa5b86d0 (0x887c bytes) 2024-09-22T01:36:24.727 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:24.723+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:24.734 INFO:teuthology.orchestra.run.smithi018.stdout:4188 write 0xc933159 thru 0xc93a242 (0x70ea bytes) 2024-09-22T01:36:24.740 INFO:teuthology.orchestra.run.smithi018.stdout:4189 read 0x32ed415 thru 0x32fbe55 (0xea41 bytes) 2024-09-22T01:36:24.744 INFO:teuthology.orchestra.run.smithi018.stdout:4190 trunc from 0xc93a243 to 0xe0052ca 2024-09-22T01:36:24.753 INFO:teuthology.orchestra.run.smithi018.stdout:4191 write 0x71f3554 thru 0x71ff88b (0xc338 bytes) 2024-09-22T01:36:24.756 INFO:teuthology.orchestra.run.smithi018.stdout:4192 write 0x2500a49 thru 0x250fbe1 (0xf199 bytes) 2024-09-22T01:36:24.758 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:24.758 INFO:teuthology.orchestra.run.smithi018.stdout:4194 writesame 0xd3f3aae thru 0xd3fc4b1 data_size 0x2c(0x8a04 bytes) 2024-09-22T01:36:24.763 INFO:teuthology.orchestra.run.smithi018.stdout:4195 write 0x125e913 thru 0x126a5d5 (0xbcc3 bytes) 2024-09-22T01:36:24.765 INFO:teuthology.orchestra.run.smithi018.stdout:4197 write 0xc371d33 thru 0xc37b34a (0x9618 bytes) 2024-09-22T01:36:24.770 INFO:teuthology.orchestra.run.smithi018.stdout:4198 trunc from 0xe0052ca to 0xd77e095 2024-09-22T01:36:24.786 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:24.787 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:24.798 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:24.798 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:24.801 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:24.801 INFO:teuthology.orchestra.run.smithi018.stdout:4200 trunc from 0xd77e095 to 0x6471fb 2024-09-22T01:36:24.818 INFO:teuthology.orchestra.run.smithi018.stdout:4203 read 0x1d293a thru 0x1d69fb (0x40c2 bytes) 2024-09-22T01:36:24.819 INFO:teuthology.orchestra.run.smithi018.stdout:4204 read 0x2a5e84 thru 0x2ab380 (0x54fd bytes) 2024-09-22T01:36:24.819 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:24.819 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:24.838 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:24.838 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:24.842 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:24.839+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:24.844 INFO:teuthology.orchestra.run.smithi018.stdout:4206 write 0xdb6895f thru 0xdb69e99 (0x153b bytes) 2024-09-22T01:36:24.848 INFO:teuthology.orchestra.run.smithi018.stdout:4207 read 0x9bac5cd thru 0x9bb1eba (0x58ee bytes) 2024-09-22T01:36:24.848 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:24.848 INFO:teuthology.orchestra.run.smithi018.stdout:4209 writesame 0xafb4715 thru 0xafc0abd data_size 0x1(0xc3a9 bytes) 2024-09-22T01:36:24.857 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:24.874 INFO:teuthology.orchestra.run.smithi018.stdout:4210 read 0x8a1ff45 thru 0x8a27b88 (0x7c44 bytes) 2024-09-22T01:36:24.876 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:24.895 INFO:teuthology.orchestra.run.smithi018.stdout:4211 trunc from 0xdb69e9a to 0x5749fb 2024-09-22T01:36:24.896 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:24.896 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:24.910 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:24.918 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:24.918 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:24.920 INFO:teuthology.orchestra.run.smithi018.stdout:4213 trunc from 0x5749fb to 0x724d07f 2024-09-22T01:36:24.930 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:24.927+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:24.940 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:24.941 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:24.942 INFO:teuthology.orchestra.run.smithi018.stdout:4215 writesame 0xc504363 thru 0xc508d25 data_size 0x1(0x49c3 bytes) 2024-09-22T01:36:24.942 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:24.942 INFO:teuthology.orchestra.run.smithi018.stdout:4221 writesame 0x3974a4d thru 0x397bbe5 data_size 0x1(0x7199 bytes) 2024-09-22T01:36:24.969 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:24.969 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:24.969 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:24.969 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:24.974 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:24.974 INFO:teuthology.orchestra.run.smithi018.stdout:4224 writesame 0x2934c84 thru 0x293e9af data_size 0x2a(0x9d2c bytes) 2024-09-22T01:36:24.977 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:24.977 INFO:teuthology.orchestra.run.smithi018.stdout:4226 read 0x85eb8d5 thru 0x85f0b19 (0x5245 bytes) 2024-09-22T01:36:24.978 INFO:teuthology.orchestra.run.smithi018.stdout:4228 write 0x1e828e4 thru 0x1e87f9a (0x56b7 bytes) 2024-09-22T01:36:24.981 INFO:teuthology.orchestra.run.smithi018.stdout:4232 read 0x46b282b thru 0x46b3bb5 (0x138b bytes) 2024-09-22T01:36:24.985 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:25.000 INFO:teuthology.orchestra.run.smithi018.stdout:4234 trunc from 0xc508d26 to 0x1fbdc5 2024-09-22T01:36:25.013 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.025 INFO:teuthology.orchestra.run.smithi018.stdout:4237 write 0x3506f8e thru 0x3515192 (0xe205 bytes) 2024-09-22T01:36:25.030 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:25.024+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:25.034 INFO:teuthology.orchestra.run.smithi018.stdout:4239 write 0x3c304f1 thru 0x3c3665b (0x616b bytes) 2024-09-22T01:36:25.047 INFO:teuthology.orchestra.run.smithi018.stdout:4240 writesame 0x5d60b19 thru 0x5d6715f data_size 0x1(0x6647 bytes) 2024-09-22T01:36:25.073 INFO:teuthology.orchestra.run.smithi018.stdout:4241 writesame 0xbc168af thru 0xbc1b7b8 data_size 0x43(0x4f0a bytes) 2024-09-22T01:36:25.073 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.085 INFO:teuthology.orchestra.run.smithi018.stdout:4244 trunc from 0xbc1b7b9 to 0x5a92e08 2024-09-22T01:36:25.097 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.114 INFO:teuthology.orchestra.run.smithi018.stdout:4246 trunc from 0x5a92e08 to 0xe6c642e 2024-09-22T01:36:25.132 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:25.127+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:25.137 INFO:teuthology.orchestra.run.smithi018.stdout:4247 trunc from 0xe6c642e to 0x8cd3170 2024-09-22T01:36:25.146 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:25.146 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:25.146 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:25.146 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:25.146 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:25.152 INFO:teuthology.orchestra.run.smithi018.stdout:4248 punch from 0x4606039 to 0x4614837, (0xe7fe bytes) 2024-09-22T01:36:25.152 INFO:teuthology.orchestra.run.smithi018.stdout:4249 write 0x46c0774 thru 0x46c3b95 (0x3422 bytes) 2024-09-22T01:36:25.156 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.156 INFO:teuthology.orchestra.run.smithi018.stdout:4251 read 0x1885dda thru 0x188fec1 (0xa0e8 bytes) 2024-09-22T01:36:25.157 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.157 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.157 INFO:teuthology.orchestra.run.smithi018.stdout:4256 write 0x290a01b thru 0x290da6e (0x3a54 bytes) 2024-09-22T01:36:25.160 INFO:teuthology.orchestra.run.smithi018.stdout:4258 write 0xc3b9bc thru 0xc42ee3 (0x7528 bytes) 2024-09-22T01:36:25.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:25.184 INFO:teuthology.orchestra.run.smithi018.stdout:4259 writesame 0xa014754 thru 0xa0174e5 data_size 0x13(0x2d92 bytes) 2024-09-22T01:36:25.184 INFO:teuthology.orchestra.run.smithi018.stdout:4260 read 0x68cfe3c thru 0x68dccb8 (0xce7d bytes) 2024-09-22T01:36:25.185 INFO:teuthology.orchestra.run.smithi018.stdout:4262 read 0x4f0f5bb thru 0x4f18d43 (0x9789 bytes) 2024-09-22T01:36:25.186 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.187 INFO:teuthology.orchestra.run.smithi018.stdout:4266 read 0x17efb24 thru 0x17fb1fd (0xb6da bytes) 2024-09-22T01:36:25.188 INFO:teuthology.orchestra.run.smithi018.stdout:4267 write 0x37c153a thru 0x37cbd8a (0xa851 bytes) 2024-09-22T01:36:25.191 INFO:teuthology.orchestra.run.smithi018.stdout:4269 read 0x2ad419c thru 0x2ad6f2b (0x2d90 bytes) 2024-09-22T01:36:25.192 INFO:teuthology.orchestra.run.smithi018.stdout:4272 punch from 0xa300f3 to 0xa3da45, (0xd952 bytes) 2024-09-22T01:36:25.192 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.192 INFO:teuthology.orchestra.run.smithi018.stdout:4276 write 0x6c73f3e thru 0x6c767ec (0x28af bytes) 2024-09-22T01:36:25.195 INFO:teuthology.orchestra.run.smithi018.stdout:4277 read 0x3cfe4b3 thru 0x3d03592 (0x50e0 bytes) 2024-09-22T01:36:25.221 INFO:teuthology.orchestra.run.smithi018.stdout:4278 writesame 0xe85311f thru 0xe85bfe1 data_size 0x17(0x8ec3 bytes) 2024-09-22T01:36:25.221 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.221 INFO:teuthology.orchestra.run.smithi018.stdout:4280 write 0x5c141d thru 0x5c7a98 (0x667c bytes) 2024-09-22T01:36:25.223 INFO:teuthology.orchestra.run.smithi018.stdout:4283 write 0x33a2ddb thru 0x33a362d (0x853 bytes) 2024-09-22T01:36:25.227 INFO:teuthology.orchestra.run.smithi018.stdout:4284 read 0xdf6289f thru 0xdf6c3d9 (0x9b3b bytes) 2024-09-22T01:36:25.227 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.232 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:25.228+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:25.235 INFO:teuthology.orchestra.run.smithi018.stdout:4286 trunc from 0xe85bfe2 to 0xb83b3bc 2024-09-22T01:36:25.248 INFO:teuthology.orchestra.run.smithi018.stdout:4288 writesame 0x33195e2 thru 0x33278bf data_size 0x47(0xe2de bytes) 2024-09-22T01:36:25.252 INFO:teuthology.orchestra.run.smithi018.stdout:4290 write 0x3940bec thru 0x394bf3a (0xb34f bytes) 2024-09-22T01:36:25.256 INFO:teuthology.orchestra.run.smithi018.stdout:4291 write 0xaf53334 thru 0xaf55f9c (0x2c69 bytes) 2024-09-22T01:36:25.282 INFO:teuthology.orchestra.run.smithi018.stdout:4293 trunc from 0xb83b3bc to 0x395fcd2 2024-09-22T01:36:25.333 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:25.328+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:25.333 INFO:teuthology.orchestra.run.smithi018.stdout:4294 write 0x7fd3afa thru 0x7fd95ff (0x5b06 bytes) 2024-09-22T01:36:25.337 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.337 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.337 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.338 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:25.338 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:25.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:25.338 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:25.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85503 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2535424~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.888395781, 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093530897000000002, 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85503 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.339 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2899999999999999e-07 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446999+0000", 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.916e-06 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447004+0000", 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0799999999999996e-06 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.341 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447009+0000", 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4020000000000004e-06 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540204+0000", 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093195373999999997 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540345+0000", 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000140381 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540528+0000", 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000183415 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85504 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2547712~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.888377439000003, 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093891557, 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.343 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85504 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447016+0000", 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5199999999999998e-07 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447018+0000", 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9039999999999999e-06 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447023+0000", 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2750000000000003e-06 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447027+0000", 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4530000000000004e-06 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540594+0000", 2024-09-22T01:36:25.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093566496999999998 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540737+0000", 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014323299999999999 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540907+0000", 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016984300000000001 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.348 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.348 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:25.348 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.888359721, 2024-09-22T01:36:25.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:36:25.348 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.348 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.348 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.348 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.348 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:25.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:36:25.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:36:25.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:36:25.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:36:25.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85514 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1789952~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.884410426000002, 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093579774000000004, 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.353 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85514 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450983+0000", 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7999999999999996e-07 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450985+0000", 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1849999999999998e-06 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450991+0000", 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2129999999999996e-06 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450996+0000", 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4610000000000001e-06 2024-09-22T01:36:25.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544381+0000", 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093384923999999994 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544456+0000", 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5506999999999994e-05 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.357 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544562+0000", 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106004 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.884391495000003, 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.358 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:25.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.361 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.362 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.884372435000003, 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.363 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.365 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.884146571999999, 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.367 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:25.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:36:25.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.371 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85526 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2732032~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.880369645000002, 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093423637000000004, 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85526 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455024+0000", 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2500000000000001e-07 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.373 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455025+0000", 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8959999999999999e-06 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455031+0000", 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0780000000000003e-06 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455035+0000", 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4580000000000003e-06 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548127+0000", 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093091561000000003 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548220+0000", 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3262000000000003e-05 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548447+0000", 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022705699999999999 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85527 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2744320~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.880352485000003, 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093760895999999996, 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85527 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458570+0000", 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035298489999999998 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.377 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458576+0000", 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3229999999999997e-06 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458585+0000", 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5410000000000006e-06 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458591+0000", 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.285e-06 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548485+0000", 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089893197999999994 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548570+0000", 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5853000000000006e-05 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548801+0000", 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023084700000000001 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.379 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85536 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2818048~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.876641655999997, 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093657773999999999, 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.380 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85536 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:25.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458752+0000", 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2500000000000001e-07 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458759+0000", 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0759999999999997e-06 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458766+0000", 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6329999999999996e-06 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458771+0000", 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5900000000000001e-06 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552107+0000", 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093335687000000001 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552246+0000", 2024-09-22T01:36:25.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013969399999999999 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552409+0000", 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000162769 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.876616229, 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.384 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:25.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:36:25.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:36:25.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.388 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85546 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2904064~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.872669414999997, 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093702627999999996, 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85546 2024-09-22T01:36:25.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462724+0000", 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.27e-07 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462726+0000", 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9099999999999999e-06 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462731+0000", 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0969999999999996e-06 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462735+0000", 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5410000000000002e-06 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556116+0000", 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093380303999999997 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556261+0000", 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000145353 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556426+0000", 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016509599999999999 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85547 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1912832~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.872651906000002, 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093927398999999995, 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85547 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4299999999999999e-07 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462743+0000", 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.815e-06 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462748+0000", 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1930000000000001e-06 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462752+0000", 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1269999999999996e-06 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556484+0000", 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093731223000000002 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556561+0000", 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7082999999999994e-05 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556668+0000", 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010761500000000001 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.872634933999997, 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.397 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.398 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.398 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:36:25.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.398 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.398 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.398 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:25.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:25.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:36:25.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85558 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3002368~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:25.402 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.868453012000003, 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093611833000000005, 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85558 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3700000000000001e-07 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466942+0000", 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6509999999999999e-06 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466947+0000", 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466951+0000", 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3460000000000004e-06 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560282+0000", 2024-09-22T01:36:25.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093330294999999994 2024-09-22T01:36:25.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.406 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.406 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560404+0000", 2024-09-22T01:36:25.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012278500000000001 2024-09-22T01:36:25.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.406 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.406 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560552+0000", 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014742100000000001 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85559 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1961984~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.868436146000001, 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093835707000000004, 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.407 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85559 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6699999999999999e-07 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466959+0000", 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.516e-06 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466965+0000", 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0610000000000001e-06 2024-09-22T01:36:25.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466970+0000", 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6930000000000004e-06 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560608+0000", 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093637915000000002 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560688+0000", 2024-09-22T01:36:25.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0139e-05 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560792+0000", 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000104016 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.411 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.868416850999999, 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:25.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:36:25.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:36:25.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.415 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85570 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3100672~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.864483462000003, 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093416421999999999, 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.416 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85570 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470910+0000", 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.46e-07 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470912+0000", 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.829e-06 2024-09-22T01:36:25.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470917+0000", 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0749999999999997e-06 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470923+0000", 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6340000000000003e-06 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564045+0000", 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093121588000000005 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564169+0000", 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000124311 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564326+0000", 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156639 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.420 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.421 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.421 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85571 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2011136~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.421 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:25.421 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.864462334000002, 2024-09-22T01:36:25.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093598939000000006, 2024-09-22T01:36:25.421 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.421 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85571 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470979+0000", 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8327e-05 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470982+0000", 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470999+0000", 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6305999999999999e-05 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471005+0000", 2024-09-22T01:36:25.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0059999999999998e-06 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564351+0000", 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093346425999999996 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564436+0000", 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4425000000000006e-05 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564530+0000", 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3890999999999999e-05 2024-09-22T01:36:25.425 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85572 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3112960~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.864378311000003, 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093850133000000002, 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85572 2024-09-22T01:36:25.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474653+0000", 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036386040000000001 2024-09-22T01:36:25.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474662+0000", 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9330000000000007e-06 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474674+0000", 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2054e-05 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474680+0000", 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000001e-06 2024-09-22T01:36:25.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564595+0000", 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089914358999999999 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564715+0000", 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012013700000000001 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564865+0000", 2024-09-22T01:36:25.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015003600000000001 2024-09-22T01:36:25.430 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.430 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.430 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.430 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.430 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.431 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:25.432 INFO:teuthology.orchestra.run.smithi018.stdout:4299 trunc from 0x7fd9600 to 0xe42ed75 2024-09-22T01:36:25.432 INFO:teuthology.orchestra.run.smithi018.stdout:4301 punch from 0x6b7041c to 0x6b7d461, (0xd045 bytes) 2024-09-22T01:36:25.432 INFO:teuthology.orchestra.run.smithi018.stdout:4302 writesame 0x15836b3 thru 0x158de21 data_size 0x1(0xa76f bytes) 2024-09-22T01:36:25.433 INFO:teuthology.orchestra.run.smithi018.stdout:4303 write 0xb096d1c thru 0xb099f46 (0x322b bytes) 2024-09-22T01:36:25.433 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:25.435 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:25.431+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:25.436 INFO:teuthology.orchestra.run.smithi018.stdout:4304 trunc from 0xe42ed75 to 0x57ae9c4 2024-09-22T01:36:25.466 INFO:teuthology.orchestra.run.smithi018.stdout:4305 read 0xd1537c thru 0xd19ae3 (0x4768 bytes) 2024-09-22T01:36:25.466 INFO:teuthology.orchestra.run.smithi018.stdout:4307 read 0x1557fe9 thru 0x1561867 (0x987f bytes) 2024-09-22T01:36:25.467 INFO:teuthology.orchestra.run.smithi018.stdout:4308 punch from 0x5357e1 to 0x53a8ec, (0x510b bytes) 2024-09-22T01:36:25.471 INFO:teuthology.orchestra.run.smithi018.stdout:4309 trunc from 0x57ae9c4 to 0x6b88163 2024-09-22T01:36:25.502 INFO:teuthology.orchestra.run.smithi018.stdout:4310 write 0x82c2723 thru 0x82c75ff (0x4edd bytes) 2024-09-22T01:36:25.517 INFO:teuthology.orchestra.run.smithi018.stdout:4311 trunc from 0x82c7600 to 0x41647f8 2024-09-22T01:36:25.535 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:25.531+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:25.556 INFO:teuthology.orchestra.run.smithi018.stdout:4312 write 0x64558b2 thru 0x645820f (0x295e bytes) 2024-09-22T01:36:25.559 INFO:teuthology.orchestra.run.smithi018.stdout:4313 read 0x5ab924f thru 0x5ac316f (0x9f21 bytes) 2024-09-22T01:36:25.560 INFO:teuthology.orchestra.run.smithi018.stdout:4314 read 0xac5ec thru 0xba9d7 (0xe3ec bytes) 2024-09-22T01:36:25.563 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:25.563 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:25.563 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:25.563 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:25.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:25.581 INFO:teuthology.orchestra.run.smithi018.stdout:4315 trunc from 0x6458210 to 0xdbbd9e1 2024-09-22T01:36:25.595 INFO:teuthology.orchestra.run.smithi018.stdout:4316 read 0xc25577f thru 0xc25726f (0x1af1 bytes) 2024-09-22T01:36:25.595 INFO:teuthology.orchestra.run.smithi018.stdout:4317 punch from 0x3d02b19 to 0x3d10efe, (0xe3e5 bytes) 2024-09-22T01:36:25.595 INFO:teuthology.orchestra.run.smithi018.stdout:4318 write 0xaaba189 thru 0xaac8c89 (0xeb01 bytes) 2024-09-22T01:36:25.602 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.602 INFO:teuthology.orchestra.run.smithi018.stdout:4320 write 0x6fd7144 thru 0x6fdb288 (0x4145 bytes) 2024-09-22T01:36:25.605 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.605 INFO:teuthology.orchestra.run.smithi018.stdout:4323 punch from 0x6544ff9 to 0x655230c, (0xd313 bytes) 2024-09-22T01:36:25.605 INFO:teuthology.orchestra.run.smithi018.stdout:4324 writesame 0x297aeb6 thru 0x2980f15 data_size 0x30(0x6060 bytes) 2024-09-22T01:36:25.609 INFO:teuthology.orchestra.run.smithi018.stdout:4325 read 0xa1cc2f4 thru 0xa1ce0fa (0x1e07 bytes) 2024-09-22T01:36:25.609 INFO:teuthology.orchestra.run.smithi018.stdout:4326 read 0x82cb2e7 thru 0x82d70b6 (0xbdd0 bytes) 2024-09-22T01:36:25.610 INFO:teuthology.orchestra.run.smithi018.stdout:4327 read 0xcebce93 thru 0xcec0636 (0x37a4 bytes) 2024-09-22T01:36:25.610 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.610 INFO:teuthology.orchestra.run.smithi018.stdout:4330 read 0x7506f5 thru 0x75593f (0x524b bytes) 2024-09-22T01:36:25.611 INFO:teuthology.orchestra.run.smithi018.stdout:4331 punch from 0x6b0dcbb to 0x6b1cde1, (0xf126 bytes) 2024-09-22T01:36:25.611 INFO:teuthology.orchestra.run.smithi018.stdout:4332 punch from 0xc90693b to 0xc9107d6, (0x9e9b bytes) 2024-09-22T01:36:25.611 INFO:teuthology.orchestra.run.smithi018.stdout:4333 writesame 0xc6fbd81 thru 0xc7085f7 data_size 0x25(0xc877 bytes) 2024-09-22T01:36:25.621 INFO:teuthology.orchestra.run.smithi018.stdout:4334 punch from 0xd643d71 to 0xd646378, (0x2607 bytes) 2024-09-22T01:36:25.621 INFO:teuthology.orchestra.run.smithi018.stdout:4335 read 0x343b74d thru 0x344817c (0xca30 bytes) 2024-09-22T01:36:25.622 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:25.622 INFO:teuthology.orchestra.run.smithi018.stdout:4338 read 0xae817ac thru 0xae8bb18 (0xa36d bytes) 2024-09-22T01:36:25.622 INFO:teuthology.orchestra.run.smithi018.stdout:4340 read 0x7dfe12 thru 0x7e20ca (0x22b9 bytes) 2024-09-22T01:36:25.623 INFO:teuthology.orchestra.run.smithi018.stdout:4341 read 0x27ded74 thru 0x27e8293 (0x9520 bytes) 2024-09-22T01:36:25.624 INFO:teuthology.orchestra.run.smithi018.stdout:4342 write 0x5f63926 thru 0x5f649ad (0x1088 bytes) 2024-09-22T01:36:25.627 INFO:teuthology.orchestra.run.smithi018.stdout:4344 write 0x51a8a1d thru 0x51a9cd9 (0x12bd bytes) 2024-09-22T01:36:25.631 INFO:teuthology.orchestra.run.smithi018.stdout:4345 read 0xd6fbbf3 thru 0xd6fc8d7 (0xce5 bytes) 2024-09-22T01:36:25.631 INFO:teuthology.orchestra.run.smithi018.stdout:4346 write 0xdb6e467 thru 0xdb7416d (0x5d07 bytes) 2024-09-22T01:36:25.634 INFO:teuthology.orchestra.run.smithi018.stdout:4347 write 0x8039a32 thru 0x803e4ec (0x4abb bytes) 2024-09-22T01:36:25.637 INFO:teuthology.orchestra.run.smithi018.stdout:4348 punch from 0x8187c6a to 0x81885b9, (0x94f bytes) 2024-09-22T01:36:25.637 INFO:teuthology.orchestra.run.smithi018.stdout:4349 read 0x79a5a38 thru 0x79a5ab1 (0x7a bytes) 2024-09-22T01:36:25.637 INFO:teuthology.orchestra.run.smithi018.stdout:4351 punch from 0x31b7471 to 0x31b786d, (0x3fc bytes) 2024-09-22T01:36:25.637 INFO:teuthology.orchestra.run.smithi018.stdout:4355 write 0x2739fb8 thru 0x273b950 (0x1999 bytes) 2024-09-22T01:36:25.640 INFO:teuthology.orchestra.run.smithi018.stdout:4357 punch from 0x3e1b71b to 0x3e28038, (0xc91d bytes) 2024-09-22T01:36:25.641 INFO:teuthology.orchestra.run.smithi018.stdout:4359 clone 32 order 23 su 32768 sc 4 2024-09-22T01:36:25.666 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:25.663+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:25.738 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:25.736+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:25.743 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:25.744 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:25.744 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:25.744 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:25.744 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:25.761 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:25.762 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7, 0, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:36:25.762 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:36:25.762 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-22T01:36:25.762 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-22T01:36:25.763 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-22T01:36:25.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-22T01:36:25.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:36:25.846 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:25.843+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:25.853 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone31 from 0xdbbd9e1 (overlap 0x1fbdc5) to 0x985bb 2024-09-22T01:36:25.918 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:25.918 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-22T01:36:25.919 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:25.932 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.857713623999999, 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.936 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:36:25.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:36:25.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.940 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.857676595999997, 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.941 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.846126136000002, 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.945 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:25.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:36:25.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.846092128999999, 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:36:25.949 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.842224778999999, 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:36:25.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:36:25.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:36:25.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:36:25.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.842179231000003, 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:36:25.958 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.959 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:36:25.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:36:25.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.962 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.842134023, 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.963 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.964 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:25.964 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.964 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.964 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.964 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:25.964 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.964 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.964 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.966 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.967 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.967 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:36:25.967 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:36:25.967 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.967 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.967 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.967 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.967 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.967 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.967 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.842099431000001, 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:25.968 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.971 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.842065783000002, 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.972 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.838336292999998, 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.976 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:25.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:25.980 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.838299790000001, 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:36:25.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:36:25.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:36:25.984 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.984 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.984 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.984 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:36:25.984 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:36:25.984 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:36:25.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:36:25.985 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.985 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.985 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.986 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.986 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:25.986 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.838255150999998, 2024-09-22T01:36:25.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:36:25.987 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.987 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.987 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.987 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.987 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.987 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.987 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:36:25.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.988 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.988 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.988 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.988 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:25.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:36:25.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:36:25.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.991 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.838204924999999, 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:25.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.838166483000002, 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:25.996 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:25.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.838122488000003, 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.000 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:26.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:36:26.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:36:26.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.838083337999997, 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.004 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.008 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.834240170000001, 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.009 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:36:26.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:36:26.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:36:26.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:36:26.013 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.013 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.013 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.014 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:26.014 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:26.014 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.834159843999998, 2024-09-22T01:36:26.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:36:26.014 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.014 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:26.018 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.129606547999998, 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:26.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:36:26.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:36:26.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:36:26.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:36:26.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:36:26.024 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 56.135464980000002, 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:36:26.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:36:26.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:36:26.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:36:26.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.030 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:26.032 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:26.028+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:26.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:26.133 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:26.128+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:26.203 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:26.203 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:26.203 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:26.203 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:26.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:26.262 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:26.259+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:26.334 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:26.331+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:26.338 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:26.338 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:26.338 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:26.338 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:26.338 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:26.347 INFO:teuthology.orchestra.run.smithi018.stdout:4360 writesame 0xd236d43 thru 0xd23b740 data_size 0x4d(0x49fe bytes) 2024-09-22T01:36:26.352 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:26.407 INFO:teuthology.orchestra.run.smithi018.stdout:4361 write 0x4fc027d thru 0x4fce1e1 (0xdf65 bytes) 2024-09-22T01:36:26.435 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:26.428+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:26.497 INFO:teuthology.orchestra.run.smithi018.stdout:4362 punch from 0x87e5fa5 to 0x87efb02, (0x9b5d bytes) 2024-09-22T01:36:26.500 INFO:teuthology.orchestra.run.smithi018.stdout:4363 trunc from 0xdbbd9e1 to 0xcbb1e22 2024-09-22T01:36:26.535 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:26.531+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 113.23190334, 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.542 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:36:26.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:36:26.548 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.701130644000003, 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.549 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:36:26.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:36:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.552 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.700903363999998, 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.553 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:36:26.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:36:26.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.556 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.697735080000001, 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:36:26.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:36:26.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:36:26.560 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.697650816000007, 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.561 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.697599319999995, 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.565 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.697553999999997, 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:36:26.569 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.570 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.570 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.570 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.570 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.570 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.570 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:36:26.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.570 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:36:26.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.573 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.694073743000004, 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:36:26.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:36:26.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:36:26.577 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.693768930999994, 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.578 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:36:26.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:36:26.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:36:26.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:36:26.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:36:26.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.693719486999996, 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.584 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.693674932999997, 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.588 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:36:26.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.693631283000002, 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.592 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:36:26.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:36:26.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.596 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:26.597 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.693584061999999, 2024-09-22T01:36:26.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:36:26.597 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.597 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.597 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.597 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:36:26.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:36:26.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.693389056000001, 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.601 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:36:26.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.693339569000003, 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.605 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.690188509999999, 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.609 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:26.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:36:26.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.613 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.689842881999994, 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.689747459000003, 2024-09-22T01:36:26.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:36:26.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:26.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:36:26.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:36:26.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:36:26.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:36:26.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:36:26.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.689694880000005, 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.622 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:36:26.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:36:26.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:26.625 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 81.689653113000006, 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:26.629 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:26.630 INFO:teuthology.orchestra.run.smithi018.stdout:4364 trunc from 0xcbb1e22 to 0x7abf596 2024-09-22T01:36:26.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:26.674 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:26.671+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:26.694 INFO:teuthology.orchestra.run.smithi018.stdout:4365 trunc from 0x7abf596 to 0x828871b 2024-09-22T01:36:26.701 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:26.701 INFO:teuthology.orchestra.run.smithi018.stdout:4370 write 0x50224d thru 0x510819 (0xe5cd bytes) 2024-09-22T01:36:26.736 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:26.731+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:26.755 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:36:26.808 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:26.808 INFO:teuthology.orchestra.run.smithi018.stdout:4373 writesame 0x79314f5 thru 0x793bb37 data_size 0x1(0xa643 bytes) 2024-09-22T01:36:26.809 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:26.810 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:26.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:26.810 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:104718 3.12 3:4fb47eae:::rbd_data.110fa04a93b5.000000000000000e:head [stat out=16b,write-same in=1b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:36:26.810 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.808526+0000", 2024-09-22T01:36:26.810 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.00088946100000000003, 2024-09-22T01:36:26.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000909614, 2024-09-22T01:36:26.810 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 104718 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.808526+0000", 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:26.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.808526+0000", 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.808528+0000", 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7239999999999999e-06 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.808534+0000", 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6710000000000002e-06 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:26.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.808547+0000", 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3148e-05 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.808554+0000", 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.302e-06 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.808603+0000", 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8899000000000001e-05 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:26.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:26.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:26.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.808679+0000", 2024-09-22T01:36:26.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5998e-05 2024-09-22T01:36:26.814 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:26.814 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:26.814 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:26.814 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:26.814 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:26.814 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 1 2024-09-22T01:36:26.814 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:26.824 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:26.828 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:26.837 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:26.831+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:26.846 INFO:teuthology.orchestra.run.smithi018.stdout:4376 writesame 0xed3e742 thru 0xed4e588 data_size 0x2f(0xfe47 bytes) 2024-09-22T01:36:26.846 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:26.846 INFO:teuthology.orchestra.run.smithi018.stdout:4379 write 0xd5ac6a6 thru 0xd5b098d (0x42e8 bytes) 2024-09-22T01:36:26.852 INFO:teuthology.orchestra.run.smithi018.stdout:4380 read 0xa897975 thru 0xa8a3ff1 (0xc67d bytes) 2024-09-22T01:36:26.852 INFO:teuthology.orchestra.run.smithi018.stdout:4382 read 0x840d0e3 thru 0x8412046 (0x4f64 bytes) 2024-09-22T01:36:26.860 INFO:teuthology.orchestra.run.smithi018.stdout:4383 trunc from 0xed4e589 to 0x97a6ddc 2024-09-22T01:36:26.879 INFO:teuthology.orchestra.run.smithi018.stdout:4384 punch from 0x1e1094c to 0x1e1d75e, (0xce12 bytes) 2024-09-22T01:36:26.879 INFO:teuthology.orchestra.run.smithi018.stdout:4386 write 0x89056e6 thru 0x8911cd6 (0xc5f1 bytes) 2024-09-22T01:36:26.906 INFO:teuthology.orchestra.run.smithi018.stdout:4387 write 0xd6e2af8 thru 0xd6f26c7 (0xfbd0 bytes) 2024-09-22T01:36:26.915 INFO:teuthology.orchestra.run.smithi018.stdout:4388 punch from 0xd33708a to 0xd3404a0, (0x9416 bytes) 2024-09-22T01:36:26.915 INFO:teuthology.orchestra.run.smithi018.stdout:4389 write 0x9b50e22 thru 0x9b5172e (0x90d bytes) 2024-09-22T01:36:26.917 INFO:teuthology.orchestra.run.smithi018.stdout:4390 write 0x5c842e7 thru 0x5c8542a (0x1144 bytes) 2024-09-22T01:36:26.921 INFO:teuthology.orchestra.run.smithi018.stdout:4393 writesame 0x47e0747 thru 0x47e47b1 data_size 0x17(0x406b bytes) 2024-09-22T01:36:26.924 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:26.924 INFO:teuthology.orchestra.run.smithi018.stdout:4396 writesame 0x8bde8e thru 0x8bfeb6 data_size 0x1(0x2029 bytes) 2024-09-22T01:36:26.938 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:26.935+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:26.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:26.975 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:26.975 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:26.975 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:26.992 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:27.037 INFO:teuthology.orchestra.run.smithi018.stdout:4397 write 0xd0b416c thru 0xd0bcc37 (0x8acc bytes) 2024-09-22T01:36:27.039 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:27.032+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:27.044 INFO:teuthology.orchestra.run.smithi018.stdout:4398 punch from 0x5fa5695 to 0x5fb084e, (0xb1b9 bytes) 2024-09-22T01:36:27.044 INFO:teuthology.orchestra.run.smithi018.stdout:4399 write 0x1e790b0 thru 0x1e81ec1 (0x8e12 bytes) 2024-09-22T01:36:27.047 INFO:teuthology.orchestra.run.smithi018.stdout:4401 read 0x40c66b5 thru 0x40cf663 (0x8faf bytes) 2024-09-22T01:36:27.049 INFO:teuthology.orchestra.run.smithi018.stdout:4402 writesame 0xa1ec4c4 thru 0xa1f7414 data_size 0x1(0xaf51 bytes) 2024-09-22T01:36:27.081 INFO:teuthology.orchestra.run.smithi018.stdout:4404 punch from 0x4d3cdf2 to 0x4d4675f, (0x996d bytes) 2024-09-22T01:36:27.081 INFO:teuthology.orchestra.run.smithi018.stdout:4405 read 0xca32 thru 0x1a252 (0xd821 bytes) 2024-09-22T01:36:27.083 INFO:teuthology.orchestra.run.smithi018.stdout:4406 punch from 0x631e047 to 0x6321a80, (0x3a39 bytes) 2024-09-22T01:36:27.083 INFO:teuthology.orchestra.run.smithi018.stdout:4408 read 0x2e14a58 thru 0x2e1cd93 (0x833c bytes) 2024-09-22T01:36:27.084 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:27.084 INFO:teuthology.orchestra.run.smithi018.stdout:4411 writesame 0x9f196b0 thru 0x9f1de12 data_size 0x2b(0x4763 bytes) 2024-09-22T01:36:27.091 INFO:teuthology.orchestra.run.smithi018.stdout:4412 flatten 2024-09-22T01:36:27.107 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:27.107 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:27.139 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:27.139 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:27.140 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:27.135+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:27.168 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:27.168 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:27.188 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:27.188 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:27.189 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:27.189 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:27.210 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:27.211 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:27.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:27.231 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:27.232 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:27.255 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:27.255 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:27.256 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:27.248+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:27.275 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:27.275 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:27.279 INFO:teuthology.orchestra.run.smithi018.stdout:4414 write 0x3c0ca0c thru 0x3c11e16 (0x540b bytes) 2024-09-22T01:36:27.282 INFO:teuthology.orchestra.run.smithi018.stdout:4415 punch from 0x1a13348 to 0x1a1de73, (0xab2b bytes) 2024-09-22T01:36:27.290 INFO:teuthology.orchestra.run.smithi018.stdout:4416 write 0xdd249c8 thru 0xdd2f3d5 (0xaa0e bytes) 2024-09-22T01:36:27.292 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:27.309 INFO:teuthology.orchestra.run.smithi018.stdout:4418 trunc from 0xdd2f3d6 to 0x204aa7f 2024-09-22T01:36:27.336 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:27.341 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:27.335+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:27.356 INFO:teuthology.orchestra.run.smithi018.stdout:4421 write 0x9e834ab thru 0x9e91c46 (0xe79c bytes) 2024-09-22T01:36:27.367 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:27.367 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:27.377 INFO:teuthology.orchestra.run.smithi018.stdout:4422 write 0xcd9759d thru 0xcda38a0 (0xc304 bytes) 2024-09-22T01:36:27.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:27.398 INFO:teuthology.orchestra.run.smithi018.stdout:4426 trunc from 0xcda38a1 to 0x53483d9 2024-09-22T01:36:27.415 INFO:teuthology.orchestra.run.smithi018.stdout:4427 write 0x360aa44 thru 0x36170b8 (0xc675 bytes) 2024-09-22T01:36:27.435 INFO:teuthology.orchestra.run.smithi018.stdout:4428 write 0x8e19847 thru 0x8e2149f (0x7c59 bytes) 2024-09-22T01:36:27.442 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:27.435+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:27.444 INFO:teuthology.orchestra.run.smithi018.stdout:4429 read 0xe569fd thru 0xe5dd24 (0x7328 bytes) 2024-09-22T01:36:27.445 INFO:teuthology.orchestra.run.smithi018.stdout:4431 punch from 0x37364c8 to 0x373bd3f, (0x5877 bytes) 2024-09-22T01:36:27.454 INFO:teuthology.orchestra.run.smithi018.stdout:4432 trunc from 0x8e214a0 to 0xeb96a36 2024-09-22T01:36:27.466 INFO:teuthology.orchestra.run.smithi018.stdout:4435 writesame 0x8aa2e03 thru 0x8aaf3a1 data_size 0x1(0xc59f bytes) 2024-09-22T01:36:27.503 INFO:teuthology.orchestra.run.smithi018.stdout:4438 write 0xd947b9a thru 0xd947df6 (0x25d bytes) 2024-09-22T01:36:27.511 INFO:teuthology.orchestra.run.smithi018.stdout:4444 write 0xeb3e1c4 thru 0xeb46f66 (0x8da3 bytes) 2024-09-22T01:36:27.520 INFO:teuthology.orchestra.run.smithi018.stdout:4445 write 0xd41b20f thru 0xd428318 (0xd10a bytes) 2024-09-22T01:36:27.521 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:27.521 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:27.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:27.543 INFO:teuthology.orchestra.run.smithi018.stdout:4446 trunc from 0xeb96a36 to 0x8f10a59 2024-09-22T01:36:27.543 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:27.536+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:27.568 INFO:teuthology.orchestra.run.smithi018.stdout:4447 writesame 0x8e1cd5d thru 0x8e1d82a data_size 0x3(0xace bytes) 2024-09-22T01:36:27.572 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:27.580 INFO:teuthology.orchestra.run.smithi018.stdout:4449 trunc from 0x8f10a59 to 0x29910cf 2024-09-22T01:36:27.606 INFO:teuthology.orchestra.run.smithi018.stdout:4450 punch from 0xba1be3 to 0xba23fc, (0x819 bytes) 2024-09-22T01:36:27.626 INFO:teuthology.orchestra.run.smithi018.stdout:4451 write 0x50eb92f thru 0x50efda2 (0x4474 bytes) 2024-09-22T01:36:27.634 INFO:teuthology.orchestra.run.smithi018.stdout:4453 read 0x1b923aa thru 0x1b9f329 (0xcf80 bytes) 2024-09-22T01:36:27.643 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:27.636+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:27.652 INFO:teuthology.orchestra.run.smithi018.stdout:4454 writesame 0x7387ac2 thru 0x738c5b6 data_size 0x1(0x4af5 bytes) 2024-09-22T01:36:27.652 INFO:teuthology.orchestra.run.smithi018.stdout:4455 read 0x1ef88b7 thru 0x1f08567 (0xfcb1 bytes) 2024-09-22T01:36:27.653 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:27.653 INFO:teuthology.orchestra.run.smithi018.stdout:4458 read 0x1174da7 thru 0x117ff01 (0xb15b bytes) 2024-09-22T01:36:27.654 INFO:teuthology.orchestra.run.smithi018.stdout:4460 punch from 0x680199d to 0x6809dde, (0x8441 bytes) 2024-09-22T01:36:27.655 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:27.655 INFO:teuthology.orchestra.run.smithi018.stdout:4462 read 0x5111d8 thru 0x51cb02 (0xb92b bytes) 2024-09-22T01:36:27.656 INFO:teuthology.orchestra.run.smithi018.stdout:4464 punch from 0xc4812f to 0xc57605, (0xf4d6 bytes) 2024-09-22T01:36:27.656 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:27.656 INFO:teuthology.orchestra.run.smithi018.stdout:4469 read 0x7365875 thru 0x736885e (0x2fea bytes) 2024-09-22T01:36:27.674 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:27.674 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:27.680 INFO:teuthology.orchestra.run.smithi018.stdout:4470 write 0xc906c0a thru 0xc90ca73 (0x5e6a bytes) 2024-09-22T01:36:27.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:27.689 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:27.689 INFO:teuthology.orchestra.run.smithi018.stdout:4473 read 0x944994c thru 0x944d740 (0x3df5 bytes) 2024-09-22T01:36:27.689 INFO:teuthology.orchestra.run.smithi018.stdout:4474 read 0x4891f98 thru 0x4899a96 (0x7aff bytes) 2024-09-22T01:36:27.689 INFO:teuthology.orchestra.run.smithi018.stdout:4479 read 0x99eefb0 thru 0x99f49c7 (0x5a18 bytes) 2024-09-22T01:36:27.703 INFO:teuthology.orchestra.run.smithi018.stdout:4480 write 0xec4753a thru 0xec55079 (0xdb40 bytes) 2024-09-22T01:36:27.714 INFO:teuthology.orchestra.run.smithi018.stdout:4481 write 0x9f42e80 thru 0x9f4e843 (0xb9c4 bytes) 2024-09-22T01:36:27.723 INFO:teuthology.orchestra.run.smithi018.stdout:4482 punch from 0x7b64aaf to 0x7b6840e, (0x395f bytes) 2024-09-22T01:36:27.723 INFO:teuthology.orchestra.run.smithi018.stdout:4483 write 0x8c4bfd3 thru 0x8c54a89 (0x8ab7 bytes) 2024-09-22T01:36:27.729 INFO:teuthology.orchestra.run.smithi018.stdout:4484 write 0x5e382c9 thru 0x5e45b08 (0xd840 bytes) 2024-09-22T01:36:27.738 INFO:teuthology.orchestra.run.smithi018.stdout:4485 punch from 0x4eb944e to 0x4ec085c, (0x740e bytes) 2024-09-22T01:36:27.738 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:27.745 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:27.739+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:27.750 INFO:teuthology.orchestra.run.smithi018.stdout:4487 writesame 0xed7ba4b thru 0xed89fa3 data_size 0x1(0xe559 bytes) 2024-09-22T01:36:27.752 INFO:teuthology.orchestra.run.smithi018.stdout:4488 write 0xcf81ac8 thru 0xcf8ba5d (0x9f96 bytes) 2024-09-22T01:36:27.755 INFO:teuthology.orchestra.run.smithi018.stdout:4490 read 0x39f4d3a thru 0x39f70d3 (0x239a bytes) 2024-09-22T01:36:27.755 INFO:teuthology.orchestra.run.smithi018.stdout:4491 punch from 0xc612869 to 0xc61b8dc, (0x9073 bytes) 2024-09-22T01:36:27.755 INFO:teuthology.orchestra.run.smithi018.stdout:4492 read 0x51eedd1 thru 0x51ef968 (0xb98 bytes) 2024-09-22T01:36:27.756 INFO:teuthology.orchestra.run.smithi018.stdout:4493 writesame 0x8cbd0cb thru 0x8cbdbcb data_size 0x3(0xb01 bytes) 2024-09-22T01:36:27.763 INFO:teuthology.orchestra.run.smithi018.stdout:4494 writesame 0x25ac03b thru 0x25ba082 data_size 0x4(0xe048 bytes) 2024-09-22T01:36:27.787 INFO:teuthology.orchestra.run.smithi018.stdout:4495 trunc from 0xed89fa4 to 0x3b3a7eb 2024-09-22T01:36:27.822 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:27.823 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:27.837 INFO:teuthology.orchestra.run.smithi018.stdout:4496 write 0x9069949 thru 0x9076359 (0xca11 bytes) 2024-09-22T01:36:27.838 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:27.846 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:27.846 INFO:teuthology.orchestra.run.smithi018.stdout:4498 read 0x7731975 thru 0x773e5cc (0xcc58 bytes) 2024-09-22T01:36:27.846 INFO:teuthology.orchestra.run.smithi018.stdout:4499 punch from 0x53d977a to 0x53e69aa, (0xd230 bytes) 2024-09-22T01:36:27.846 INFO:teuthology.orchestra.run.smithi018.stdout:4501 read 0x17de402 thru 0x17df614 (0x1213 bytes) 2024-09-22T01:36:27.846 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:27.839+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:27.852 INFO:teuthology.orchestra.run.smithi018.stdout:4502 trunc from 0x907635a to 0xd603bd9 2024-09-22T01:36:27.863 INFO:teuthology.orchestra.run.smithi018.stdout:4503 read 0xa95722b thru 0xa963fd5 (0xcdab bytes) 2024-09-22T01:36:27.863 INFO:teuthology.orchestra.run.smithi018.stdout:4504 read 0x2e0e85a thru 0x2e0f855 (0xffc bytes) 2024-09-22T01:36:27.864 INFO:teuthology.orchestra.run.smithi018.stdout:4506 read 0x4613c24 thru 0x461644b (0x2828 bytes) 2024-09-22T01:36:27.864 INFO:teuthology.orchestra.run.smithi018.stdout:4507 read 0xaa3594f thru 0xaa4246c (0xcb1e bytes) 2024-09-22T01:36:27.864 INFO:teuthology.orchestra.run.smithi018.stdout:4508 punch from 0x1cc69ae to 0x1cd1a26, (0xb078 bytes) 2024-09-22T01:36:27.875 INFO:teuthology.orchestra.run.smithi018.stdout:4510 trunc from 0xd603bd9 to 0x55508f1 2024-09-22T01:36:27.898 INFO:teuthology.orchestra.run.smithi018.stdout:4513 clone 33 order 23 su 524288 sc 11 2024-09-22T01:36:27.946 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:27.943+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:27.965 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:27.965 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:27.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:28.047 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:28.043+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:28.146 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:28.146 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:28.148 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:28.140+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:28.161 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:28.248 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:28.244+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:28.333 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:28.333 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:28.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:28.392 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:28.388+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:28.449 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:28.443+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:28.513 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:28.513 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:28.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:28.576 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:28.572+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:28.651 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:28.644+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:28.657 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:28.657 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:28.672 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:28.752 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:28.748+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:28.801 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:36:28.810 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:28.810 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:28.825 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:28.870 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:28.867+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:28.954 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:28.954 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:28.954 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:28.948+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:28.968 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:28.990 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-22T01:36:28.995 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:28.995 INFO:teuthology.orchestra.run.smithi018.stdout:4517 write 0x3772298 thru 0x3776ec9 (0x4c32 bytes) 2024-09-22T01:36:29.029 INFO:teuthology.orchestra.run.smithi018.stdout:4519 trunc from 0x55508f1 to 0x39163a1 2024-09-22T01:36:29.055 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:29.051+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:29.131 INFO:teuthology.orchestra.run.smithi018.stdout:4520 punch from 0x388401a to 0x389192c, (0xd912 bytes) 2024-09-22T01:36:29.139 INFO:teuthology.orchestra.run.smithi018.stdout:4521 writesame 0x50ae4e8 thru 0x50b99e7 data_size 0x40(0xb500 bytes) 2024-09-22T01:36:29.154 INFO:teuthology.orchestra.run.smithi018.stdout:4522 write 0x935ac70 thru 0x93632c8 (0x8659 bytes) 2024-09-22T01:36:29.156 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:29.151+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:29.157 INFO:teuthology.orchestra.run.smithi018.stdout:4523 read 0x35ff2ff thru 0x360272f (0x3431 bytes) 2024-09-22T01:36:29.158 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:29.158 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:29.158 INFO:teuthology.orchestra.run.smithi018.stdout:4524 read 0x90d911c thru 0x90e16c2 (0x85a7 bytes) 2024-09-22T01:36:29.158 INFO:teuthology.orchestra.run.smithi018.stdout:4525 read 0x8e5ce33 thru 0x8e63778 (0x6946 bytes) 2024-09-22T01:36:29.158 INFO:teuthology.orchestra.run.smithi018.stdout:4526 punch from 0x8728fd4 to 0x87368e5, (0xd911 bytes) 2024-09-22T01:36:29.159 INFO:teuthology.orchestra.run.smithi018.stdout:4527 writesame 0x64f269b thru 0x64f89d4 data_size 0xd(0x633a bytes) 2024-09-22T01:36:29.164 INFO:teuthology.orchestra.run.smithi018.stdout:4528 write 0x27eab44 thru 0x27eeb8f (0x404c bytes) 2024-09-22T01:36:29.166 INFO:teuthology.orchestra.run.smithi018.stdout:4529 writesame 0x866057 thru 0x86a7ea data_size 0x12(0x4794 bytes) 2024-09-22T01:36:29.171 INFO:teuthology.orchestra.run.smithi018.stdout:4530 read 0x3fd17bb thru 0x3fde3cd (0xcc13 bytes) 2024-09-22T01:36:29.171 INFO:teuthology.orchestra.run.smithi018.stdout:4533 write 0x8044dc2 thru 0x804c868 (0x7aa7 bytes) 2024-09-22T01:36:29.173 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:29.173 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:29.173 INFO:teuthology.orchestra.run.smithi018.stdout:4540 punch from 0x1d156f to 0x1d546e, (0x3eff bytes) 2024-09-22T01:36:29.173 INFO:teuthology.orchestra.run.smithi018.stdout:4541 clone 34 order 22 su 16384 sc 5 2024-09-22T01:36:29.258 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:29.255+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:29.298 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:29.335 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:29.335 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:29.349 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:29.358 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:29.352+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:29.451 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:29.452 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:29.459 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:29.452+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:29.468 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:29.468 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:29.484 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:29.485 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:29.501 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:29.515 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:29.515 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:29.522 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:29.530 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:29.542 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:29.543 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:29.563 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:29.564 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:29.574 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:29.571+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:29.586 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:29.648 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85503 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2535424~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.198830256999997, 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093530897000000002, 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.649 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85503 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446997+0000", 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2899999999999999e-07 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.446999+0000", 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.916e-06 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447004+0000", 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0799999999999996e-06 2024-09-22T01:36:29.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447009+0000", 2024-09-22T01:36:29.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4020000000000004e-06 2024-09-22T01:36:29.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540204+0000", 2024-09-22T01:36:29.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093195373999999997 2024-09-22T01:36:29.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540345+0000", 2024-09-22T01:36:29.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000140381 2024-09-22T01:36:29.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540528+0000", 2024-09-22T01:36:29.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000183415 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85504 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2547712~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.198811915, 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093891557, 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85504 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447015+0000", 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447016+0000", 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5199999999999998e-07 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447018+0000", 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9039999999999999e-06 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447023+0000", 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2750000000000003e-06 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447027+0000", 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4530000000000004e-06 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540594+0000", 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093566496999999998 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540737+0000", 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014323299999999999 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540907+0000", 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016984300000000001 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.198794196999998, 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.659 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:29.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85514 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1789952~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.194844902, 2024-09-22T01:36:29.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093579774000000004, 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85514 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450982+0000", 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450983+0000", 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7999999999999996e-07 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450985+0000", 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1849999999999998e-06 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450991+0000", 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2129999999999996e-06 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450996+0000", 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4610000000000001e-06 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544381+0000", 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093384923999999994 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544456+0000", 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5506999999999994e-05 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544562+0000", 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106004 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.194825971, 2024-09-22T01:36:29.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.194806911000001, 2024-09-22T01:36:29.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:36:29.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.194581048000003, 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.675 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:36:29.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:36:29.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85526 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2732032~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.190804120999999, 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093423637000000004, 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.679 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.680 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.680 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.680 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.680 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85526 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455023+0000", 2024-09-22T01:36:29.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455024+0000", 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2500000000000001e-07 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455025+0000", 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8959999999999999e-06 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455031+0000", 2024-09-22T01:36:29.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0780000000000003e-06 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455035+0000", 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4580000000000003e-06 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548127+0000", 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093091561000000003 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548220+0000", 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3262000000000003e-05 2024-09-22T01:36:29.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548447+0000", 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022705699999999999 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85527 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2744320~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.190786961000001, 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093760895999999996, 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.684 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85527 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.455040+0000", 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458570+0000", 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035298489999999998 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458576+0000", 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3229999999999997e-06 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458585+0000", 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5410000000000006e-06 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458591+0000", 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.285e-06 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548485+0000", 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089893197999999994 2024-09-22T01:36:29.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548570+0000", 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5853000000000006e-05 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.548801+0000", 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023084700000000001 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85536 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2818048~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.688 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.187076132000001, 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093657773999999999, 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85536 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:29.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458751+0000", 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458752+0000", 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2500000000000001e-07 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458759+0000", 2024-09-22T01:36:29.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0759999999999997e-06 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458766+0000", 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6329999999999996e-06 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458771+0000", 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5900000000000001e-06 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552107+0000", 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093335687000000001 2024-09-22T01:36:29.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552246+0000", 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013969399999999999 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552409+0000", 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000162769 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.692 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.187050704999997, 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:29.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:36:29.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:36:29.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85546 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2904064~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.696 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.183103891000002, 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093702627999999996, 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85546 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:29.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462723+0000", 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462724+0000", 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.27e-07 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462726+0000", 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9099999999999999e-06 2024-09-22T01:36:29.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462731+0000", 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0969999999999996e-06 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462735+0000", 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5410000000000002e-06 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556116+0000", 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093380303999999997 2024-09-22T01:36:29.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556261+0000", 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000145353 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556426+0000", 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016509599999999999 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85547 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1912832~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.700 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.183086381999999, 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093927398999999995, 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85547 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462741+0000", 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4299999999999999e-07 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462743+0000", 2024-09-22T01:36:29.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.815e-06 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462748+0000", 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1930000000000001e-06 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462752+0000", 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1269999999999996e-06 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556484+0000", 2024-09-22T01:36:29.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093731223000000002 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556561+0000", 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7082999999999994e-05 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556668+0000", 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00010761500000000001 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.704 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.183069410000002, 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:36:29.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85558 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3002368~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.178887488000001, 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093611833000000005, 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85558 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466940+0000", 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3700000000000001e-07 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466942+0000", 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6509999999999999e-06 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466947+0000", 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466951+0000", 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3460000000000004e-06 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560282+0000", 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093330294999999994 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560404+0000", 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012278500000000001 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560552+0000", 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014742100000000001 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85559 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1961984~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.178870621999998, 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093835707000000004, 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85559 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466957+0000", 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6699999999999999e-07 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466959+0000", 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.516e-06 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466965+0000", 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0610000000000001e-06 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466970+0000", 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6930000000000004e-06 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560608+0000", 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093637915000000002 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560688+0000", 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0139e-05 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560792+0000", 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000104016 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.178851326999997, 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85570 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3100672~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.174917938, 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093416421999999999, 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85570 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470909+0000", 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470910+0000", 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.46e-07 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470912+0000", 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.829e-06 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470917+0000", 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0749999999999997e-06 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470923+0000", 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6340000000000003e-06 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564045+0000", 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093121588000000005 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564169+0000", 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000124311 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564326+0000", 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156639 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85571 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2011136~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.17489681, 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093598939000000006, 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85571 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470931+0000", 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470979+0000", 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8327e-05 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470982+0000", 2024-09-22T01:36:29.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470999+0000", 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6305999999999999e-05 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471005+0000", 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0059999999999998e-06 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564351+0000", 2024-09-22T01:36:29.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093346425999999996 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564436+0000", 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4425000000000006e-05 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564530+0000", 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3890999999999999e-05 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.728 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85572 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3112960~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 49.174812787, 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093850133000000002, 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85572 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:29.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.471015+0000", 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474653+0000", 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036386040000000001 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474662+0000", 2024-09-22T01:36:29.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9330000000000007e-06 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474674+0000", 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2054e-05 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.474680+0000", 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0100000000000001e-06 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564595+0000", 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089914358999999999 2024-09-22T01:36:29.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564715+0000", 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012013700000000001 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.564865+0000", 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015003600000000001 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:29.732 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:29.734 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:29.734 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:29.731+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:29.775 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:36:29.835 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:29.828+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:29.880 INFO:teuthology.orchestra.run.smithi018.stdout:leaving image image_client.0-clone33 intact 2024-09-22T01:36:29.911 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:29.911 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:29.911 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:29.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:29.970 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:29.967+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:30.036 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:30.031+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:30.045 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:30.045 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:30.045 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:30.045 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:30.045 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:30.059 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:30.098 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-22T01:36:30.150 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:30.147+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:30.229 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:30.229 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:30.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:30.229 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:30.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.229 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.229 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:30.229 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.150752390000001, 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:30.230 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:36:30.231 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:36:30.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.233 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.150715362, 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:30.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:36:30.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.237 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.139164901999997, 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:30.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:36:30.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:36:30.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.241 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.139130895000001, 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:30.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:36:30.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:36:30.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.245 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.135263545000001, 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:36:30.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.135217996999998, 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.250 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:36:30.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:36:30.253 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.135172789000002, 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.254 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:36:30.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:36:30.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.135138197000003, 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.258 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.135104548999998, 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.262 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:36:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:36:30.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.131375059, 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.266 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:30.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:36:30.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.131338556000003, 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.270 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.131293917000001, 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.274 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.131243691000002, 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.278 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.131205248999997, 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.282 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.131161253999998, 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.286 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:30.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:36:30.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:36:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.131122103999999, 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.290 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:36:30.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.127278936000003, 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.294 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:36:30.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.127198610000001, 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:30.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:36:30.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 61.422645314, 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:36:30.301 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:36:30.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:36:30.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.306 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 60.428503745999997, 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:36:30.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:36:30.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:36:30.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:36:30.311 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.312 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.312 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.312 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.312 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.312 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:30.313 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:30.313 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:30.308+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:30.386 INFO:teuthology.orchestra.run.smithi018.stdout:4543 trunc from 0x93632c9 to 0x3892ec9 2024-09-22T01:36:30.414 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:30.407+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:30.498 INFO:teuthology.orchestra.run.smithi018.stdout:4547 punch from 0x2a214e7 to 0x2a28450, (0x6f69 bytes) 2024-09-22T01:36:30.498 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:30.498 INFO:teuthology.orchestra.run.smithi018.stdout:4549 write 0x1cfbcbc thru 0x1d04f78 (0x92bd bytes) 2024-09-22T01:36:30.515 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:30.508+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109512 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.513950+0000", 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.009465612, 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0094920349999999994, 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109512 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513950+0000", 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513950+0000", 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513951+0000", 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1399999999999997e-07 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513954+0000", 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.631e-06 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513963+0000", 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0250000000000008e-06 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513969+0000", 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9950000000000002e-06 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109653 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516274+0000", 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0071412300000000001, 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0072392430000000002, 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.535 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109653 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516274+0000", 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516274+0000", 2024-09-22T01:36:30.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516275+0000", 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1800000000000001e-07 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516277+0000", 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9879999999999999e-06 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516283+0000", 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.331e-06 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516288+0000", 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.169e-06 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109787 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.520094+0000", 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0033218219999999999, 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034808679999999998, 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.538 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109787 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520094+0000", 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520094+0000", 2024-09-22T01:36:30.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520094+0000", 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1400000000000001e-07 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520095+0000", 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.299e-06 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520100+0000", 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.211e-06 2024-09-22T01:36:30.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520104+0000", 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5730000000000001e-06 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109896 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.521983+0000", 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0014321889999999999, 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001650061, 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.541 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109896 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.521983+0000", 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.521983+0000", 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.521984+0000", 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1399999999999997e-07 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.521986+0000", 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2129999999999998e-06 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522002+0000", 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6308999999999999e-05 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522278+0000", 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027532199999999999 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109513 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.513986+0000", 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.009429537, 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0097060270000000008, 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.544 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109513 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513986+0000", 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513986+0000", 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513987+0000", 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8800000000000003e-07 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513989+0000", 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3520000000000001e-06 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.513996+0000", 2024-09-22T01:36:30.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8279999999999997e-06 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514001+0000", 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0159999999999999e-06 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109654 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516295+0000", 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0071206430000000003, 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0074585780000000004, 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.547 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109654 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516295+0000", 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516295+0000", 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516296+0000", 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.61e-07 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516298+0000", 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0339999999999999e-06 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516304+0000", 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4659999999999996e-06 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516309+0000", 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1869999999999996e-06 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109788 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.520111+0000", 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0033047490000000001, 2024-09-22T01:36:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003708888, 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109788 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520111+0000", 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520111+0000", 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520111+0000", 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9499999999999998e-07 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520114+0000", 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3599999999999999e-06 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520120+0000", 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4370000000000004e-06 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520125+0000", 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0440000000000003e-06 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109897 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.522292+0000", 2024-09-22T01:36:30.553 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0011240169999999999, 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001585342, 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109897 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522292+0000", 2024-09-22T01:36:30.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522292+0000", 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522292+0000", 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.1200000000000002e-07 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522295+0000", 2024-09-22T01:36:30.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.089e-06 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522304+0000", 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5990000000000002e-06 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522312+0000", 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8809999999999996e-06 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109514 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514008+0000", 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0094080139999999993, 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0099292340000000003, 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109514 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514008+0000", 2024-09-22T01:36:30.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514008+0000", 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514008+0000", 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2199999999999999e-07 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514010+0000", 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.074e-06 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514025+0000", 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5206e-05 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514030+0000", 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8579999999999999e-06 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109655 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516316+0000", 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0070992130000000001, 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0076824989999999998, 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109655 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516316+0000", 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516316+0000", 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516317+0000", 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.08e-07 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516319+0000", 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3640000000000002e-06 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516327+0000", 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.3159999999999999e-06 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516332+0000", 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0459999999999996e-06 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109789 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.520132+0000", 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0032839509999999998, 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039278680000000002, 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109789 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520132+0000", 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520132+0000", 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520132+0000", 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.39e-07 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520134+0000", 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1090000000000001e-06 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520141+0000", 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2169999999999999e-06 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520145+0000", 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9010000000000002e-06 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109898 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.522320+0000", 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0010960119999999999, 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001798326, 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109898 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522320+0000", 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522320+0000", 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522320+0000", 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8500000000000002e-07 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522323+0000", 2024-09-22T01:36:30.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4940000000000002e-06 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522329+0000", 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7719999999999997e-06 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522335+0000", 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5099999999999998e-06 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.568 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109515 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514037+0000", 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0093782469999999993, 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010146041, 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109515 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514037+0000", 2024-09-22T01:36:30.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514037+0000", 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514038+0000", 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7100000000000002e-07 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514045+0000", 2024-09-22T01:36:30.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4630000000000004e-06 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514052+0000", 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0940000000000002e-06 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514066+0000", 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3738e-05 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109656 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516339+0000", 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0070771560000000002, 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0078963530000000001, 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109656 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516339+0000", 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516339+0000", 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516339+0000", 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5899999999999996e-07 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516341+0000", 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2469999999999998e-06 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516348+0000", 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3539999999999996e-06 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516353+0000", 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9470000000000002e-06 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.574 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109790 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.520162+0000", 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0032535519999999998, 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0041345879999999998, 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109790 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520162+0000", 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520162+0000", 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520163+0000", 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5599999999999995e-07 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520287+0000", 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012429699999999999 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520296+0000", 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.5960000000000004e-06 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520301+0000", 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5659999999999997e-06 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109899 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.522342+0000", 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0010736949999999999, 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0020162259999999999, 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109899 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522342+0000", 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522342+0000", 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522342+0000", 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6499999999999999e-07 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522345+0000", 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1229999999999998e-06 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522352+0000", 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7079999999999997e-06 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522357+0000", 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1850000000000003e-06 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.580 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109516 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514097+0000", 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0093189729999999995, 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010329914000000001, 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109516 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514097+0000", 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514097+0000", 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514097+0000", 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.3600000000000003e-07 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514100+0000", 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8590000000000001e-06 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514107+0000", 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.1219999999999997e-06 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514113+0000", 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3820000000000003e-06 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.583 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109657 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516364+0000", 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0070515760000000004, 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0081317179999999996, 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109657 2024-09-22T01:36:30.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516364+0000", 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516364+0000", 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516365+0000", 2024-09-22T01:36:30.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3300000000000003e-07 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516367+0000", 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5399999999999998e-06 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516374+0000", 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2849999999999997e-06 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516379+0000", 2024-09-22T01:36:30.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4009999999999999e-06 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109791 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.520311+0000", 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0031051799999999999, 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.004245431, 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.587 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109791 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520311+0000", 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520311+0000", 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520311+0000", 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7199999999999998e-07 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520314+0000", 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4940000000000002e-06 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520321+0000", 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.3390000000000004e-06 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520327+0000", 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6319999999999996e-06 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109900 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.522387+0000", 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.001029184, 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002227134, 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.590 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109900 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522387+0000", 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522387+0000", 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522387+0000", 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522390+0000", 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.224e-06 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522673+0000", 2024-09-22T01:36:30.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028254099999999998 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522680+0000", 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.3540000000000002e-06 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109517 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514120+0000", 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0092960760000000003, 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010547414999999999, 2024-09-22T01:36:30.593 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109517 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514120+0000", 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514120+0000", 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514120+0000", 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6599999999999996e-07 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514122+0000", 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.041e-06 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514137+0000", 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4455e-05 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514142+0000", 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7429999999999999e-06 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109658 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516387+0000", 2024-09-22T01:36:30.596 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0070291399999999997, 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0083340940000000002, 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109658 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516387+0000", 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516387+0000", 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516387+0000", 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1800000000000001e-07 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516389+0000", 2024-09-22T01:36:30.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3989999999999998e-06 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516396+0000", 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2870000000000001e-06 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516401+0000", 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8980000000000004e-06 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109792 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.520335+0000", 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0030810199999999999, 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.004443537, 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109792 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520335+0000", 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520335+0000", 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520335+0000", 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2099999999999997e-07 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520338+0000", 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.322e-06 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520344+0000", 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6250000000000001e-06 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520349+0000", 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9520000000000002e-06 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109901 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.522694+0000", 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00072166099999999996, 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00214175, 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109901 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.603 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522694+0000", 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522694+0000", 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522695+0000", 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2900000000000002e-07 2024-09-22T01:36:30.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522699+0000", 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1659999999999996e-06 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522707+0000", 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4330000000000004e-06 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522716+0000", 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0760000000000003e-06 2024-09-22T01:36:30.605 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109518 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514150+0000", 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0092661740000000003, 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010746555, 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.606 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109518 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514150+0000", 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514150+0000", 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514150+0000", 2024-09-22T01:36:30.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0900000000000002e-07 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514153+0000", 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8930000000000001e-06 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514160+0000", 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5440000000000001e-06 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514166+0000", 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3730000000000001e-06 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.608 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109659 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516407+0000", 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0070086030000000004, 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0085326220000000001, 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109659 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.609 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516407+0000", 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516407+0000", 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516407+0000", 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.03e-07 2024-09-22T01:36:30.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516410+0000", 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2759999999999999e-06 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516416+0000", 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2740000000000004e-06 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516421+0000", 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9150000000000004e-06 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.611 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109902 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.522747+0000", 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00066905999999999997, 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0022307099999999999, 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109902 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.612 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522747+0000", 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522747+0000", 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522747+0000", 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.1999999999999999e-07 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522751+0000", 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522759+0000", 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8049999999999996e-06 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522766+0000", 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2720000000000003e-06 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.614 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109519 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514174+0000", 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0092416640000000001, 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.01084516, 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109519 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.615 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514174+0000", 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514174+0000", 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514174+0000", 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.46e-07 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514177+0000", 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3889999999999999e-06 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514183+0000", 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4640000000000003e-06 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514188+0000", 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7899999999999999e-06 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109660 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516428+0000", 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0069876929999999997, 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0086359390000000005, 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109660 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516428+0000", 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516428+0000", 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516428+0000", 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516431+0000", 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1720000000000001e-06 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516437+0000", 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2040000000000002e-06 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516442+0000", 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8330000000000001e-06 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109903 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.522791+0000", 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00062490600000000005, 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002316434, 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109903 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522791+0000", 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522791+0000", 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.522791+0000", 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8599999999999998e-07 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523079+0000", 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000287273 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523095+0000", 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6237999999999999e-05 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523102+0000", 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6029999999999999e-06 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.623 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109520 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514195+0000", 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0092211370000000008, 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010975555, 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109520 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514195+0000", 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514195+0000", 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514195+0000", 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1699999999999999e-07 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514197+0000", 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2639999999999998e-06 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514203+0000", 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2090000000000002e-06 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514208+0000", 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8459999999999999e-06 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109661 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516448+0000", 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0069676210000000002, 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00878052, 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109661 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516448+0000", 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516448+0000", 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516448+0000", 2024-09-22T01:36:30.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1800000000000001e-07 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516451+0000", 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1909999999999999e-06 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516457+0000", 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0739999999999998e-06 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516462+0000", 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3070000000000002e-06 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109904 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523116+0000", 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00029976500000000001, 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0021695429999999999, 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.630 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109904 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523116+0000", 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523116+0000", 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523117+0000", 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523120+0000", 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1310000000000002e-06 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523128+0000", 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.157e-06 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523134+0000", 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1120000000000001e-06 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109521 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514215+0000", 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0092010589999999993, 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011118973000000001, 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.633 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109521 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514215+0000", 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514215+0000", 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.634 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514215+0000", 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2800000000000002e-07 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514217+0000", 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1560000000000002e-06 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514234+0000", 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6603e-05 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514239+0000", 2024-09-22T01:36:30.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5670000000000002e-06 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109662 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516469+0000", 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0069462780000000002, 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0089169490000000004, 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.636 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109662 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516469+0000", 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516469+0000", 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516470+0000", 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2199999999999999e-07 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516472+0000", 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5629999999999999e-06 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516479+0000", 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1750000000000002e-06 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.638 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516483+0000", 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9099999999999996e-06 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109905 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523143+0000", 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00027302899999999999, 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002273859, 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.639 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109905 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523143+0000", 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523143+0000", 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523143+0000", 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.51e-07 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523146+0000", 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6189999999999998e-06 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523161+0000", 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5342e-05 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523167+0000", 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0519999999999998e-06 2024-09-22T01:36:30.641 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109522 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514247+0000", 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0091688380000000003, 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.01121021, 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.642 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109522 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514247+0000", 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514247+0000", 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514247+0000", 2024-09-22T01:36:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8599999999999998e-07 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514250+0000", 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4449999999999999e-06 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514258+0000", 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6430000000000001e-06 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514264+0000", 2024-09-22T01:36:30.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2610000000000001e-06 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109663 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516494+0000", 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.006921333, 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0090199300000000007, 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.645 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109663 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516494+0000", 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516494+0000", 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516495+0000", 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.99e-07 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516497+0000", 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4870000000000001e-06 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516505+0000", 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.1210000000000001e-06 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516510+0000", 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0250000000000002e-06 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109906 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523178+0000", 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00023748700000000001, 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0023937390000000002, 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.648 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109906 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523178+0000", 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523178+0000", 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523179+0000", 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4499999999999997e-07 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523182+0000", 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9000000000000002e-06 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523189+0000", 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5959999999999998e-06 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523195+0000", 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2140000000000004e-06 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109523 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514270+0000", 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0091456300000000001, 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011360777000000001, 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.651 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109523 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514270+0000", 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514270+0000", 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514270+0000", 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0200000000000003e-07 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514273+0000", 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1610000000000001e-06 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514279+0000", 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5300000000000002e-06 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514284+0000", 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7949999999999998e-06 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109664 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516516+0000", 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0068994520000000004, 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0091663430000000004, 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.654 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109664 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516516+0000", 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516516+0000", 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516517+0000", 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6899999999999998e-07 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516519+0000", 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.39e-06 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516526+0000", 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5560000000000004e-06 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516530+0000", 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6759999999999998e-06 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109907 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523203+0000", 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.00021305400000000001, 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025383739999999999, 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109907 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523203+0000", 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523203+0000", 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523203+0000", 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4499999999999997e-07 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523206+0000", 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7329999999999999e-06 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523213+0000", 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9929999999999998e-06 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523219+0000", 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.677e-06 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109524 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514296+0000", 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0091195430000000008, 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011508899, 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.660 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109524 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514296+0000", 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514296+0000", 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514297+0000", 2024-09-22T01:36:30.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5600000000000001e-07 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514299+0000", 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2869999999999999e-06 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514308+0000", 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7739999999999993e-06 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514313+0000", 2024-09-22T01:36:30.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9819999999999999e-06 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109767 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518383+0000", 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.005032201, 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0074779060000000003, 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.663 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109767 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518383+0000", 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518383+0000", 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518385+0000", 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4529999999999999e-06 2024-09-22T01:36:30.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518391+0000", 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8270000000000003e-06 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518404+0000", 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3063e-05 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518412+0000", 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8560000000000007e-06 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.665 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109908 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523227+0000", 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.000188882, 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0026729729999999999, 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109908 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.666 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523227+0000", 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523227+0000", 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523227+0000", 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6600000000000002e-07 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523230+0000", 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7070000000000001e-06 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523238+0000", 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4549999999999995e-06 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523244+0000", 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1970000000000004e-06 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109525 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514320+0000", 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0090959430000000004, 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011612736, 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109525 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514320+0000", 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514320+0000", 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514320+0000", 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0999999999999999e-07 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514323+0000", 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3599999999999999e-06 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514331+0000", 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0790000000000001e-06 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514335+0000", 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.671 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109768 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518426+0000", 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0049897199999999996, 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00753618, 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109768 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518426+0000", 2024-09-22T01:36:30.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518426+0000", 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518427+0000", 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6899999999999997e-07 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518430+0000", 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.579e-06 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518438+0000", 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5970000000000003e-06 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518444+0000", 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9959999999999999e-06 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109909 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523480+0000", 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9999352, 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025358220000000001, 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109909 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523480+0000", 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523480+0000", 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523481+0000", 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4900000000000004e-07 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523485+0000", 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8369999999999999e-06 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523496+0000", 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1117999999999999e-05 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523504+0000", 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8369999999999997e-06 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109526 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514343+0000", 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.009073032, 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011741995999999999, 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109526 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514343+0000", 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514343+0000", 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514343+0000", 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1100000000000001e-07 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514346+0000", 2024-09-22T01:36:30.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6840000000000001e-06 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514354+0000", 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9619999999999993e-06 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514359+0000", 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8960000000000002e-06 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109769 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.680 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518460+0000", 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0049552449999999996, 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.007693732, 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109769 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518460+0000", 2024-09-22T01:36:30.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518460+0000", 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518461+0000", 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7700000000000005e-07 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518464+0000", 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2399999999999999e-06 2024-09-22T01:36:30.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518472+0000", 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7449999999999995e-06 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518478+0000", 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8560000000000003e-06 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.683 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109910 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523515+0000", 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9999003, 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002672734, 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109910 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523515+0000", 2024-09-22T01:36:30.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523515+0000", 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523516+0000", 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1300000000000001e-07 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523518+0000", 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1509999999999998e-06 2024-09-22T01:36:30.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523523+0000", 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8350000000000003e-06 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523526+0000", 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3340000000000002e-06 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.686 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109527 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514366+0000", 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0090497240000000003, 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011859519000000001, 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109527 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514366+0000", 2024-09-22T01:36:30.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514366+0000", 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514367+0000", 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4000000000000002e-07 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514369+0000", 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7089999999999998e-06 2024-09-22T01:36:30.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514376+0000", 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7560000000000002e-06 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514381+0000", 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.259e-06 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109770 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.689 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518486+0000", 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0049295709999999998, 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0077837189999999997, 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109770 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518486+0000", 2024-09-22T01:36:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518486+0000", 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518487+0000", 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4200000000000001e-07 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518489+0000", 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6979999999999998e-06 2024-09-22T01:36:30.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518496+0000", 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4200000000000004e-06 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518501+0000", 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4539999999999998e-06 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109911 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.692 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523530+0000", 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9998851, 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0027704180000000002, 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109911 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523530+0000", 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523530+0000", 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523531+0000", 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1e-07 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523532+0000", 2024-09-22T01:36:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.491e-06 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523536+0000", 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7809999999999999e-06 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523539+0000", 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0170000000000001e-06 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109528 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514388+0000", 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0090272589999999993, 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011969436, 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109528 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514388+0000", 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514388+0000", 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514389+0000", 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8500000000000002e-07 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514391+0000", 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4090000000000001e-06 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514398+0000", 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6409999999999996e-06 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514403+0000", 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8509999999999998e-06 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109771 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518508+0000", 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0049074599999999998, 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0079086279999999991, 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109771 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518508+0000", 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518508+0000", 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518509+0000", 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1100000000000001e-07 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518511+0000", 2024-09-22T01:36:30.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2060000000000001e-06 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518519+0000", 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8590000000000005e-06 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518524+0000", 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2700000000000004e-06 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.701 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109912 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523543+0000", 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9998727, 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0029437299999999999, 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109912 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523543+0000", 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523543+0000", 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523543+0000", 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.41e-07 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523544+0000", 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3510000000000001e-06 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523550+0000", 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7350000000000001e-06 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523557+0000", 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3740000000000003e-06 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.704 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109529 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514410+0000", 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0090055399999999994, 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012129239, 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109529 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514410+0000", 2024-09-22T01:36:30.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514410+0000", 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514411+0000", 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7500000000000001e-07 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514413+0000", 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2249999999999999e-06 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514421+0000", 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7520000000000002e-06 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514427+0000", 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1089999999999997e-06 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109772 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518550+0000", 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0048659089999999999, 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0080361430000000008, 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109772 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518550+0000", 2024-09-22T01:36:30.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518550+0000", 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518550+0000", 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518553+0000", 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8789999999999999e-06 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518560+0000", 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2779999999999999e-06 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518565+0000", 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9189999999999998e-06 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109913 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523563+0000", 2024-09-22T01:36:30.710 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9998527, 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030539930000000001, 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109913 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523563+0000", 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523563+0000", 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523563+0000", 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5599999999999995e-07 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523566+0000", 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2579999999999998e-06 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523572+0000", 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4180000000000002e-06 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523577+0000", 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0130000000000001e-06 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109530 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514448+0000", 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0089672789999999999, 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012204932999999999, 2024-09-22T01:36:30.713 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109530 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514448+0000", 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514448+0000", 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514449+0000", 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9200000000000001e-07 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514459+0000", 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0438000000000001e-05 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514468+0000", 2024-09-22T01:36:30.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1449999999999997e-06 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514474+0000", 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9320000000000001e-06 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109639 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.515903+0000", 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0075126189999999999, 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010793371, 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.716 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109639 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515903+0000", 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515903+0000", 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515904+0000", 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.3600000000000003e-07 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515908+0000", 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2030000000000002e-06 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515928+0000", 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9831999999999999e-05 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515939+0000", 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0716e-05 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109773 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518573+0000", 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0048430870000000003, 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0081549629999999994, 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.719 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109773 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518573+0000", 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518573+0000", 2024-09-22T01:36:30.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518573+0000", 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518575+0000", 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3180000000000001e-06 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518582+0000", 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3759999999999996e-06 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518587+0000", 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0610000000000003e-06 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109914 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523584+0000", 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9998322, 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031819280000000001, 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.722 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109914 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523584+0000", 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523584+0000", 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523584+0000", 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523586+0000", 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1629999999999999e-06 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523592+0000", 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9329999999999998e-06 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523597+0000", 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9269999999999996e-06 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109531 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514492+0000", 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0089232370000000005, 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012316538, 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.725 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109531 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514492+0000", 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514492+0000", 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514493+0000", 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3499999999999996e-07 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514496+0000", 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8820000000000001e-06 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514505+0000", 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:36:30.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514511+0000", 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109640 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.515950+0000", 2024-09-22T01:36:30.728 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0074652130000000001, 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010916894, 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109640 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515950+0000", 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515950+0000", 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515951+0000", 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9699999999999996e-07 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515954+0000", 2024-09-22T01:36:30.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.467e-06 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515964+0000", 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1980000000000007e-06 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515970+0000", 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9179999999999999e-06 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.731 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109774 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518603+0000", 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0048122920000000001, 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0083121640000000004, 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109774 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518603+0000", 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518603+0000", 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518604+0000", 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7100000000000002e-07 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518786+0000", 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000181774 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518797+0000", 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1399e-05 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518804+0000", 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2189999999999998e-06 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109915 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.734 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523604+0000", 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9998121, 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0033431730000000001, 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109915 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523604+0000", 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523604+0000", 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523604+0000", 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8000000000000001e-07 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523612+0000", 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7109999999999995e-06 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523620+0000", 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0800000000000006e-06 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523636+0000", 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5934e-05 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109532 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.737 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514519+0000", 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0088970260000000006, 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012529370999999999, 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109532 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514519+0000", 2024-09-22T01:36:30.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514519+0000", 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514519+0000", 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.2500000000000005e-07 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514522+0000", 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4940000000000002e-06 2024-09-22T01:36:30.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514529+0000", 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.72e-06 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514542+0000", 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3261999999999999e-05 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109641 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.740 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.515978+0000", 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0074373779999999997, 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011126548, 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109641 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515978+0000", 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515978+0000", 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515979+0000", 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2200000000000004e-07 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515982+0000", 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0649999999999999e-06 2024-09-22T01:36:30.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515991+0000", 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8480000000000007e-06 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.515996+0000", 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6400000000000002e-06 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.743 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109775 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518815+0000", 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.004600898, 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0083290729999999993, 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109775 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518815+0000", 2024-09-22T01:36:30.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518815+0000", 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518815+0000", 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4499999999999997e-07 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518818+0000", 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4430000000000002e-06 2024-09-22T01:36:30.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518823+0000", 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.378e-06 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518828+0000", 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.967e-06 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109916 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523809+0000", 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9996071, 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0033715120000000001, 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109916 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.747 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523809+0000", 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523809+0000", 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523809+0000", 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4300000000000003e-07 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523812+0000", 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9950000000000001e-06 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523819+0000", 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7129999999999999e-06 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523823+0000", 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3950000000000003e-06 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109533 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514552+0000", 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0088639189999999996, 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012665048999999999, 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109533 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.750 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514552+0000", 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514552+0000", 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514552+0000", 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8400000000000004e-07 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514555+0000", 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9000000000000002e-06 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514563+0000", 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.554e-06 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514569+0000", 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7130000000000002e-06 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.752 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109642 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516034+0000", 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0073820530000000004, 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011232560000000001, 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109642 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.753 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516034+0000", 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516034+0000", 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516034+0000", 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4899999999999995e-07 2024-09-22T01:36:30.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516037+0000", 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8849999999999999e-06 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516046+0000", 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6959999999999994e-06 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516052+0000", 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.144e-06 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.755 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109776 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518836+0000", 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0045793450000000003, 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0084772860000000005, 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109776 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.756 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518836+0000", 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518836+0000", 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518837+0000", 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9699999999999996e-07 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518839+0000", 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6189999999999998e-06 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518859+0000", 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9415999999999998e-05 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518865+0000", 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.981e-06 2024-09-22T01:36:30.758 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109917 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523830+0000", 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9995856, 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035263970000000001, 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.759 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109917 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523830+0000", 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523830+0000", 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.760 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523830+0000", 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2000000000000001e-07 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523832+0000", 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.722e-06 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523836+0000", 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9339999999999999e-06 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523839+0000", 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.005e-06 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109534 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514576+0000", 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0088397819999999992, 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012836086, 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.762 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109534 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514576+0000", 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514576+0000", 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.763 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514576+0000", 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514579+0000", 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.204e-06 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514598+0000", 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9361999999999999e-05 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.764 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514604+0000", 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6409999999999999e-06 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109643 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516061+0000", 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0073549549999999998, 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011404900000000001, 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.765 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109643 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516061+0000", 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516061+0000", 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.766 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516061+0000", 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4799999999999999e-07 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516064+0000", 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4509999999999999e-06 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516070+0000", 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4350000000000002e-06 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.767 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516075+0000", 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7720000000000002e-06 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109777 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.518883+0000", 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0045327029999999999, 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0086398250000000003, 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.768 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109777 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518883+0000", 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518883+0000", 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518884+0000", 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9400000000000005e-07 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.518887+0000", 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.055e-06 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519199+0000", 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00031228700000000001 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519208+0000", 2024-09-22T01:36:30.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.166e-06 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109918 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523843+0000", 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9995728, 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037457620000000001, 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.771 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109918 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523843+0000", 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523843+0000", 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523843+0000", 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6199999999999999e-07 2024-09-22T01:36:30.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523845+0000", 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6449999999999999e-06 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523848+0000", 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.472e-06 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523851+0000", 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6429999999999999e-06 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109535 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514613+0000", 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0088025550000000001, 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.013035893, 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109535 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.774 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514613+0000", 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514613+0000", 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514614+0000", 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5299999999999999e-07 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514621+0000", 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7479999999999993e-06 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514628+0000", 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7730000000000002e-06 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514633+0000", 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109644 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516082+0000", 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0073333799999999996, 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011620831, 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109644 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.777 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516082+0000", 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516082+0000", 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516083+0000", 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.15e-07 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516086+0000", 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7879999999999998e-06 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516092+0000", 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8940000000000004e-06 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516098+0000", 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2360000000000004e-06 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109778 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.519225+0000", 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0041902650000000003, 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0085367670000000007, 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109778 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519225+0000", 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519225+0000", 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519226+0000", 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0800000000000004e-07 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519251+0000", 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4922999999999998e-05 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519266+0000", 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4591e-05 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519272+0000", 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.455e-06 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.782 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109919 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523855+0000", 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9995613, 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039700619999999999, 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109919 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.783 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523855+0000", 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523855+0000", 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523855+0000", 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3200000000000001e-07 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523856+0000", 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2869999999999999e-06 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523859+0000", 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3699999999999999e-06 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523862+0000", 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.666e-06 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.785 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109536 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.514649+0000", 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0087670609999999996, 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.013226287999999999, 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109536 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.786 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514649+0000", 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514649+0000", 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514649+0000", 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4799999999999999e-07 2024-09-22T01:36:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514652+0000", 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8210000000000002e-06 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514660+0000", 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8080000000000005e-06 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.514665+0000", 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9429999999999999e-06 2024-09-22T01:36:30.788 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109645 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516105+0000", 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0073103420000000001, 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011830235999999999, 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.789 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109645 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516105+0000", 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516105+0000", 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516106+0000", 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1399999999999997e-07 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516108+0000", 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.537e-06 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516115+0000", 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.331e-06 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516120+0000", 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8879999999999996e-06 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109779 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.519283+0000", 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0041322720000000002, 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0086842229999999996, 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.792 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109779 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519283+0000", 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519283+0000", 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519284+0000", 2024-09-22T01:36:30.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2e-07 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519286+0000", 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5000000000000002e-06 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519293+0000", 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6370000000000002e-06 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519297+0000", 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.211e-06 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109920 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523866+0000", 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9995499, 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0041342419999999998, 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.795 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109920 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523866+0000", 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523866+0000", 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523866+0000", 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2499999999999999e-07 2024-09-22T01:36:30.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523867+0000", 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.22e-06 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523870+0000", 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3349999999999998e-06 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523873+0000", 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6350000000000002e-06 2024-09-22T01:36:30.797 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109646 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516126+0000", 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0072897769999999999, 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011917247000000001, 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109646 2024-09-22T01:36:30.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516126+0000", 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516126+0000", 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516126+0000", 2024-09-22T01:36:30.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9099999999999999e-07 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516133+0000", 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3339999999999998e-06 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516139+0000", 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6810000000000001e-06 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516144+0000", 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8640000000000004e-06 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.800 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109780 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.519312+0000", 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0041033679999999996, 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0087764609999999993, 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109780 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519312+0000", 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519312+0000", 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519313+0000", 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6800000000000001e-07 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519651+0000", 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033774599999999999 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519659+0000", 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9020000000000005e-06 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519664+0000", 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.006e-06 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:110024 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523877+0000", 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9995389, 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.004246049, 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110024 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523877+0000", 2024-09-22T01:36:30.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523877+0000", 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523877+0000", 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.29e-07 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523878+0000", 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.235e-06 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523881+0000", 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3289999999999998e-06 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523884+0000", 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7350000000000001e-06 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109647 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516151+0000", 2024-09-22T01:36:30.806 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0072648319999999997, 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012008527, 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109647 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516151+0000", 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516151+0000", 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516151+0000", 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.13e-07 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516153+0000", 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1059999999999998e-06 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516160+0000", 2024-09-22T01:36:30.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0939999999999996e-06 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516164+0000", 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.746e-06 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109781 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.519687+0000", 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0037285719999999999, 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0085229309999999992, 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.809 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109781 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519687+0000", 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519687+0000", 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519688+0000", 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.82e-07 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519690+0000", 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8600000000000001e-06 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519695+0000", 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0250000000000002e-06 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519699+0000", 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3220000000000001e-06 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:110025 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523888+0000", 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9995279, 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0043773010000000001, 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.812 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110025 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523888+0000", 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523888+0000", 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523888+0000", 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3300000000000001e-07 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523889+0000", 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.308e-06 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523893+0000", 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.382e-06 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523895+0000", 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7760000000000002e-06 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109648 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516170+0000", 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0072454290000000003, 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012141506, 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.815 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109648 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516170+0000", 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516170+0000", 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516171+0000", 2024-09-22T01:36:30.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0600000000000001e-07 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516173+0000", 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3870000000000002e-06 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516179+0000", 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.105e-06 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516184+0000", 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6879999999999998e-06 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.817 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109782 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.519715+0000", 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0037008760000000001, 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0086429899999999997, 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109782 2024-09-22T01:36:30.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519715+0000", 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519715+0000", 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.519715+0000", 2024-09-22T01:36:30.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4200000000000001e-07 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520019+0000", 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000303954 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520028+0000", 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6670000000000002e-06 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520033+0000", 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.955e-06 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.820 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:110026 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523900+0000", 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9995151, 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0044940689999999998, 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110026 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.821 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523900+0000", 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523900+0000", 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523901+0000", 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.11e-07 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523902+0000", 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.437e-06 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523906+0000", 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.478e-06 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523908+0000", 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8229999999999999e-06 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.823 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109649 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516190+0000", 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0072256170000000002, 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012246963, 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109649 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516190+0000", 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516190+0000", 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516190+0000", 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8000000000000001e-07 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516193+0000", 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0640000000000001e-06 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516199+0000", 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4049999999999997e-06 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516204+0000", 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.2950000000000001e-06 2024-09-22T01:36:30.826 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109783 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.520043+0000", 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.003372454, 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0084542999999999997, 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.827 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109783 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520043+0000", 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520043+0000", 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520044+0000", 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8800000000000003e-07 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520047+0000", 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0019999999999998e-06 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520051+0000", 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1250000000000003e-06 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520054+0000", 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.038e-06 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:110027 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523912+0000", 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9995036, 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0046453739999999999, 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.830 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110027 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523912+0000", 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523912+0000", 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523912+0000", 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.16e-07 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523914+0000", 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.347e-06 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523917+0000", 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4939999999999999e-06 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523920+0000", 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7180000000000001e-06 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109650 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516211+0000", 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0072048900000000003, 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012406558999999999, 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.833 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109650 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516211+0000", 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516211+0000", 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516211+0000", 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516213+0000", 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0940000000000002e-06 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516220+0000", 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3709999999999996e-06 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516225+0000", 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8910000000000003e-06 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109784 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.520058+0000", 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0033572710000000002, 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0086138959999999994, 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.836 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109784 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520058+0000", 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520058+0000", 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520059+0000", 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5199999999999998e-07 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520060+0000", 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.454e-06 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520064+0000", 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.681e-06 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520067+0000", 2024-09-22T01:36:30.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8100000000000002e-06 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:110028 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523923+0000", 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9994926, 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0047838790000000004, 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.839 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110028 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523923+0000", 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523923+0000", 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523923+0000", 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.16e-07 2024-09-22T01:36:30.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523925+0000", 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.251e-06 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523928+0000", 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3739999999999998e-06 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523931+0000", 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.559e-06 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.841 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109651 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516235+0000", 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.007181031, 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012513455999999999, 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109651 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516235+0000", 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516235+0000", 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516235+0000", 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.4900000000000001e-07 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516237+0000", 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3190000000000002e-06 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516244+0000", 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1059999999999996e-06 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516248+0000", 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6970000000000001e-06 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109785 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.520071+0000", 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0033450849999999998, 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0087227390000000002, 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109785 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520071+0000", 2024-09-22T01:36:30.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520071+0000", 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520071+0000", 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2499999999999999e-07 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520072+0000", 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:36:30.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520076+0000", 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4979999999999998e-06 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520078+0000", 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6570000000000001e-06 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:110029 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523934+0000", 2024-09-22T01:36:30.847 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9994817, 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0049028359999999998, 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110029 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523934+0000", 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523934+0000", 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523934+0000", 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4999999999999999e-07 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523936+0000", 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523939+0000", 2024-09-22T01:36:30.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2949999999999998e-06 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523942+0000", 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7920000000000001e-06 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109652 3.11 3.507a7b31 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.516255+0000", 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0071611640000000002, 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.012614215, 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.850 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109652 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516255+0000", 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516255+0000", 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516255+0000", 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5600000000000001e-07 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516257+0000", 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0209999999999998e-06 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516263+0000", 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0610000000000001e-06 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.516268+0000", 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7759999999999997e-06 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:109786 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.520082+0000", 2024-09-22T01:36:30.853 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.003333552, 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0088272200000000002, 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 109786 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520082+0000", 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520082+0000", 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520082+0000", 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0900000000000001e-07 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520084+0000", 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.319e-06 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520087+0000", 2024-09-22T01:36:30.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5209999999999998e-06 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.520090+0000", 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7609999999999999e-06 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:110030 3.11 3.48105ff1 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.523948+0000", 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4294967295.9994683, 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.004999262, 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:30.856 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "queued for pg", 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 110030 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523948+0000", 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523948+0000", 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523948+0000", 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.82e-07 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523956+0000", 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3100000000000001e-06 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523963+0000", 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9079999999999998e-06 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:30.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.523968+0000", 2024-09-22T01:36:30.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8640000000000004e-06 2024-09-22T01:36:30.859 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.859 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:30.859 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.859 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:30.859 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:36:30.859 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 109 2024-09-22T01:36:30.859 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:30.860 INFO:teuthology.orchestra.run.smithi018.stdout:4552 punch from 0x2630a73 to 0x2637aeb, (0x7078 bytes) 2024-09-22T01:36:30.860 INFO:teuthology.orchestra.run.smithi018.stdout:4553 writesame 0x8ba24c5 thru 0x8ba7dc6 data_size 0x1(0x5902 bytes) 2024-09-22T01:36:30.861 INFO:teuthology.orchestra.run.smithi018.stdout:4554 write 0x578f9fc thru 0x579f5be (0xfbc3 bytes) 2024-09-22T01:36:30.861 INFO:teuthology.orchestra.run.smithi018.stdout:4555 write 0xbf3e58 thru 0xc005a7 (0xc750 bytes) 2024-09-22T01:36:30.861 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:30.861 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:30.856+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:30.861 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:30.866 INFO:teuthology.orchestra.run.smithi018.stdout:4558 writesame 0xbaa1166 thru 0xbaad795 data_size 0x70(0xc630 bytes) 2024-09-22T01:36:30.866 INFO:teuthology.orchestra.run.smithi018.stdout:4559 read 0x86cb291 thru 0x86d78bf (0xc62f bytes) 2024-09-22T01:36:30.870 INFO:teuthology.orchestra.run.smithi018.stdout:4560 trunc from 0xbaad796 to 0xa12b895 2024-09-22T01:36:30.908 INFO:teuthology.orchestra.run.smithi018.stdout:4562 write 0xecd22c7 thru 0xecda2b3 (0x7fed bytes) 2024-09-22T01:36:30.921 INFO:teuthology.orchestra.run.smithi018.stdout:4563 write 0xdd235cf thru 0xdd2c7a3 (0x91d5 bytes) 2024-09-22T01:36:30.932 INFO:teuthology.orchestra.run.smithi018.stdout:4566 write 0x2c3cd60 thru 0x2c4bd05 (0xefa6 bytes) 2024-09-22T01:36:30.936 INFO:teuthology.orchestra.run.smithi018.stdout:4567 read 0x43b49a8 thru 0x43c43a6 (0xf9ff bytes) 2024-09-22T01:36:30.936 INFO:teuthology.orchestra.run.smithi018.stdout:4568 read 0x3e72691 thru 0x3e7b14c (0x8abc bytes) 2024-09-22T01:36:30.936 INFO:teuthology.orchestra.run.smithi018.stdout:4569 punch from 0x3a3f39 to 0x3b2d16, (0xeddd bytes) 2024-09-22T01:36:30.936 INFO:teuthology.orchestra.run.smithi018.stdout:4570 writesame 0x1de81ea thru 0x1df6f84 data_size 0x1(0xed9b bytes) 2024-09-22T01:36:30.961 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:30.956+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:30.980 INFO:teuthology.orchestra.run.smithi018.stdout:4571 read 0x4437038 thru 0x4442b70 (0xbb39 bytes) 2024-09-22T01:36:30.980 INFO:teuthology.orchestra.run.smithi018.stdout:4572 read 0xc1c2f37 thru 0xc1c9d0b (0x6dd5 bytes) 2024-09-22T01:36:31.007 INFO:teuthology.orchestra.run.smithi018.stdout:4573 trunc from 0xecda2b4 to 0x48a4590 2024-09-22T01:36:31.030 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:31.030 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:31.030 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:31.030 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:31.030 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:31.032 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7, 0, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:36:31.033 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:36:31.033 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-22T01:36:31.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-22T01:36:31.038 INFO:teuthology.orchestra.run.smithi018.stdout:4574 trunc from 0x48a4590 to 0x619e6a8 2024-09-22T01:36:31.044 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:31.051 INFO:teuthology.orchestra.run.smithi018.stdout:4575 punch from 0x589a86 to 0x598ea5, (0xf41f bytes) 2024-09-22T01:36:31.051 INFO:teuthology.orchestra.run.smithi018.stdout:4576 write 0x18259b thru 0x18d7af (0xb215 bytes) 2024-09-22T01:36:31.054 INFO:teuthology.orchestra.run.smithi018.stdout:4577 write 0x41520a0 thru 0x4158ba5 (0x6b06 bytes) 2024-09-22T01:36:31.061 INFO:teuthology.orchestra.run.smithi018.stdout:4578 read 0x3c6e278 thru 0x3c73104 (0x4e8d bytes) 2024-09-22T01:36:31.062 INFO:teuthology.orchestra.run.smithi018.stdout:4579 read 0x1d687ee thru 0x1d6fe2d (0x7640 bytes) 2024-09-22T01:36:31.090 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:31.087+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:31.091 INFO:teuthology.orchestra.run.smithi018.stdout:4580 write 0xe27c576 thru 0xe28693e (0xa3c9 bytes) 2024-09-22T01:36:31.101 INFO:teuthology.orchestra.run.smithi018.stdout:4581 read 0xf4dcd3 thru 0xf5ce8c (0xf1ba bytes) 2024-09-22T01:36:31.102 INFO:teuthology.orchestra.run.smithi018.stdout:4582 read 0xb48caae thru 0xb4915f3 (0x4b46 bytes) 2024-09-22T01:36:31.102 INFO:teuthology.orchestra.run.smithi018.stdout:4583 write 0xa810121 thru 0xa81edaa (0xec8a bytes) 2024-09-22T01:36:31.117 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:31.117 INFO:teuthology.orchestra.run.smithi018.stdout:4585 punch from 0x3c5660e to 0x3c59d24, (0x3716 bytes) 2024-09-22T01:36:31.138 INFO:teuthology.orchestra.run.smithi018.stdout:4586 trunc from 0xe28693f to 0x51cfbf8 2024-09-22T01:36:31.159 INFO:teuthology.orchestra.run.smithi018.stdout:4587 punch from 0x5181f08 to 0x51838c8, (0x19c0 bytes) 2024-09-22T01:36:31.159 INFO:teuthology.orchestra.run.smithi018.stdout:4588 read 0x333d93c thru 0x33447b3 (0x6e78 bytes) 2024-09-22T01:36:31.161 INFO:teuthology.orchestra.run.smithi018.stdout:4589 read 0x463c753 thru 0x463fdad (0x365b bytes) 2024-09-22T01:36:31.161 INFO:teuthology.orchestra.run.smithi018.stdout:4590 write 0x1f28201 thru 0x1f2f071 (0x6e71 bytes) 2024-09-22T01:36:31.162 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:31.156+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:31.165 INFO:teuthology.orchestra.run.smithi018.stdout:4592 read 0x186fc91 thru 0x18725c2 (0x2932 bytes) 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 117.858627783, 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:36:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.327855087000003, 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:36:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.327627806999999, 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:36:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:36:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:36:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.324459523000002, 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:36:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:36:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:36:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.324375259000007, 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:36:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.324323762999995, 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:36:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.324278442999997, 2024-09-22T01:36:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:36:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.320798186000005, 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:36:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:36:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.320493373999994, 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:36:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:36:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:36:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.320443929999996, 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:36:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:36:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.320399375999997, 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.320355726000003, 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:36:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:36:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.320308505, 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.218 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:36:31.219 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.220 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.220 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.220 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:36:31.220 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:36:31.220 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.220 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.221 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.221 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:36:31.221 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:36:31.221 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.221 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.221 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:31.222 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.320113499000001, 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:31.223 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.320064012000003, 2024-09-22T01:36:31.226 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.227 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:36:31.228 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.316912952999999, 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:31.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:36:31.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:36:31.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.234 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.316567324999994, 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:31.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:36:31.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.316471902000004, 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.238 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:31.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:36:31.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:36:31.241 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.316419323000005, 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.242 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:36:31.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:36:31.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.245 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 86.316377556000006, 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:31.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:36:31.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:36:31.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:31.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:31.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:31.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:36:31.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:36:31.249 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.249 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.249 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.249 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:31.249 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:31.249 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:31.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:31.251 INFO:teuthology.orchestra.run.smithi018.stdout:4593 write 0x787e7c1 thru 0x788b0f3 (0xc933 bytes) 2024-09-22T01:36:31.251 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:31.251 INFO:teuthology.orchestra.run.smithi018.stdout:4595 write 0xc2b06a7 thru 0xc2b8532 (0x7e8c bytes) 2024-09-22T01:36:31.252 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:31.252 INFO:teuthology.orchestra.run.smithi018.stdout:4597 write 0x4597e28 thru 0x45a125f (0x9438 bytes) 2024-09-22T01:36:31.252 INFO:teuthology.orchestra.run.smithi018.stdout:4598 write 0xcd146cf thru 0xcd15d7d (0x16af bytes) 2024-09-22T01:36:31.252 INFO:teuthology.orchestra.run.smithi018.stdout:4599 writesame 0x78a9f5e thru 0x78b3909 data_size 0x46(0x99ac bytes) 2024-09-22T01:36:31.252 INFO:teuthology.orchestra.run.smithi018.stdout:4600 writesame 0xdf8cad3 thru 0xdf90f4f data_size 0x1(0x447d bytes) 2024-09-22T01:36:31.252 INFO:teuthology.orchestra.run.smithi018.stdout:4602 read 0x8e956c3 thru 0x8e9889b (0x31d9 bytes) 2024-09-22T01:36:31.252 INFO:teuthology.orchestra.run.smithi018.stdout:4604 write 0x1cc9976 thru 0x1cd61ce (0xc859 bytes) 2024-09-22T01:36:31.296 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:31.292+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:31.304 INFO:teuthology.orchestra.run.smithi018.stdout:4605 trunc from 0xdf90f50 to 0x7a211a5 2024-09-22T01:36:31.328 INFO:teuthology.orchestra.run.smithi018.stdout:4606 punch from 0x1264fa3 to 0x126881b, (0x3878 bytes) 2024-09-22T01:36:31.328 INFO:teuthology.orchestra.run.smithi018.stdout:4608 writesame 0x74dbfbb thru 0x74e7544 data_size 0x13(0xb58a bytes) 2024-09-22T01:36:31.341 INFO:teuthology.orchestra.run.smithi018.stdout:4609 trunc from 0x7a211a5 to 0x51510ab 2024-09-22T01:36:31.363 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:31.356+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:31.378 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:31.379 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:31.379 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:31.379 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:31.380 INFO:teuthology.orchestra.run.smithi018.stdout:4610 write 0xa5a5d2d thru 0xa5a891a (0x2bee bytes) 2024-09-22T01:36:31.387 INFO:teuthology.orchestra.run.smithi018.stdout:4611 punch from 0x890854f to 0x890923d, (0xcee bytes) 2024-09-22T01:36:31.387 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:31.387 INFO:teuthology.orchestra.run.smithi018.stdout:4614 read 0x98d37c1 thru 0x98db757 (0x7f97 bytes) 2024-09-22T01:36:31.387 INFO:teuthology.orchestra.run.smithi018.stdout:4615 clone 35 order 19 su 16384 sc 3 2024-09-22T01:36:31.394 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:36:31.394 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:31.394 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 102, 2024-09-22T01:36:31.394 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "2d4626ba-577e-46d9-ad53-8451e5733f43", 2024-09-22T01:36:31.394 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-22T01:34:18.722829+0000", 2024-09-22T01:36:31.394 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-22T01:36:29.771957+0000", 2024-09-22T01:36:31.394 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-22T01:34:31.284224+0000", 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-22T01:36:08.612770+0000", 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5804032, 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-22T01:36:31.395 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 3, 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:31.452919+0000", 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:36:31.396 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:36:31.397 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "16", 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:36:31.398 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:36:31.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-22T01:36:31.400 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:36:31.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "rbd", 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:36.960578+0000", 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:36:31.402 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:36:31.403 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "20", 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 2, 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 20, 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:36:31.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:36:31.405 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:36:31.406 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.9900000095367432, 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.9900000095367432, 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.87999999523162842, 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "pool_client.0", 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:46.686791+0000", 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:36:31.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-22T01:36:31.408 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "102", 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:36:31.409 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 36, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 102, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:36:31.410 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:36:31.411 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.93506431579589844, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.93999999761581421, 2024-09-22T01:36:31.412 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.93999999761581421 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "8de621b1-0a3b-4b8b-b982-70e8db073085", 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:31.413 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 89, 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.414 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.415 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:31.416 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/1213730345", 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/1213730345", 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/1213730345", 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/1213730345", 2024-09-22T01:36:31.417 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "798cbd57-ebd4-461a-9bbf-68e683d1049e", 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.4805145263671875, 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 88, 2024-09-22T01:36:31.418 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:31.420 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3361514324", 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3361514324", 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3361514324", 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3361514324", 2024-09-22T01:36:31.422 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9294585f-3dc9-4b04-8cae-f8d78c92791e", 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 89, 2024-09-22T01:36:31.423 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:31.425 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/4002178714", 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/4002178714", 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/4002178714", 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/4002178714", 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:31.427 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "1ff1abf7-fdbb-4f8a-85e5-90f102abcec2", 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 84, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:31.428 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.430 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.431 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.432 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/2610959301", 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/2610959301", 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/2610959301", 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/2610959301", 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9aa2579a-ada1-45f3-9341-f46697c28212", 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:31.433 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 89, 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6824", 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.434 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6825", 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6826", 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6827", 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.435 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6830", 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6831", 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.436 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6828", 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6829", 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6825/482886379", 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6827/482886379", 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6831/482886379", 2024-09-22T01:36:31.437 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6829/482886379", 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4a6678eb-28ca-4b05-96ae-e9deeb60ca96", 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:31.438 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 86, 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6816", 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6817", 2024-09-22T01:36:31.439 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6818", 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6819", 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6822", 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6823", 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.441 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6820", 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6821", 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.442 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6817/2695689817", 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6819/2695689817", 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6823/2695689817", 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6821/2695689817", 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "775b01e8-5705-4b98-a3ab-f15a78271355", 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:31.443 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 84, 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6808", 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.444 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6809", 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6810", 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6811", 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6814", 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6815", 2024-09-22T01:36:31.446 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6812", 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6813", 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:31.447 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6809/1840779137", 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6811/1840779137", 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6815/1840779137", 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6813/1840779137", 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "15f6d6c1-8a16-42c6-9e43-f3a92e511735", 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:31.448 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 83, 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6800", 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6801", 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6802", 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.450 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6803", 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6806", 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6807", 2024-09-22T01:36:31.451 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6804", 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6805", 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:31.452 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6801/4222842386", 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6803/4222842386", 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6807/4222842386", 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6805/4222842386", 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.453 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.339566+0000", 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:31.454 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.065958+0000", 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.261750+0000", 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.455 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.463117+0000", 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:31.456 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.557372+0000", 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.195553+0000", 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.008891+0000", 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:31.458 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:27.839466+0000", 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [ 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "3.8", 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: 0, 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: 2 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:31.459 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "3.3", 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 4, 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 6 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-22T01:36:31.460 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-22T01:36:31.461 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-22T01:36:31.462 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-22T01:36:31.462 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-22T01:36:31.462 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-22T01:36:31.462 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-22T01:36:31.462 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:31.462 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:31.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:31.464 INFO:tasks.thrashosds.thrasher:j is {'epoch': 102, 'fsid': '2d4626ba-577e-46d9-ad53-8451e5733f43', 'created': '2024-09-22T01:34:18.722829+0000', 'modified': '2024-09-22T01:36:29.771957+0000', 'last_up_change': '2024-09-22T01:34:31.284224+0000', 'last_in_change': '2024-09-22T01:36:08.612770+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-22T01:34:31.452919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-22T01:34:36.960578+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-22T01:34:46.686791+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 36, 'snap_epoch': 102, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9350643157958984, 'average_primary_affinity': 0.9399999976158142, 'average_primary_affinity_weighted': 0.9399999976158142}}], 'osds': [{'osd': 0, 'uuid': '8de621b1-0a3b-4b8b-b982-70e8db073085', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6824', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6825', 'nonce': 1213730345}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6826', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6827', 'nonce': 1213730345}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6830', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6831', 'nonce': 1213730345}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6828', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6829', 'nonce': 1213730345}]}, 'public_addr': '172.21.15.18:6825/1213730345', 'cluster_addr': '172.21.15.18:6827/1213730345', 'heartbeat_back_addr': '172.21.15.18:6831/1213730345', 'heartbeat_front_addr': '172.21.15.18:6829/1213730345', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '798cbd57-ebd4-461a-9bbf-68e683d1049e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.4805145263671875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 88, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6800', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6801', 'nonce': 3361514324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6803', 'nonce': 3361514324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6807', 'nonce': 3361514324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6805', 'nonce': 3361514324}]}, 'public_addr': '172.21.15.18:6801/3361514324', 'cluster_addr': '172.21.15.18:6803/3361514324', 'heartbeat_back_addr': '172.21.15.18:6807/3361514324', 'heartbeat_front_addr': '172.21.15.18:6805/3361514324', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '9294585f-3dc9-4b04-8cae-f8d78c92791e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6817', 'nonce': 4002178714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6818', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6819', 'nonce': 4002178714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6822', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6823', 'nonce': 4002178714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6820', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6821', 'nonce': 4002178714}]}, 'public_addr': '172.21.15.18:6817/4002178714', 'cluster_addr': '172.21.15.18:6819/4002178714', 'heartbeat_back_addr': '172.21.15.18:6823/4002178714', 'heartbeat_front_addr': '172.21.15.18:6821/4002178714', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1ff1abf7-fdbb-4f8a-85e5-90f102abcec2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6809', 'nonce': 2610959301}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6811', 'nonce': 2610959301}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6815', 'nonce': 2610959301}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6813', 'nonce': 2610959301}]}, 'public_addr': '172.21.15.18:6809/2610959301', 'cluster_addr': '172.21.15.18:6811/2610959301', 'heartbeat_back_addr': '172.21.15.18:6815/2610959301', 'heartbeat_front_addr': '172.21.15.18:6813/2610959301', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '9aa2579a-ada1-45f3-9341-f46697c28212', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6824', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6825', 'nonce': 482886379}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6826', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6827', 'nonce': 482886379}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6830', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6831', 'nonce': 482886379}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6828', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6829', 'nonce': 482886379}]}, 'public_addr': '172.21.15.179:6825/482886379', 'cluster_addr': '172.21.15.179:6827/482886379', 'heartbeat_back_addr': '172.21.15.179:6831/482886379', 'heartbeat_front_addr': '172.21.15.179:6829/482886379', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4a6678eb-28ca-4b05-96ae-e9deeb60ca96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6816', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6817', 'nonce': 2695689817}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6818', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6819', 'nonce': 2695689817}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6822', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6823', 'nonce': 2695689817}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6820', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6821', 'nonce': 2695689817}]}, 'public_addr': '172.21.15.179:6817/2695689817', 'cluster_addr': '172.21.15.179:6819/2695689817', 'heartbeat_back_addr': '172.21.15.179:6823/2695689817', 'heartbeat_front_addr': '172.21.15.179:6821/2695689817', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '775b01e8-5705-4b98-a3ab-f15a78271355', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6808', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6809', 'nonce': 1840779137}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6810', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6811', 'nonce': 1840779137}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6814', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6815', 'nonce': 1840779137}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6812', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6813', 'nonce': 1840779137}]}, 'public_addr': '172.21.15.179:6809/1840779137', 'cluster_addr': '172.21.15.179:6811/1840779137', 'heartbeat_back_addr': '172.21.15.179:6815/1840779137', 'heartbeat_front_addr': '172.21.15.179:6813/1840779137', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '15f6d6c1-8a16-42c6-9e43-f3a92e511735', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6800', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6801', 'nonce': 4222842386}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6802', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6803', 'nonce': 4222842386}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6806', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6807', 'nonce': 4222842386}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6804', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6805', 'nonce': 4222842386}]}, 'public_addr': '172.21.15.179:6801/4222842386', 'cluster_addr': '172.21.15.179:6803/4222842386', 'heartbeat_back_addr': '172.21.15.179:6807/4222842386', 'heartbeat_front_addr': '172.21.15.179:6805/4222842386', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.339566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.065958+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.261750+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.463117+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.557372+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.195553+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.008891+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:27.839466+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.8', 'osds': [0, 2]}], 'pg_upmap_items': [{'pgid': '3.3', 'mappings': [{'from': 4, 'to': 6}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-22T01:36:31.464 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.8 2024-09-22T01:36:31.465 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.8 2024-09-22T01:36:31.466 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:31.463+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:31.567 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:31.560+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:31.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:31.627 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:31.628 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:31.628 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:31.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:31.688 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:31.684+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:31.768 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:31.763+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:31.772 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:31.772 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:31.791 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:31.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:36:31.809 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:31.809 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:31.812 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:31.812 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:31.827 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:31.831 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:31.852 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:31.852 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:31.869 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:31.863+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:31.876 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:31.898 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:31.921 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:31.922 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:31.945 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone34 from 0xa5a891b (overlap 0x3892ec9) to 0x21f1c12 2024-09-22T01:36:31.963 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:31.963 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:31.969 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:31.963+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:31.982 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:32.070 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:32.064+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:32.103 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-22T01:36:32.163 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:32.163 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:32.171 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:32.167+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:32.185 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:32.276 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:32.272+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:32.351 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:32.351 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:32.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:32.408 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:32.404+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:32.424 INFO:teuthology.orchestra.run.smithi018.stdout:4616 write 0xe6d7bb0 thru 0xe6e1d68 (0xa1b9 bytes) 2024-09-22T01:36:32.431 INFO:teuthology.orchestra.run.smithi018.stdout:4617 read 0x85d7488 thru 0x85e1116 (0x9c8f bytes) 2024-09-22T01:36:32.431 INFO:teuthology.orchestra.run.smithi018.stdout:4618 punch from 0x5781cbe to 0x578ed15, (0xd057 bytes) 2024-09-22T01:36:32.432 INFO:teuthology.orchestra.run.smithi018.stdout:4619 read 0xdc4a856 thru 0xdc54d81 (0xa52c bytes) 2024-09-22T01:36:32.432 INFO:teuthology.orchestra.run.smithi018.stdout:4620 punch from 0x6201c6c to 0x62039e9, (0x1d7d bytes) 2024-09-22T01:36:32.432 INFO:teuthology.orchestra.run.smithi018.stdout:4623 punch from 0xd17dd9 to 0xd2701d, (0xf244 bytes) 2024-09-22T01:36:32.434 INFO:teuthology.orchestra.run.smithi018.stdout:4625 trunc from 0xe6e1d69 to 0xc062fdc 2024-09-22T01:36:32.450 INFO:teuthology.orchestra.run.smithi018.stdout:4626 read 0x7937248 thru 0x7943424 (0xc1dd bytes) 2024-09-22T01:36:32.450 INFO:teuthology.orchestra.run.smithi018.stdout:4627 write 0xc5bb6 thru 0xc7414 (0x185f bytes) 2024-09-22T01:36:32.464 INFO:teuthology.orchestra.run.smithi018.stdout:4629 read 0x1754eed thru 0x175b783 (0x6897 bytes) 2024-09-22T01:36:32.465 INFO:teuthology.orchestra.run.smithi018.stdout:4631 read 0x256309b thru 0x2567bb9 (0x4b1f bytes) 2024-09-22T01:36:32.466 INFO:teuthology.orchestra.run.smithi018.stdout:4632 punch from 0x57a4810 to 0x57a8000, (0x37f0 bytes) 2024-09-22T01:36:32.466 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:32.467 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:32.474 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:32.468+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:32.476 INFO:teuthology.orchestra.run.smithi018.stdout:4635 write 0xd74dcdf thru 0xd75c43a (0xe75c bytes) 2024-09-22T01:36:32.485 INFO:teuthology.orchestra.run.smithi018.stdout:4637 write 0xd6888cd thru 0xd692284 (0x99b8 bytes) 2024-09-22T01:36:32.489 INFO:teuthology.orchestra.run.smithi018.stdout:4638 punch from 0xbc33e0 to 0xbcbb03, (0x8723 bytes) 2024-09-22T01:36:32.489 INFO:teuthology.orchestra.run.smithi018.stdout:4639 trunc from 0xd75c43b to 0xd6330ec 2024-09-22T01:36:32.506 INFO:teuthology.orchestra.run.smithi018.stdout:4640 trunc from 0xd6330ec to 0xdfba1f0 2024-09-22T01:36:32.535 INFO:teuthology.orchestra.run.smithi018.stdout:4641 trunc from 0xdfba1f0 to 0x31f6bc4 2024-09-22T01:36:32.539 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:32.539 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:32.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:32.568 INFO:teuthology.orchestra.run.smithi018.stdout:4642 write 0x26808c5 thru 0x268f1de (0xe91a bytes) 2024-09-22T01:36:32.591 INFO:teuthology.orchestra.run.smithi018.stdout:4643 write 0x5ef962 thru 0x5f781a (0x7eb9 bytes) 2024-09-22T01:36:32.591 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:32.584+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:32.627 INFO:teuthology.orchestra.run.smithi018.stdout:4644 write 0x417e0f9 thru 0x41832f2 (0x51fa bytes) 2024-09-22T01:36:32.631 INFO:teuthology.orchestra.run.smithi018.stdout:4645 read 0x1e18f97 thru 0x1e1c858 (0x38c2 bytes) 2024-09-22T01:36:32.632 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:32.633 INFO:teuthology.orchestra.run.smithi018.stdout:4647 trunc from 0x41832f3 to 0x3521a03 2024-09-22T01:36:32.645 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:32.645 INFO:teuthology.orchestra.run.smithi018.stdout:4650 read 0x3498a6c thru 0x34a5841 (0xcdd6 bytes) 2024-09-22T01:36:32.645 INFO:teuthology.orchestra.run.smithi018.stdout:4651 read 0x8dcf00 thru 0x8e630f (0x9410 bytes) 2024-09-22T01:36:32.647 INFO:teuthology.orchestra.run.smithi018.stdout:4654 writesame 0x297c33d thru 0x2984e08 data_size 0x8d(0x8acc bytes) 2024-09-22T01:36:32.668 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:32.668 INFO:teuthology.orchestra.run.smithi018.stdout:4658 punch from 0xbbef67 to 0xbc2088, (0x3121 bytes) 2024-09-22T01:36:32.668 INFO:teuthology.orchestra.run.smithi018.stdout:4659 punch from 0x1454760 to 0x145fc7e, (0xb51e bytes) 2024-09-22T01:36:32.668 INFO:teuthology.orchestra.run.smithi018.stdout:4660 read 0x45772a thru 0x45ceff (0x57d6 bytes) 2024-09-22T01:36:32.677 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:32.672+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:32.690 INFO:teuthology.orchestra.run.smithi018.stdout:4664 writesame 0xd11826a thru 0xd118dee data_size 0x1(0xb85 bytes) 2024-09-22T01:36:32.690 INFO:teuthology.orchestra.run.smithi018.stdout:4666 read 0x6313ab5 thru 0x6320379 (0xc8c5 bytes) 2024-09-22T01:36:32.690 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:32.692 INFO:teuthology.orchestra.run.smithi018.stdout:4668 trunc from 0xd118def to 0xe028242 2024-09-22T01:36:32.713 INFO:teuthology.orchestra.run.smithi018.stdout:4669 trunc from 0xe028242 to 0x466cc2a 2024-09-22T01:36:32.715 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:32.718 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:32.720 INFO:teuthology.orchestra.run.smithi018.stdout:4670 read 0xa5bca2 thru 0xa69bbb (0xdf1a bytes) 2024-09-22T01:36:32.731 INFO:teuthology.orchestra.run.smithi018.stdout:4673 trunc from 0x466cc2a to 0x96a04e4 2024-09-22T01:36:32.735 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:32.751 INFO:teuthology.orchestra.run.smithi018.stdout:4674 write 0xbc68da8 thru 0xbc75de6 (0xd03f bytes) 2024-09-22T01:36:32.758 INFO:teuthology.orchestra.run.smithi018.stdout:4675 writesame 0x160c03f thru 0x161b808 data_size 0xa1(0xf7ca bytes) 2024-09-22T01:36:32.777 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:32.772+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:32.782 INFO:teuthology.orchestra.run.smithi018.stdout:4676 punch from 0xeb5e99 to 0xec5bc3, (0xfd2a bytes) 2024-09-22T01:36:32.782 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:32.782 INFO:teuthology.orchestra.run.smithi018.stdout:4680 write 0x7e28d76 thru 0x7e32825 (0x9ab0 bytes) 2024-09-22T01:36:32.789 INFO:teuthology.orchestra.run.smithi018.stdout:4682 punch from 0xba0939f to 0xba103c7, (0x7028 bytes) 2024-09-22T01:36:32.789 INFO:teuthology.orchestra.run.smithi018.stdout:4683 read 0xa959351 thru 0xa95f78c (0x643c bytes) 2024-09-22T01:36:32.794 INFO:teuthology.orchestra.run.smithi018.stdout:4684 trunc from 0xbc75de7 to 0xe9fe292 2024-09-22T01:36:32.801 INFO:teuthology.orchestra.run.smithi018.stdout:4685 write 0x7d758d2 thru 0x7d7798c (0x20bb bytes) 2024-09-22T01:36:32.802 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:36:32.802 INFO:teuthology.orchestra.run.smithi018.stderr:clear 3.8 pg_upmap mapping 2024-09-22T01:36:32.814 INFO:teuthology.orchestra.run.smithi018.stdout:4686 punch from 0x49eb2a9 to 0x49f5f2c, (0xac83 bytes) 2024-09-22T01:36:32.815 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:32.815 INFO:teuthology.orchestra.run.smithi018.stdout:4688 punch from 0x9562d36 to 0x956f232, (0xc4fc bytes) 2024-09-22T01:36:32.815 INFO:teuthology.orchestra.run.smithi018.stdout:4690 read 0x175c072 thru 0x1767c69 (0xbbf8 bytes) 2024-09-22T01:36:32.815 INFO:teuthology.orchestra.run.smithi018.stdout:4693 writesame 0x215c5b2 thru 0x215ea5d data_size 0x2(0x24ac bytes) 2024-09-22T01:36:32.830 INFO:teuthology.orchestra.run.smithi018.stdout:4696 punch from 0x880a465 to 0x8817cb9, (0xd854 bytes) 2024-09-22T01:36:32.830 INFO:teuthology.orchestra.run.smithi018.stdout:4697 write 0x99128f thru 0x99e5cb (0xd33d bytes) 2024-09-22T01:36:32.852 INFO:teuthology.orchestra.run.smithi018.stdout:4698 write 0xa804488 thru 0xa81173d (0xd2b6 bytes) 2024-09-22T01:36:32.860 INFO:teuthology.orchestra.run.smithi018.stdout:4699 read 0xcd19903 thru 0xcd292d4 (0xf9d2 bytes) 2024-09-22T01:36:32.860 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:32.860 INFO:teuthology.orchestra.run.smithi018.stdout:4702 write 0xd65b0d2 thru 0xd65bfc2 (0xef1 bytes) 2024-09-22T01:36:32.862 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:32.862 INFO:teuthology.orchestra.run.smithi018.stdout:4706 writesame 0x281f23c thru 0x28272d1 data_size 0x6d(0x8096 bytes) 2024-09-22T01:36:32.880 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:32.875+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:32.882 INFO:teuthology.orchestra.run.smithi018.stdout:4707 read 0x541eefd thru 0x5423d6a (0x4e6e bytes) 2024-09-22T01:36:32.882 INFO:teuthology.orchestra.run.smithi018.stdout:4708 punch from 0x68918c6 to 0x6891bdb, (0x315 bytes) 2024-09-22T01:36:32.883 INFO:teuthology.orchestra.run.smithi018.stdout:4709 read 0x9e2d097 thru 0x9e34cfb (0x7c65 bytes) 2024-09-22T01:36:32.883 INFO:teuthology.orchestra.run.smithi018.stdout:4710 writesame 0x50d251 thru 0x51a4fc data_size 0x61(0xd2ac bytes) 2024-09-22T01:36:32.887 INFO:teuthology.orchestra.run.smithi018.stdout:4711 read 0x58e4916 thru 0x58f080a (0xbef5 bytes) 2024-09-22T01:36:32.891 INFO:teuthology.orchestra.run.smithi018.stdout:4713 trunc from 0xe9fe292 to 0xbbfb0ec 2024-09-22T01:36:32.907 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:32.907 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:32.907 INFO:teuthology.orchestra.run.smithi018.stdout:4714 clone 36 order 24 su 8388608 sc 10 2024-09-22T01:36:32.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:32.980 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:32.975+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:33.081 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:33.076+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:33.094 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:33.094 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:33.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:33.182 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:33.179+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:33.281 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:33.282 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:33.283 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:33.276+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:33.296 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:33.384 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:33.379+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:33.469 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:33.470 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:33.484 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:33.485 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:33.483+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:33.585 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:33.580+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:33.619 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:33.619 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:33.633 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:33.687 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:33.680+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:33.758 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:33.758 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:33.773 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:33.787 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:33.780+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:33.888 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:33.883+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:33.895 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:33.895 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:33.910 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:33.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:33.998 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:33.995+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:34.070 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:34.070 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:34.084 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:34.104 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:34.105 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:34.121 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:34.121 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:34.126 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:34.123+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:34.141 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:34.159 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:34.160 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:34.179 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:34.179 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:34.191 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:34.187+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:34.200 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:34.223 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:34.223 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:34.245 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:34.245 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:34.251 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:34.251 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:34.251 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:34.251 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:34.251 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:34.265 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:34.291 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:34.284+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:34.392 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:34.387+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.982950146, 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.433 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.978981920000003, 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:36:34.437 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:36:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:34.441 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.978962860000003, 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.445 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.978736996999999, 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:36:34.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:36:34.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:36:34.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.971206654, 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.450 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:36:34.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.455 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:34.455 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:34.455 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.967225358999997, 2024-09-22T01:36:34.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:36:34.455 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.455 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.455 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:34.455 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:34.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:34.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:36:34.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:36:34.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:36:34.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.963007275999999, 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:34.460 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:34.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111086 3.c 3:35fd2b6c:::rbd_data.110fb46d971e.0000000000000006:24 [read 835584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:36:34.464 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7451727670000001, 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094586389000000007, 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111086 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8699999999999995e-07 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684828+0000", 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6847e-05 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684836+0000", 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6539999999999999e-06 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684841+0000", 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.896e-06 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776879+0000", 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.092037657999999994 2024-09-22T01:36:34.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776960+0000", 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0653000000000002e-05 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779397+0000", 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024371940000000002 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111087 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:36:34.468 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7451198359999998, 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094592211999999995, 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111087 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684864+0000", 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0500000000000003e-07 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684867+0000", 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2820000000000001e-06 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684887+0000", 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9834e-05 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684892+0000", 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3220000000000003e-06 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779442+0000", 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094550318999999994 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779456+0000", 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.385e-05 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111088 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7450831129999997, 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094599416000000006, 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.472 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111088 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684901+0000", 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3300000000000003e-07 2024-09-22T01:36:34.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684906+0000", 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684912+0000", 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8819999999999998e-06 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684919+0000", 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0330000000000003e-06 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779492+0000", 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094573333999999995 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779500+0000", 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7360000000000001e-06 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111089 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7450562089999999, 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094616622999999997, 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111089 2024-09-22T01:36:34.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684928+0000", 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7399999999999998e-07 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684930+0000", 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.881e-06 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684938+0000", 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5689999999999999e-06 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684944+0000", 2024-09-22T01:36:34.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.665e-06 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779538+0000", 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094594370999999997 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779544+0000", 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6629999999999998e-06 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111090 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.745020158, 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094605844999999994, 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111090 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684964+0000", 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8999999999999997e-07 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684967+0000", 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4460000000000001e-06 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684975+0000", 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.943e-06 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684990+0000", 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4482e-05 2024-09-22T01:36:34.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779561+0000", 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094571526000000003 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779569+0000", 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9580000000000007e-06 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.483 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111091 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7449755360000001, 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094588915999999995, 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111091 2024-09-22T01:36:34.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685012+0000", 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.602e-06 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685020+0000", 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2300000000000008e-06 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685030+0000", 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5719999999999992e-06 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779591+0000", 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094560898000000004 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779597+0000", 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9569999999999999e-06 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111092 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.487 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7449438050000001, 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094585007999999998, 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111092 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685043+0000", 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7269999999999999e-06 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685051+0000", 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3140000000000004e-06 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685057+0000", 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9739999999999999e-06 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779618+0000", 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094561289000000007 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779625+0000", 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.195e-06 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111093 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:36:34.491 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.744918491, 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094587735000000006, 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111093 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685537+0000", 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00047185400000000001 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685543+0000", 2024-09-22T01:36:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9410000000000004e-06 2024-09-22T01:36:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685555+0000", 2024-09-22T01:36:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2449999999999999e-05 2024-09-22T01:36:34.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685563+0000", 2024-09-22T01:36:34.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6279999999999996e-06 2024-09-22T01:36:34.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779648+0000", 2024-09-22T01:36:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094084962999999994 2024-09-22T01:36:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779653+0000", 2024-09-22T01:36:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.899e-06 2024-09-22T01:36:34.496 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111094 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:36:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7443954769999999, 2024-09-22T01:36:34.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091857000000001, 2024-09-22T01:36:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111094 2024-09-22T01:36:34.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:36:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:36:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685589+0000", 2024-09-22T01:36:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5300000000000004e-07 2024-09-22T01:36:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685595+0000", 2024-09-22T01:36:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8229999999999997e-06 2024-09-22T01:36:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685602+0000", 2024-09-22T01:36:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8730000000000001e-06 2024-09-22T01:36:34.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685607+0000", 2024-09-22T01:36:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5279999999999997e-06 2024-09-22T01:36:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779675+0000", 2024-09-22T01:36:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094068054999999998 2024-09-22T01:36:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779680+0000", 2024-09-22T01:36:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9250000000000003e-06 2024-09-22T01:36:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.503 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111095 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:36:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7443699189999999, 2024-09-22T01:36:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091049999999996, 2024-09-22T01:36:34.504 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111095 2024-09-22T01:36:34.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685614+0000", 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5600000000000001e-07 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685615+0000", 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.593e-06 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685619+0000", 2024-09-22T01:36:34.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1150000000000004e-06 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685623+0000", 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3529999999999999e-06 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779700+0000", 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094076749000000001 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779704+0000", 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8840000000000002e-06 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111096 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7443560800000002, 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094106891999999998, 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.509 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111096 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685756+0000", 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012857600000000001 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685761+0000", 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.118e-06 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685770+0000", 2024-09-22T01:36:34.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0650000000000005e-06 2024-09-22T01:36:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685794+0000", 2024-09-22T01:36:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4202999999999998e-05 2024-09-22T01:36:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779729+0000", 2024-09-22T01:36:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093934985999999998 2024-09-22T01:36:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779734+0000", 2024-09-22T01:36:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9439999999999996e-06 2024-09-22T01:36:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111097 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685807+0000", 2024-09-22T01:36:34.514 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7441759879999998, 2024-09-22T01:36:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093953446999999995, 2024-09-22T01:36:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.515 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111097 2024-09-22T01:36:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685807+0000", 2024-09-22T01:36:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685807+0000", 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685808+0000", 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685812+0000", 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6830000000000001e-06 2024-09-22T01:36:34.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685821+0000", 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1300000000000007e-06 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685827+0000", 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1460000000000001e-06 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.518 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779755+0000", 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093928426999999995 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779761+0000", 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3990000000000003e-06 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111098 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685846+0000", 2024-09-22T01:36:34.519 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 3.7441371569999999, 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093945415000000004, 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111098 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685846+0000", 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685846+0000", 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685955+0000", 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000108563 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685975+0000", 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9831e-05 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685988+0000", 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3828999999999999e-05 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685998+0000", 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3610000000000007e-06 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779783+0000", 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093785048999999995 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:34.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:34.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779792+0000", 2024-09-22T01:36:34.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7819999999999999e-06 2024-09-22T01:36:34.523 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.523 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.523 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.523 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:34.523 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:34.523 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:34.524 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:34.525 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:34.520+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:34.625 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:34.619+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:34.704 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:34.704 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:34.704 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:34.704 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:34.718 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:34.723 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone35 from 0xbbfb0ec (overlap 0x31f6bc4) to 0x13fc4b4 2024-09-22T01:36:34.766 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:34.763+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:34.828 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:34.823+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:34.833 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:36:34.904 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:34.904 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:34.904 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:34.904 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:34.905 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:34.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:34.962 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:34.959+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:35.028 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:35.023+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:35.088 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 67.010515104000007, 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.089 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:36:35.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 67.010478075999998, 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.093 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.998927616000003, 2024-09-22T01:36:35.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:35.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:35.101 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.998893609000007, 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:36:35.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.995026258999999, 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:36:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.994980710999997, 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.110 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:36:35.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:36:35.113 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.994935502999994, 2024-09-22T01:36:35.114 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.117 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.994900911000002, 2024-09-22T01:36:35.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.121 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.122 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.994867263000003, 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:36:35.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:36:35.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.991137773000005, 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.129 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:36:35.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:35.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.129 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.129 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.129 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:36:35.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:36:35.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.130 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.130 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:36:35.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:36:35.130 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.130 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:36:35.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:36:35.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:36:35.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:36:35.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.991101270000001, 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.132 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:35.133 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.134 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:36:35.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.991056631000006, 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:36:35.136 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:36:35.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:36:35.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.140 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.991006404999993, 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:36:35.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:36:35.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:36:35.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.990967963000003, 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.146 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.990923968000004, 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.149 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.150 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:36:35.151 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.152 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:35.153 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.990884817999998, 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.154 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.155 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:36:35.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.157 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.987041649999995, 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.158 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.159 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.160 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.161 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.986961324000006, 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.162 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:36:35.163 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.164 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.165 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.282408028000006, 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.166 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.167 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.168 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.168 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:36:35.168 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:36:35.169 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.169 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.169 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.169 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:36:35.169 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:36:35.169 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:36:35.170 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.171 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 65.288266460000003, 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.173 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.174 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.175 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.176 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:36:35.178 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:36:35.178 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.178 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.178 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.178 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.178 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.178 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:35.180 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:35.180 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:35.175+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:35.280 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:35.276+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:35.326 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-22T01:36:35.352 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:35.352 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:35.352 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:35.352 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:35.368 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:35.418 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:35.415+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:35.482 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:35.479+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:35.483 INFO:teuthology.orchestra.run.smithi018.stdout:4715 trunc from 0xbbfb0ec to 0xebc18a0 2024-09-22T01:36:35.493 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:35.494 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:35.494 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:35.494 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:35.494 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:35.503 INFO:teuthology.orchestra.run.smithi018.stdout:4716 read 0xc7deaf thru 0xc81a01 (0x3b53 bytes) 2024-09-22T01:36:35.505 INFO:teuthology.orchestra.run.smithi018.stdout:4718 punch from 0xcaea611 to 0xcaf6e47, (0xc836 bytes) 2024-09-22T01:36:35.505 INFO:teuthology.orchestra.run.smithi018.stdout:4719 punch from 0x7b90f27 to 0x7b9a761, (0x983a bytes) 2024-09-22T01:36:35.505 INFO:teuthology.orchestra.run.smithi018.stdout:4720 write 0x3fa031c thru 0x3fabaac (0xb791 bytes) 2024-09-22T01:36:35.510 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:35.513 INFO:teuthology.orchestra.run.smithi018.stdout:4721 read 0x9e73ef8 thru 0x9e796c6 (0x57cf bytes) 2024-09-22T01:36:35.514 INFO:teuthology.orchestra.run.smithi018.stdout:4722 writesame 0x9742e48 thru 0x97455ce data_size 0x1(0x2787 bytes) 2024-09-22T01:36:35.534 INFO:teuthology.orchestra.run.smithi018.stdout:4723 write 0x8da3f67 thru 0x8dad598 (0x9632 bytes) 2024-09-22T01:36:35.537 INFO:teuthology.orchestra.run.smithi018.stdout:4725 writesame 0xc43014f thru 0xc433a23 data_size 0x1(0x38d5 bytes) 2024-09-22T01:36:35.560 INFO:teuthology.orchestra.run.smithi018.stdout:4726 writesame 0xe26ff87 thru 0xe276488 data_size 0x7(0x6502 bytes) 2024-09-22T01:36:35.571 INFO:teuthology.orchestra.run.smithi018.stdout:4727 writesame 0x86a022b thru 0x86a47e6 data_size 0x2(0x45bc bytes) 2024-09-22T01:36:35.598 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:35.595+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:35.599 INFO:teuthology.orchestra.run.smithi018.stdout:4728 read 0x15c5b90 thru 0x15d52dc (0xf74d bytes) 2024-09-22T01:36:35.601 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:35.601 INFO:teuthology.orchestra.run.smithi018.stdout:4732 write 0x5d0dae9 thru 0x5d15ee6 (0x83fe bytes) 2024-09-22T01:36:35.683 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:35.679+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:35.691 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:35.691 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:35.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:35.692 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:35.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.692 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:36:35.692 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:35.692 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 122.37922213, 2024-09-22T01:36:35.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:36:35.692 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.692 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.693 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:35.693 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.693 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:36:35.693 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:36:35.693 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:36:35.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.693 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:35.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:35.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:36:35.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:36:35.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:36:35.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:36:35.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:36:35.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:36:35.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:36:35.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:36:35.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:36:35.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:36:35.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:35.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:36:35.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:36:35.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:36:35.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:36:35.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:36:35.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:36:35.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:36:35.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:36:35.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:36:35.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:35.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:36:35.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:36:35.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:35.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:36:35.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:36:35.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:35.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:36:35.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:36:35.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:36:35.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:36:35.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.704 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.704 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.704 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.704 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:35.704 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.848449434000003, 2024-09-22T01:36:35.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:36:35.705 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.705 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.705 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.705 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.705 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.705 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.706 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:36:35.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.706 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:35.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:35.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.708 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:36:35.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:36:35.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.708 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.708 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:36:35.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:36:35.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:36:35.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:36:35.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:36:35.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:36:35.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:36:35.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:36:35.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:36:35.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:36:35.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:36:35.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:36:35.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.712 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.712 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.712 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:35.713 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.848222153999998, 2024-09-22T01:36:35.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:36:35.713 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.713 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.713 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.714 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.714 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.714 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.714 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:36:35.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.714 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:35.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:35.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:36:35.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:36:35.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:36:35.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:36:35.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:36:35.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:36:35.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:36:35.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:36:35.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:36:35.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:36:35.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:36:35.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:36:35.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:36:35.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:36:35.721 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.721 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.721 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.722 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.722 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:35.722 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.845053870000001, 2024-09-22T01:36:35.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:36:35.722 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.722 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.723 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.723 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.723 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.723 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.723 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:36:35.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.723 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:35.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:35.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:36:35.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:35.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:36:35.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:35.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:36:35.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:36:35.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:36:35.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:36:35.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:36:35.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:36:35.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:36:35.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:36:35.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:36:35.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:36:35.730 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.730 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.731 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.731 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.731 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:35.731 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.844969606000006, 2024-09-22T01:36:35.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:36:35.732 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.732 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.732 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.732 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.732 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.733 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.733 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:36:35.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.733 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:35.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:35.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.735 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.735 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:36:35.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:36:35.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.735 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.735 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:36:35.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:36:35.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:36:35.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:36:35.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:36:35.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:36:35.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:36:35.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:36:35.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:36:35.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:36:35.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:36:35.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:36:35.739 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.739 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.739 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.740 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.740 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:35.740 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.844918109999995, 2024-09-22T01:36:35.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:36:35.740 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.740 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.740 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.741 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.741 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.741 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.741 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:36:35.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.741 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:35.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:35.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.743 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.743 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:36:35.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:36:35.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:36:35.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:36:35.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:36:35.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:36:35.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:36:35.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:36:35.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:36:35.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:36:35.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.747 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.747 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.747 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:36:35.747 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:36:35.747 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:36:35.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:36:35.748 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.748 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.749 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.749 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.749 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:35.749 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.844872789999997, 2024-09-22T01:36:35.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:36:35.750 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.750 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.750 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.750 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.750 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.750 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.751 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:36:35.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.751 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.751 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.751 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:35.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:35.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.753 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.753 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.753 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:36:35.753 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:36:35.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.753 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:36:35.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:36:35.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:36:35.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:36:35.755 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.755 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.755 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:36:35.755 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:36:35.755 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:36:35.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:36:35.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:36:35.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:36:35.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:36:35.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:36:35.758 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.758 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.758 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.758 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.758 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.758 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.759 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:35.759 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.841392533000004, 2024-09-22T01:36:35.759 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:36:35.759 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.759 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.759 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.760 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.760 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.760 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.760 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:36:35.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.760 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.760 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:35.761 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.761 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:35.762 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.762 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.762 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.762 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.762 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:36:35.762 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:36:35.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.763 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.763 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.763 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:36:35.763 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:36:35.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.763 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.764 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.764 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:36:35.764 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:36:35.764 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.764 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.764 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.765 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.841087720999994, 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.766 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:35.767 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:36:35.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:36:35.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.841038276999996, 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:36:35.770 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.771 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:36:35.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.840993722999997, 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:36:35.774 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.777 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.840950073000002, 2024-09-22T01:36:35.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:35.782 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.840902851999999, 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:35.783 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:36:35.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:36:35.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.786 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.840707846000001, 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.787 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:36:35.790 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.840658359000003, 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.791 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:36:35.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:36:35.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.837507299999999, 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.795 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:35.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:36:35.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.837161671999993, 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.799 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:35.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:36:35.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:36:35.802 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.837066249000003, 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.803 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:36:35.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:36:35.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.837013670000005, 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.836971903000006, 2024-09-22T01:36:35.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:35.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:35.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:36:35.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:36:35.814 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.814 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.814 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.814 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:35.814 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:35.814 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:35.816 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:35.817 INFO:teuthology.orchestra.run.smithi018.stdout:4733 read 0x3bfbaa9 thru 0x3c03ea8 (0x8400 bytes) 2024-09-22T01:36:35.817 INFO:teuthology.orchestra.run.smithi018.stdout:4734 write 0x5ca84e0 thru 0x5cb5121 (0xcc42 bytes) 2024-09-22T01:36:35.817 INFO:teuthology.orchestra.run.smithi018.stdout:4735 trunc from 0xebc18a0 to 0xe922158 2024-09-22T01:36:35.817 INFO:teuthology.orchestra.run.smithi018.stdout:4737 read 0xe1115fd thru 0xe11a945 (0x9349 bytes) 2024-09-22T01:36:35.817 INFO:teuthology.orchestra.run.smithi018.stdout:4739 punch from 0x6062b42 to 0x6070ed4, (0xe392 bytes) 2024-09-22T01:36:35.817 INFO:teuthology.orchestra.run.smithi018.stdout:4740 punch from 0x68811c3 to 0x688cfbd, (0xbdfa bytes) 2024-09-22T01:36:35.817 INFO:teuthology.orchestra.run.smithi018.stdout:4741 read 0xe50c965 thru 0xe517bb2 (0xb24e bytes) 2024-09-22T01:36:35.817 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:35.817 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:35.818 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:35.818 INFO:teuthology.orchestra.run.smithi018.stdout:4745 read 0x67ae24 thru 0x68acf7 (0xfed4 bytes) 2024-09-22T01:36:35.818 INFO:teuthology.orchestra.run.smithi018.stdout:4746 write 0xd817596 thru 0xd81d2f5 (0x5d60 bytes) 2024-09-22T01:36:35.818 INFO:teuthology.orchestra.run.smithi018.stdout:4748 writesame 0x3f37155 thru 0x3f41932 data_size 0x1(0xa7de bytes) 2024-09-22T01:36:35.818 INFO:teuthology.orchestra.run.smithi018.stdout:4749 read 0xe219a2 thru 0xe268db (0x4f3a bytes) 2024-09-22T01:36:35.818 INFO:teuthology.orchestra.run.smithi018.stdout:4750 write 0x814195e thru 0x814db3f (0xc1e2 bytes) 2024-09-22T01:36:35.818 INFO:teuthology.orchestra.run.smithi018.stdout:4752 trunc from 0xe922158 to 0xe5e3b5b 2024-09-22T01:36:35.818 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:36:35.819 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:35.819 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:35.808+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:35.819 INFO:teuthology.orchestra.run.smithi018.stdout:4754 trunc from 0xe5e3b5b to 0xc8a9b17 2024-09-22T01:36:35.842 INFO:teuthology.orchestra.run.smithi018.stdout:4755 punch from 0xb46e326 to 0xb476183, (0x7e5d bytes) 2024-09-22T01:36:35.842 INFO:teuthology.orchestra.run.smithi018.stdout:4757 read 0x9282047 thru 0x928bb04 (0x9abe bytes) 2024-09-22T01:36:35.843 INFO:teuthology.orchestra.run.smithi018.stdout:4758 read 0x4a0afaa thru 0x4a159f6 (0xaa4d bytes) 2024-09-22T01:36:35.843 INFO:teuthology.orchestra.run.smithi018.stdout:4759 write 0x2c377c5 thru 0x2c45d48 (0xe584 bytes) 2024-09-22T01:36:35.916 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:35.912+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:35.951 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:35.951 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:35.952 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:35.952 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:35.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:36.052 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:36.048+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:36.118 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:36.115+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:36.136 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:36.136 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:36.136 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:36.136 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:36.136 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:36.151 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:36.236 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:36.232+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:36.267 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:36.320 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:36.316+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:36.324 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:36.324 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:36.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:36.324 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:36.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.324 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.851217577, 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.328 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.851143167000004, 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.851086636000005, 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.333 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:36.337 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.851029041999993, 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:36:36.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.341 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.342 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.353 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:36.353 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.850971704000003, 2024-09-22T01:36:36.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:36:36.353 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:36:36.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.850914262999993, 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:36.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:36:36.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:36:36.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.850878354000002, 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.365 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.845834655999994, 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:36:36.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:36:36.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.369 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.845771214999999, 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.845715978000001, 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.845642663999996, 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:36.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:36:36.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:36:36.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.845588582999994, 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:36.386 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.845534145000002, 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:36:36.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 87.845478283999995, 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.391 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:36:36.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93498 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.745311526000002, 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93801259999999997, 2024-09-22T01:36:36.395 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.396 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:36.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.396 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93498 2024-09-22T01:36:36.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.397 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576580+0000", 2024-09-22T01:36:36.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8600000000000003e-06 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576600+0000", 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9746e-05 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576650+0000", 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0419e-05 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576678+0000", 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7858999999999999e-05 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580737+0000", 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040585939999999996 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580754+0000", 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7102e-05 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514561+0000", 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93380681700000001 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514589+0000", 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8203000000000001e-05 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93499 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:36.401 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.742445813000003, 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93524844100000004, 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93499 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579444+0000", 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2369999999999999e-06 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579455+0000", 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0655e-05 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579486+0000", 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1473999999999997e-05 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579506+0000", 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9513000000000001e-05 2024-09-22T01:36:36.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581124+0000", 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016177050000000001 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581135+0000", 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1534e-05 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514663+0000", 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93352768399999997 2024-09-22T01:36:36.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514691+0000", 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7639000000000001e-05 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94339 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch reconnect cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.700068581, 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0158427670000001, 2024-09-22T01:36:36.406 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94339 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621821+0000", 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.55e-06 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621827+0000", 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1299999999999998e-06 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621843+0000", 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5542000000000001e-05 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621853+0000", 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0445000000000001e-05 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621924+0000", 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1262999999999999e-05 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621936+0000", 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.131e-05 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625444+0000", 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0035085479999999 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625845+0000", 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040067999999999999 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.637662+0000", 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011817299 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94342 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [notify cookie 140215384087984] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.685898412, 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99234641400000001, 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.411 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94342 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:36.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635992+0000", 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.12e-06 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636002+0000", 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636032+0000", 2024-09-22T01:36:36.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0463e-05 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636053+0000", 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1002999999999999e-05 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636187+0000", 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013359299999999999 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636206+0000", 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9327e-05 2024-09-22T01:36:36.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627756+0000", 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99154943799999995 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627997+0000", 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024163200000000001 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628336+0000", 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033850200000000002 2024-09-22T01:36:36.415 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94343 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch ping cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.613730545999999, 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92041710600000004, 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.416 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94343 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708160+0000", 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8559999999999998e-06 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708178+0000", 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.73e-05 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708212+0000", 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4573000000000003e-05 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708238+0000", 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5792e-05 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708344+0000", 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106508 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708357+0000", 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2183e-05 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628387+0000", 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92003072600000002 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628449+0000", 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1828000000000005e-05 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628574+0000", 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012533999999999999 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:95531 3.8 3:11293fc5:::rbd_object_map.110f30608ae1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e89)", 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.674721192, 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.012680681, 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 95531 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.421 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647169+0000", 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9649999999999998e-06 2024-09-22T01:36:36.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647177+0000", 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0439999999999996e-06 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647196+0000", 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9400000000000001e-05 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647204+0000", 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:36.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647266+0000", 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2117000000000002e-05 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647275+0000", 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0679999999999997e-06 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651032+0000", 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037574980000000002 2024-09-22T01:36:36.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651044+0000", 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-05 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659538+0000", 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0084937460000001 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659847+0000", 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000309587 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.425 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:36.426 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:36.426 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:36.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:36.428 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:36.428 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:36.423+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:36.432 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:36.433 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:36.450 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:36.466 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:36.466 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:36.487 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:36.509 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:36.528 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:36.524+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:36.531 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:36.553 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:36.554 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:36.563 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:36.563 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:36.578 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:36.668 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:36.664+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:36.731 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:36.727+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:36.736 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:36.737 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:36.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:36.844 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:36.840+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:36.877 INFO:teuthology.orchestra.run.smithi018.stdout:4760 write 0x373f873 thru 0x374a9cb (0xb159 bytes) 2024-09-22T01:36:36.880 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:36.880 INFO:teuthology.orchestra.run.smithi018.stdout:4762 punch from 0x6d03a57 to 0x6d0f15f, (0xb708 bytes) 2024-09-22T01:36:36.888 INFO:teuthology.orchestra.run.smithi018.stdout:4764 trunc from 0xc8a9b17 to 0x8cc2848 2024-09-22T01:36:36.920 INFO:teuthology.orchestra.run.smithi018.stdout:4766 read 0x2eb44af thru 0x2ebce8b (0x89dd bytes) 2024-09-22T01:36:36.921 INFO:teuthology.orchestra.run.smithi018.stdout:4767 punch from 0x63fe33e to 0x640b9a6, (0xd668 bytes) 2024-09-22T01:36:36.932 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:36.928+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:36.936 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:36.936 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:36.936 INFO:teuthology.orchestra.run.smithi018.stdout:4768 trunc from 0x8cc2848 to 0x2262f5e 2024-09-22T01:36:36.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:37.033 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:37.027+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:37.113 INFO:teuthology.orchestra.run.smithi018.stdout:4769 trunc from 0x2262f5e to 0xbe4072 2024-09-22T01:36:37.134 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:37.131+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:37.150 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:37.150 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:37.153 INFO:teuthology.orchestra.run.smithi018.stdout:4771 writesame 0x6593d11 thru 0x659b7fc data_size 0x2(0x7aec bytes) 2024-09-22T01:36:37.166 INFO:teuthology.orchestra.run.smithi018.stdout:4772 write 0x781fc3e thru 0x7827ac8 (0x7e8b bytes) 2024-09-22T01:36:37.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:37.171 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:37.190 INFO:teuthology.orchestra.run.smithi018.stdout:4774 write 0xd479811 thru 0xd47b0fd (0x18ed bytes) 2024-09-22T01:36:37.197 INFO:teuthology.orchestra.run.smithi018.stdout:4776 punch from 0x2424703 to 0x2426031, (0x192e bytes) 2024-09-22T01:36:37.209 INFO:teuthology.orchestra.run.smithi018.stdout:4778 write 0xdc00ada thru 0xdc064ea (0x5a11 bytes) 2024-09-22T01:36:37.215 INFO:teuthology.orchestra.run.smithi018.stdout:4780 read 0xcbc82ed thru 0xcbd0e94 (0x8ba8 bytes) 2024-09-22T01:36:37.215 INFO:teuthology.orchestra.run.smithi018.stdout:4782 write 0xbcbdf2a thru 0xbcc9aa1 (0xbb78 bytes) 2024-09-22T01:36:37.223 INFO:teuthology.orchestra.run.smithi018.stdout:4784 punch from 0xf057fc to 0xf138e1, (0xe0e5 bytes) 2024-09-22T01:36:37.223 INFO:teuthology.orchestra.run.smithi018.stdout:4785 read 0x3bc5e23 thru 0x3bd4f5c (0xf13a bytes) 2024-09-22T01:36:37.223 INFO:teuthology.orchestra.run.smithi018.stdout:4786 write 0x373276a thru 0x373a113 (0x79aa bytes) 2024-09-22T01:36:37.227 INFO:teuthology.orchestra.run.smithi018.stdout:4787 read 0x8126652 thru 0x8133c0d (0xd5bc bytes) 2024-09-22T01:36:37.228 INFO:teuthology.orchestra.run.smithi018.stdout:4788 read 0xa87cdc5 thru 0xa88429f (0x74db bytes) 2024-09-22T01:36:37.228 INFO:teuthology.orchestra.run.smithi018.stdout:4789 write 0x54d2aa8 thru 0x54d4281 (0x17da bytes) 2024-09-22T01:36:37.233 INFO:teuthology.orchestra.run.smithi018.stdout:4790 trunc from 0xdc064eb to 0xe990761 2024-09-22T01:36:37.235 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:37.228+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:37.245 INFO:teuthology.orchestra.run.smithi018.stdout:4792 read 0x36a9e6d thru 0x36afa26 (0x5bba bytes) 2024-09-22T01:36:37.246 INFO:teuthology.orchestra.run.smithi018.stdout:4793 punch from 0xbd7cd8f to 0xbd8c328, (0xf599 bytes) 2024-09-22T01:36:37.246 INFO:teuthology.orchestra.run.smithi018.stdout:4794 read 0xe623ec0 thru 0xe627dbf (0x3f00 bytes) 2024-09-22T01:36:37.247 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:37.247 INFO:teuthology.orchestra.run.smithi018.stdout:4796 read 0x848a0d2 thru 0x848c286 (0x21b5 bytes) 2024-09-22T01:36:37.247 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:37.247 INFO:teuthology.orchestra.run.smithi018.stdout:4801 clone 37 order 24 su 1048576 sc 9 2024-09-22T01:36:37.294 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:37.295 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:37.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:37.352 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:37.348+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:37.437 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:37.432+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:37.479 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:37.479 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:37.494 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:37.539 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:37.535+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:37.639 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:37.632+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:37.664 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:37.664 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:37.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:37.764 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:37.760+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:37.840 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7, 0, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:36:37.840 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:36:37.840 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-22T01:36:37.840 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.732803 2024-09-22T01:36:37.841 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.7328030234635158 2024-09-22T01:36:37.841 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:37.836+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:37.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:36:37.854 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:37.854 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:37.872 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:37.941 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:37.935+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:37.999 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone36 from 0xe990761 (overlap 0xbe4072) to 0x4c19c7 2024-09-22T01:36:38.042 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:38.036+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:38.046 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:38.047 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:38.065 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:38.143 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:38.139+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:38.198 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-22T01:36:38.204 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:38.204 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:38.224 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:38.266 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:38.263+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:38.294 INFO:teuthology.orchestra.run.smithi018.stdout:4802 punch from 0x7f3e594 to 0x7f46bc7, (0x8633 bytes) 2024-09-22T01:36:38.301 INFO:teuthology.orchestra.run.smithi018.stdout:4803 read 0xe8b11b4 thru 0xe8b19e9 (0x836 bytes) 2024-09-22T01:36:38.301 INFO:teuthology.orchestra.run.smithi018.stdout:4805 read 0x342d9fa thru 0x343bdd3 (0xe3da bytes) 2024-09-22T01:36:38.302 INFO:teuthology.orchestra.run.smithi018.stdout:4809 read 0x8dc2957 thru 0x8dcf9fe (0xd0a8 bytes) 2024-09-22T01:36:38.302 INFO:teuthology.orchestra.run.smithi018.stdout:4810 read 0xcbb32cf thru 0xcbc2b2f (0xf861 bytes) 2024-09-22T01:36:38.302 INFO:teuthology.orchestra.run.smithi018.stdout:4811 writesame 0x552c0d5 thru 0x552c291 data_size 0x1(0x1bd bytes) 2024-09-22T01:36:38.311 INFO:teuthology.orchestra.run.smithi018.stdout:4812 read 0x979d3f7 thru 0x979ffe1 (0x2beb bytes) 2024-09-22T01:36:38.311 INFO:teuthology.orchestra.run.smithi018.stdout:4813 read 0x57cb139 thru 0x57d299d (0x7865 bytes) 2024-09-22T01:36:38.312 INFO:teuthology.orchestra.run.smithi018.stdout:4814 read 0xe46950e thru 0xe475c1e (0xc711 bytes) 2024-09-22T01:36:38.312 INFO:teuthology.orchestra.run.smithi018.stdout:4816 read 0x51c46c6 thru 0x51d19f1 (0xd32c bytes) 2024-09-22T01:36:38.313 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.313 INFO:teuthology.orchestra.run.smithi018.stdout:4818 writesame 0x6b28ae0 thru 0x6b30f5b data_size 0x3d(0x847c bytes) 2024-09-22T01:36:38.325 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.345 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:38.340+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:38.352 INFO:teuthology.orchestra.run.smithi018.stdout:4820 trunc from 0xe990761 to 0x9f453e 2024-09-22T01:36:38.391 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:38.392 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:38.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:38.411 INFO:teuthology.orchestra.run.smithi018.stdout:4821 write 0x4e6b38f thru 0x4e6c729 (0x139b bytes) 2024-09-22T01:36:38.413 INFO:teuthology.orchestra.run.smithi018.stdout:4823 write 0x448dd83 thru 0x449d4dc (0xf75a bytes) 2024-09-22T01:36:38.416 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.436 INFO:teuthology.orchestra.run.smithi018.stdout:4826 write 0x7b883f6 thru 0x7b90762 (0x836d bytes) 2024-09-22T01:36:38.439 INFO:teuthology.orchestra.run.smithi018.stdout:4827 writesame 0x34f130b thru 0x350106b data_size 0x1(0xfd61 bytes) 2024-09-22T01:36:38.450 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:38.447+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:38.501 INFO:teuthology.orchestra.run.smithi018.stdout:4829 read 0x3d977cb thru 0x3d9e0ef (0x6925 bytes) 2024-09-22T01:36:38.501 INFO:teuthology.orchestra.run.smithi018.stdout:4830 punch from 0x5dadda9 to 0x5daec64, (0xebb bytes) 2024-09-22T01:36:38.520 INFO:teuthology.orchestra.run.smithi018.stdout:4832 write 0x9fa5d59 thru 0x9fa6564 (0x80c bytes) 2024-09-22T01:36:38.527 INFO:teuthology.orchestra.run.smithi018.stdout:4834 read 0x81386d5 thru 0x8143e4c (0xb778 bytes) 2024-09-22T01:36:38.528 INFO:teuthology.orchestra.run.smithi018.stdout:4836 read 0x9f86048 thru 0x9f867c6 (0x77f bytes) 2024-09-22T01:36:38.530 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:38.530 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:38.544 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:38.551 INFO:teuthology.orchestra.run.smithi018.stdout:4838 writesame 0xc505ec2 thru 0xc50fb4d data_size 0x56(0x9c8c bytes) 2024-09-22T01:36:38.551 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.551 INFO:teuthology.orchestra.run.smithi018.stdout:4841 punch from 0x3257ee3 to 0x325990e, (0x1a2b bytes) 2024-09-22T01:36:38.551 INFO:teuthology.orchestra.run.smithi018.stdout:4843 write 0x97d9881 thru 0x97e21fe (0x897e bytes) 2024-09-22T01:36:38.557 INFO:teuthology.orchestra.run.smithi018.stdout:4844 read 0xa7b380 thru 0xa8373c (0x83bd bytes) 2024-09-22T01:36:38.558 INFO:teuthology.orchestra.run.smithi018.stdout:4845 read 0xb446d94 thru 0xb44b7e9 (0x4a56 bytes) 2024-09-22T01:36:38.558 INFO:teuthology.orchestra.run.smithi018.stdout:4846 write 0xb653041 thru 0xb654e42 (0x1e02 bytes) 2024-09-22T01:36:38.563 INFO:teuthology.orchestra.run.smithi018.stdout:4848 writesame 0xa9521f0 thru 0xa95d51e data_size 0x1(0xb32f bytes) 2024-09-22T01:36:38.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:38.586 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:38.582+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:38.623 INFO:teuthology.orchestra.run.smithi018.stdout:4849 punch from 0x3807632 to 0x3810f8e, (0x995c bytes) 2024-09-22T01:36:38.623 INFO:teuthology.orchestra.run.smithi018.stdout:4850 write 0x3d4242c thru 0x3d51ce9 (0xf8be bytes) 2024-09-22T01:36:38.633 INFO:teuthology.orchestra.run.smithi018.stdout:4851 trunc from 0xc50fb4e to 0xed03c16 2024-09-22T01:36:38.642 INFO:teuthology.orchestra.run.smithi018.stdout:4852 write 0x57602bd thru 0x576065e (0x3a2 bytes) 2024-09-22T01:36:38.644 INFO:teuthology.orchestra.run.smithi018.stdout:4854 read 0xa0d7815 thru 0xa0e38c2 (0xc0ae bytes) 2024-09-22T01:36:38.645 INFO:teuthology.orchestra.run.smithi018.stdout:4855 punch from 0x345f95 to 0x34807b, (0x20e6 bytes) 2024-09-22T01:36:38.645 INFO:teuthology.orchestra.run.smithi018.stdout:4857 read 0x7a63f60 thru 0x7a69745 (0x57e6 bytes) 2024-09-22T01:36:38.645 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.647 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:38.642+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:38.661 INFO:teuthology.orchestra.run.smithi018.stdout:4859 trunc from 0xed03c16 to 0x68cea21 2024-09-22T01:36:38.680 INFO:teuthology.orchestra.run.smithi018.stdout:4860 read 0x128d558 thru 0x1298d8c (0xb835 bytes) 2024-09-22T01:36:38.681 INFO:teuthology.orchestra.run.smithi018.stdout:4862 read 0x2c2eb32 thru 0x2c372ab (0x877a bytes) 2024-09-22T01:36:38.681 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.681 INFO:teuthology.orchestra.run.smithi018.stdout:4864 read 0x920903 thru 0x9259a3 (0x50a1 bytes) 2024-09-22T01:36:38.682 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.709 INFO:teuthology.orchestra.run.smithi018.stdout:4867 write 0xd27d501 thru 0xd28c76d (0xf26d bytes) 2024-09-22T01:36:38.714 INFO:teuthology.orchestra.run.smithi018.stdout:4868 writesame 0x88d94e5 thru 0x88dda76 data_size 0x1a(0x4592 bytes) 2024-09-22T01:36:38.717 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:38.717 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:38.717 INFO:teuthology.orchestra.run.smithi018.stdout:4870 read 0x23f33 thru 0x2f1f9 (0xb2c7 bytes) 2024-09-22T01:36:38.726 INFO:teuthology.orchestra.run.smithi018.stdout:4872 trunc from 0xd28c76e to 0x7cf917b 2024-09-22T01:36:38.732 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:38.743 INFO:teuthology.orchestra.run.smithi018.stdout:4873 punch from 0x101ecbf to 0x102b0ad, (0xc3ee bytes) 2024-09-22T01:36:38.743 INFO:teuthology.orchestra.run.smithi018.stdout:4874 read 0x4061bdf thru 0x406e8f6 (0xcd18 bytes) 2024-09-22T01:36:38.743 INFO:teuthology.orchestra.run.smithi018.stdout:4875 read 0x5698ee4 thru 0x56a0737 (0x7854 bytes) 2024-09-22T01:36:38.744 INFO:teuthology.orchestra.run.smithi018.stdout:4876 write 0x23e784f thru 0x23e79f3 (0x1a5 bytes) 2024-09-22T01:36:38.746 INFO:teuthology.orchestra.run.smithi018.stdout:4877 writesame 0x7453ee5 thru 0x745f677 data_size 0x41(0xb793 bytes) 2024-09-22T01:36:38.747 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:38.747 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:38.749 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.749 INFO:teuthology.orchestra.run.smithi018.stdout:4879 punch from 0x4070ec0 to 0x4076374, (0x54b4 bytes) 2024-09-22T01:36:38.749 INFO:teuthology.orchestra.run.smithi018.stdout:4880 punch from 0x43da45b to 0x43dd82e, (0x33d3 bytes) 2024-09-22T01:36:38.749 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.749 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.762 INFO:teuthology.orchestra.run.smithi018.stdout:4883 writesame 0xbaff157 thru 0xbb02c7a data_size 0xa(0x3b24 bytes) 2024-09-22T01:36:38.762 INFO:teuthology.orchestra.run.smithi018.stdout:4885 write 0x7a85f6b thru 0x7a918b0 (0xb946 bytes) 2024-09-22T01:36:38.765 INFO:teuthology.orchestra.run.smithi018.stdout:4889 write 0x7931d76 thru 0x7938772 (0x69fd bytes) 2024-09-22T01:36:38.767 INFO:teuthology.orchestra.run.smithi018.stdout:4890 punch from 0x69cd371 to 0x69da78a, (0xd419 bytes) 2024-09-22T01:36:38.767 INFO:teuthology.orchestra.run.smithi018.stdout:4891 read 0x9c5eb8 thru 0x9d0c05 (0xad4e bytes) 2024-09-22T01:36:38.769 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:38.770 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:38.774 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:38.770+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:38.781 INFO:teuthology.orchestra.run.smithi018.stdout:4892 trunc from 0xbb02c7b to 0x3d4d1c6 2024-09-22T01:36:38.793 INFO:teuthology.orchestra.run.smithi018.stdout:4893 trunc from 0x3d4d1c6 to 0x555c333 2024-09-22T01:36:38.797 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:38.797 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:38.800 INFO:teuthology.orchestra.run.smithi018.stdout:4894 punch from 0x52fe6bb to 0x5300455, (0x1d9a bytes) 2024-09-22T01:36:38.800 INFO:teuthology.orchestra.run.smithi018.stdout:4895 punch from 0x56019b to 0x56948d, (0x92f2 bytes) 2024-09-22T01:36:38.800 INFO:teuthology.orchestra.run.smithi018.stdout:4896 punch from 0x4e50eda to 0x4e5bcc4, (0xadea bytes) 2024-09-22T01:36:38.803 INFO:teuthology.orchestra.run.smithi018.stdout:4897 trunc from 0x555c333 to 0x304c9f5 2024-09-22T01:36:38.817 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:38.818 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:38.824 INFO:teuthology.orchestra.run.smithi018.stdout:4899 trunc from 0x304c9f5 to 0xbd7dc54 2024-09-22T01:36:38.830 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.836 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:38.836 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:38.841 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:36:38.841 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.2 primary-affinity to 0.732803 (8480242) 2024-09-22T01:36:38.849 INFO:teuthology.orchestra.run.smithi018.stdout:4902 trunc from 0xbd7dc54 to 0x65f0c1 2024-09-22T01:36:38.849 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:38.844+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:38.862 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:38.871 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.871 INFO:teuthology.orchestra.run.smithi018.stdout:4906 punch from 0x27ba56 to 0x2804bd, (0x4a67 bytes) 2024-09-22T01:36:38.882 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:38.882 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:38.884 INFO:teuthology.orchestra.run.smithi018.stdout:4907 write 0x4990ad0 thru 0x4999ac6 (0x8ff7 bytes) 2024-09-22T01:36:38.887 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:38.887 INFO:teuthology.orchestra.run.smithi018.stdout:4911 write 0x292319e thru 0x292bcfa (0x8b5d bytes) 2024-09-22T01:36:38.889 INFO:teuthology.orchestra.run.smithi018.stdout:4912 read 0x9561ac thru 0x95f3b8 (0x920d bytes) 2024-09-22T01:36:38.889 INFO:teuthology.orchestra.run.smithi018.stdout:4913 write 0x2a56abd thru 0x2a6606f (0xf5b3 bytes) 2024-09-22T01:36:38.891 INFO:teuthology.orchestra.run.smithi018.stdout:4914 punch from 0x3cecf7b to 0x3cf32f3, (0x6378 bytes) 2024-09-22T01:36:38.891 INFO:teuthology.orchestra.run.smithi018.stdout:4915 writesame 0x10470e thru 0x10f336 data_size 0x53(0xac29 bytes) 2024-09-22T01:36:38.903 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:38.903 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:38.904 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:38.904 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:38.904 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:38.904 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:38.904 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:38.912 INFO:teuthology.orchestra.run.smithi018.stdout:4916 write 0xb6135d9 thru 0xb61a8f6 (0x731e bytes) 2024-09-22T01:36:38.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:38.929 INFO:teuthology.orchestra.run.smithi018.stdout:4917 writesame 0xe144d37 thru 0xe1525b6 data_size 0x40(0xd880 bytes) 2024-09-22T01:36:38.929 INFO:teuthology.orchestra.run.smithi018.stdout:4918 read 0xb4d41d4 thru 0xb4dc7e6 (0x8613 bytes) 2024-09-22T01:36:38.929 INFO:teuthology.orchestra.run.smithi018.stdout:4919 trunc from 0xe1525b7 to 0xe85c4a5 2024-09-22T01:36:38.935 INFO:teuthology.orchestra.run.smithi018.stdout:4920 write 0x9472e14 thru 0x947b747 (0x8934 bytes) 2024-09-22T01:36:38.940 INFO:teuthology.orchestra.run.smithi018.stdout:4922 read 0x664dbfb thru 0x6651559 (0x395f bytes) 2024-09-22T01:36:38.950 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:38.944+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:38.957 INFO:teuthology.orchestra.run.smithi018.stdout:4926 trunc from 0xe85c4a5 to 0x3debd47 2024-09-22T01:36:38.975 INFO:teuthology.orchestra.run.smithi018.stdout:4927 read 0xf58908 thru 0xf68338 (0xfa31 bytes) 2024-09-22T01:36:38.976 INFO:teuthology.orchestra.run.smithi018.stdout:4929 write 0x10e4199 thru 0x10ec7d8 (0x8640 bytes) 2024-09-22T01:36:38.980 INFO:teuthology.orchestra.run.smithi018.stdout:4931 clone 38 order 19 su 65536 sc 14 2024-09-22T01:36:39.049 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:39.049 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.599371998999999, 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.050 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:36:39.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:36:39.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.595403773000001, 2024-09-22T01:36:39.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:36:39.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:36:39.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:36:39.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.595384713000001, 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:36:39.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:36:39.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:36:39.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.063 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.595158849999997, 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:36:39.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:36:39.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:36:39.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:36:39.068 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.068 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.068 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.068 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:39.068 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:39.068 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.587628506999998, 2024-09-22T01:36:39.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:36:39.070 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.070 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.071 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.071 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.071 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.071 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.071 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:36:39.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.071 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.074 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.583647212000002, 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.075 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:36:39.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.079 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 58.579429128999998, 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.080 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.083 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111086 3.c 3:35fd2b6c:::rbd_data.110fb46d971e.0000000000000006:24 [read 835584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.36159462, 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094586389000000007, 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111086 2024-09-22T01:36:39.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:36:39.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8699999999999995e-07 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684828+0000", 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6847e-05 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684836+0000", 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6539999999999999e-06 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684841+0000", 2024-09-22T01:36:39.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.896e-06 2024-09-22T01:36:39.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776879+0000", 2024-09-22T01:36:39.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.092037657999999994 2024-09-22T01:36:39.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776960+0000", 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0653000000000002e-05 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779397+0000", 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024371940000000002 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111087 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.088 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3615416889999992, 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094592211999999995, 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111087 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684864+0000", 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0500000000000003e-07 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684867+0000", 2024-09-22T01:36:39.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2820000000000001e-06 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684887+0000", 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9834e-05 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684892+0000", 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3220000000000003e-06 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779442+0000", 2024-09-22T01:36:39.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094550318999999994 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779456+0000", 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.385e-05 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111088 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.361504966, 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094599416000000006, 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.092 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111088 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684901+0000", 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3300000000000003e-07 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684906+0000", 2024-09-22T01:36:39.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684912+0000", 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8819999999999998e-06 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684919+0000", 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0330000000000003e-06 2024-09-22T01:36:39.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779492+0000", 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094573333999999995 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779500+0000", 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7360000000000001e-06 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111089 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3614780619999998, 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094616622999999997, 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111089 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684928+0000", 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7399999999999998e-07 2024-09-22T01:36:39.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684930+0000", 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.881e-06 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684938+0000", 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5689999999999999e-06 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684944+0000", 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.665e-06 2024-09-22T01:36:39.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779538+0000", 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094594370999999997 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779544+0000", 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6629999999999998e-06 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111090 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3614420109999994, 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094605844999999994, 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.101 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111090 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:36:39.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684964+0000", 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8999999999999997e-07 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684967+0000", 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4460000000000001e-06 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684975+0000", 2024-09-22T01:36:39.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.943e-06 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684990+0000", 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4482e-05 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779561+0000", 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094571526000000003 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779569+0000", 2024-09-22T01:36:39.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9580000000000007e-06 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111091 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3613973890000004, 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094588915999999995, 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.105 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111091 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685012+0000", 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.602e-06 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685020+0000", 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2300000000000008e-06 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.107 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685030+0000", 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5719999999999992e-06 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779591+0000", 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094560898000000004 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779597+0000", 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9569999999999999e-06 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111092 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3613656580000004, 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094585007999999998, 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.109 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111092 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.110 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685043+0000", 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7269999999999999e-06 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685051+0000", 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3140000000000004e-06 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685057+0000", 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9739999999999999e-06 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779618+0000", 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094561289000000007 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779625+0000", 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.195e-06 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111093 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3613403440000003, 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094587735000000006, 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.113 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111093 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:36:39.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.115 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.115 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685537+0000", 2024-09-22T01:36:39.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00047185400000000001 2024-09-22T01:36:39.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.115 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.115 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685543+0000", 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9410000000000004e-06 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685555+0000", 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2449999999999999e-05 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685563+0000", 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6279999999999996e-06 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779648+0000", 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094084962999999994 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779653+0000", 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.899e-06 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.117 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111094 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3608173299999997, 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091857000000001, 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111094 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.118 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685589+0000", 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5300000000000004e-07 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685595+0000", 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8229999999999997e-06 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685602+0000", 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8730000000000001e-06 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685607+0000", 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5279999999999997e-06 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779675+0000", 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094068054999999998 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779680+0000", 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9250000000000003e-06 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111095 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:36:39.121 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3607917720000007, 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091049999999996, 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111095 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.122 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685614+0000", 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5600000000000001e-07 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685615+0000", 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.593e-06 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685619+0000", 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1150000000000004e-06 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685623+0000", 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3529999999999999e-06 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779700+0000", 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094076749000000001 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779704+0000", 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8840000000000002e-06 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.125 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111096 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3607779329999996, 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094106891999999998, 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.126 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111096 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685756+0000", 2024-09-22T01:36:39.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012857600000000001 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685761+0000", 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.118e-06 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685770+0000", 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0650000000000005e-06 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685794+0000", 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4202999999999998e-05 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779729+0000", 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093934985999999998 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779734+0000", 2024-09-22T01:36:39.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9439999999999996e-06 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111097 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685807+0000", 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3605978410000006, 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093953446999999995, 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.130 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111097 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685807+0000", 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685807+0000", 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.131 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685808+0000", 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685812+0000", 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6830000000000001e-06 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685821+0000", 2024-09-22T01:36:39.132 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1300000000000007e-06 2024-09-22T01:36:39.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685827+0000", 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1460000000000001e-06 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779755+0000", 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093928426999999995 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779761+0000", 2024-09-22T01:36:39.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3990000000000003e-06 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111098 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685846+0000", 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 8.3605590099999993, 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093945415000000004, 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:39.136 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.137 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.137 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.137 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111098 2024-09-22T01:36:39.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.137 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.137 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.137 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685846+0000", 2024-09-22T01:36:39.137 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685846+0000", 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685955+0000", 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000108563 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685975+0000", 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9831e-05 2024-09-22T01:36:39.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685988+0000", 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3828999999999999e-05 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685998+0000", 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3610000000000007e-06 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779783+0000", 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093785048999999995 2024-09-22T01:36:39.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779792+0000", 2024-09-22T01:36:39.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7819999999999999e-06 2024-09-22T01:36:39.142 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.142 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.143 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.143 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.143 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.143 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:39.144 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:39.145 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:39.140+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:39.245 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:39.238+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:39.275 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:39.275 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:39.275 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:39.286 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:39.374 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:39.370+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:39.448 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:39.442+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:39.453 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:39.453 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:39.453 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:39.453 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:39.453 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:39.467 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:39.554 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:39.550+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.561172158000005, 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.640 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:39.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.644 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.561135129999997, 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.648 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.549584670000002, 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.649 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.549550663000005, 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.653 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:39.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:36:39.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.545683312999998, 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:36:39.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:36:39.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:36:39.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:36:39.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.545637764999995, 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.662 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:36:39.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:39.666 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.545592557000006, 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:39.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:36:39.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:36:39.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.545557965, 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.671 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.545524317000002, 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.675 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:36:39.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.679 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.541794827000004, 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:36:39.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:36:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.684 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.684 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.684 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.685 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:39.685 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.541758324, 2024-09-22T01:36:39.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:36:39.685 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.685 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.689 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.541713685000005, 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:39.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:36:39.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.693 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.541663459000006, 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.694 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.541625017000001, 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.698 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:36:39.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:36:39.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.703 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.703 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:39.703 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.541581022000003, 2024-09-22T01:36:39.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:36:39.703 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.703 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.703 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.703 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.703 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.541541871999996, 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.708 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:36:39.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.537698703999993, 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.712 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:36:39.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:36:39.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.537618378000005, 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:36:39.720 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.833065082000005, 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.721 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:36:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 69.838923514000001, 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:36:39.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:36:39.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:39.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:39.732 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:39.734 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:39.734 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:39.732+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:39.835 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:39.828+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:39.908 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:39.908 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:39.908 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:39.908 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:39.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:39.936 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:39.932+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:40.037 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:40.030+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:40.046 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:40.047 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:40.047 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:40.047 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:40.047 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:40.060 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:40.146 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:40.142+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:40.230 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:40.230 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 126.918077408, 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:36:40.231 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:40.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.235 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.237 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.387304712000002, 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.238 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.241 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.387077431999998, 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.242 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:36:40.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.246 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.383909148000001, 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:40.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:36:40.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:36:40.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.383824884000006, 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:36:40.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:36:40.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:36:40.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.383773387999994, 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:36:40.255 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:36:40.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:36:40.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.383728067999996, 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.260 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:36:40.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:36:40.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.380247811000004, 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.264 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:36:40.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:40.268 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.379942998999994, 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:40.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:36:40.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.272 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.379893554999995, 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:36:40.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.277 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.379849000999997, 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:36:40.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.379805351000002, 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.282 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.379758129999999, 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.286 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:36:40.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.379563124000001, 2024-09-22T01:36:40.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:40.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:36:40.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:36:40.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.379513637000002, 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.298 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.376362577999998, 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:36:40.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.376016949999993, 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:40.303 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:36:40.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:36:40.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.375921527000003, 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.307 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.310 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.375868948000004, 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.311 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.314 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.375827181000005, 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:40.318 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:40.319 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone37 from 0x3debd47 (overlap 0x65f0c1) to 0x518d67 2024-09-22T01:36:40.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:40.320 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:40.316+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:40.421 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:40.414+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:40.453 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:40.453 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:40.453 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:40.454 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:40.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:40.522 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:40.516+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:40.598 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:40.598 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:40.598 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:40.599 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:40.599 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:40.615 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:40.623 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:40.618+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:40.723 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-22T01:36:40.723 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:40.716+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:40.753 INFO:teuthology.orchestra.run.smithi018.stdout:4933 punch from 0x2c2166c to 0x2c2f5ef, (0xdf83 bytes) 2024-09-22T01:36:40.762 INFO:teuthology.orchestra.run.smithi018.stdout:4936 trunc from 0x3debd47 to 0x373d982 2024-09-22T01:36:40.804 INFO:teuthology.orchestra.run.smithi018.stdout:4937 write 0x9c7d9 thru 0xa5cc9 (0x94f1 bytes) 2024-09-22T01:36:40.805 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:40.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.332455742999997, 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.806 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.332381333000001, 2024-09-22T01:36:40.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:36:40.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.332324802000002, 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.815 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:40.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:36:40.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:36:40.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.332267208000005, 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:36:40.819 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.823 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.33220987, 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:40.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:36:40.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:40.827 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.332152429000004, 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.831 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.33211652, 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.835 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.327072822000005, 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:36:40.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:40.840 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.327009380999996, 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:36:40.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.844 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.326954143999998, 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:36:40.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:40.848 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.326880829999993, 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:36:40.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:36:40.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.852 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.326826749000006, 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:36:40.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.326772310999999, 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.326716450000006, 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:36:40.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:40.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:36:40.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93498 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.226549691999999, 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93801259999999997, 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93498 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576580+0000", 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8600000000000003e-06 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576600+0000", 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9746e-05 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576650+0000", 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0419e-05 2024-09-22T01:36:40.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576678+0000", 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7858999999999999e-05 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580737+0000", 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040585939999999996 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580754+0000", 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7102e-05 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514561+0000", 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93380681700000001 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514589+0000", 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8203000000000001e-05 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93499 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:40.869 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.223683979, 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93524844100000004, 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93499 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:40.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579444+0000", 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2369999999999999e-06 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579455+0000", 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0655e-05 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579486+0000", 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1473999999999997e-05 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579506+0000", 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9513000000000001e-05 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581124+0000", 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016177050000000001 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581135+0000", 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1534e-05 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514663+0000", 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93352768399999997 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514691+0000", 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7639000000000001e-05 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94339 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch reconnect cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.181306747000001, 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0158427670000001, 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.874 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94339 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:40.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621821+0000", 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.55e-06 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621827+0000", 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1299999999999998e-06 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621843+0000", 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5542000000000001e-05 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621853+0000", 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0445000000000001e-05 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621924+0000", 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1262999999999999e-05 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621936+0000", 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.131e-05 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625444+0000", 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0035085479999999 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625845+0000", 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040067999999999999 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.637662+0000", 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011817299 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94342 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [notify cookie 140215384087984] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.167136577999997, 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99234641400000001, 2024-09-22T01:36:40.879 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94342 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635992+0000", 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.12e-06 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636002+0000", 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636032+0000", 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0463e-05 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636053+0000", 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1002999999999999e-05 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636187+0000", 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013359299999999999 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636206+0000", 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9327e-05 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627756+0000", 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99154943799999995 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627997+0000", 2024-09-22T01:36:40.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024163200000000001 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628336+0000", 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033850200000000002 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94343 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch ping cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.094968711999996, 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92041710600000004, 2024-09-22T01:36:40.884 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94343 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708160+0000", 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8559999999999998e-06 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708178+0000", 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.73e-05 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708212+0000", 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4573000000000003e-05 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708238+0000", 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5792e-05 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708344+0000", 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106508 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708357+0000", 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2183e-05 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628387+0000", 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92003072600000002 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628449+0000", 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1828000000000005e-05 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628574+0000", 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012533999999999999 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:95531 3.8 3:11293fc5:::rbd_object_map.110f30608ae1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e89)", 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.155959358, 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.012680681, 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:40.889 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 95531 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:40.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647169+0000", 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9649999999999998e-06 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647177+0000", 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0439999999999996e-06 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647196+0000", 2024-09-22T01:36:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9400000000000001e-05 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647204+0000", 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647266+0000", 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2117000000000002e-05 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647275+0000", 2024-09-22T01:36:40.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0679999999999997e-06 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651032+0000", 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037574980000000002 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651044+0000", 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-05 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659538+0000", 2024-09-22T01:36:40.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0084937460000001 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659847+0000", 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000309587 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:40.894 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:40.895 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:36:40.896 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:40.890+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:40.896 INFO:teuthology.orchestra.run.smithi018.stdout:4938 read 0x3473578 thru 0x3476248 (0x2cd1 bytes) 2024-09-22T01:36:40.896 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:40.896 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:40.896 INFO:teuthology.orchestra.run.smithi018.stdout:4941 read 0x55b526 thru 0x55dbcd (0x26a8 bytes) 2024-09-22T01:36:40.896 INFO:teuthology.orchestra.run.smithi018.stdout:4942 punch from 0x25a4898 to 0x25b3cf7, (0xf45f bytes) 2024-09-22T01:36:40.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4943 writesame 0x96d401d thru 0x96d8cd3 data_size 0x1(0x4cb7 bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4944 read 0x644fa8d thru 0x6456548 (0x6abc bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4945 punch from 0x16cfc7c to 0x16d57d0, (0x5b54 bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4948 read 0x3574076 thru 0x3579f21 (0x5eac bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4949 writesame 0xe01505f thru 0xe022d75 data_size 0x1(0xdd17 bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4950 read 0x7c73640 thru 0x7c7b11e (0x7adf bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4951 write 0x2c50c44 thru 0x2c56b91 (0x5f4e bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4952 punch from 0x5d82fad to 0x5d8b4fd, (0x8550 bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4953 writesame 0xe50bf93 thru 0xe513a48 data_size 0x71(0x7ab6 bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4954 write 0x7a70317 thru 0x7a792e2 (0x8fcc bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4955 writesame 0x319297e thru 0x31a13f8 data_size 0x21(0xea7b bytes) 2024-09-22T01:36:40.899 INFO:teuthology.orchestra.run.smithi018.stdout:4956 write 0x421e30f thru 0x422777c (0x946e bytes) 2024-09-22T01:36:40.900 INFO:teuthology.orchestra.run.smithi018.stdout:4958 write 0x2134c9 thru 0x21b104 (0x7c3c bytes) 2024-09-22T01:36:40.901 INFO:teuthology.orchestra.run.smithi018.stdout:4959 read 0x2fac8db thru 0x2fba1af (0xd8d5 bytes) 2024-09-22T01:36:40.915 INFO:teuthology.orchestra.run.smithi018.stdout:4960 trunc from 0xe513a49 to 0x7d7345a 2024-09-22T01:36:40.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:40.931 INFO:teuthology.orchestra.run.smithi018.stdout:4961 read 0x240e670 thru 0x241b79d (0xd12e bytes) 2024-09-22T01:36:40.932 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:40.933 INFO:teuthology.orchestra.run.smithi018.stdout:4964 trunc from 0x7d7345a to 0x73f3b7f 2024-09-22T01:36:40.972 INFO:teuthology.orchestra.run.smithi018.stdout:4965 writesame 0x90c32c4 thru 0x90ca729 data_size 0x2f(0x7466 bytes) 2024-09-22T01:36:40.981 INFO:teuthology.orchestra.run.smithi018.stdout:4966 trunc from 0x90ca72a to 0x2b068fc 2024-09-22T01:36:40.996 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:40.990+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:41.031 INFO:teuthology.orchestra.run.smithi018.stdout:4967 punch from 0x22ee704 to 0x22f35d2, (0x4ece bytes) 2024-09-22T01:36:41.043 INFO:teuthology.orchestra.run.smithi018.stdout:4968 write 0x3c63dcf thru 0x3c69efb (0x612d bytes) 2024-09-22T01:36:41.044 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:41.044 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:41.044 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:41.044 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:41.051 INFO:teuthology.orchestra.run.smithi018.stdout:4969 trunc from 0x3c69efc to 0x295bb73 2024-09-22T01:36:41.067 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:41.097 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:41.090+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:41.109 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:41.110 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:41.110 INFO:teuthology.orchestra.run.smithi018.stdout:4970 trunc from 0x295bb73 to 0xa42a9e3 2024-09-22T01:36:41.128 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:41.128 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:41.136 INFO:teuthology.orchestra.run.smithi018.stdout:4971 write 0xc1f2f5a thru 0xc1f60d9 (0x3180 bytes) 2024-09-22T01:36:41.142 INFO:teuthology.orchestra.run.smithi018.stdout:4972 writesame 0x34abffe thru 0x34b05bd data_size 0x40(0x45c0 bytes) 2024-09-22T01:36:41.156 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:41.157 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:41.165 INFO:teuthology.orchestra.run.smithi018.stdout:4973 write 0xec593fc thru 0xec5edd6 (0x59db bytes) 2024-09-22T01:36:41.171 INFO:teuthology.orchestra.run.smithi018.stdout:4974 writesame 0x99c1588 thru 0x99cc93f data_size 0x6c(0xb3b8 bytes) 2024-09-22T01:36:41.176 INFO:teuthology.orchestra.run.smithi018.stdout:4975 read 0xd82bcba thru 0xd834536 (0x887d bytes) 2024-09-22T01:36:41.176 INFO:teuthology.orchestra.run.smithi018.stdout:4976 write 0x100a5bf thru 0x1016ae1 (0xc523 bytes) 2024-09-22T01:36:41.178 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:41.178 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:41.183 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.184 INFO:teuthology.orchestra.run.smithi018.stdout:4978 read 0x343c643 thru 0x34451a1 (0x8b5f bytes) 2024-09-22T01:36:41.184 INFO:teuthology.orchestra.run.smithi018.stdout:4980 write 0x3ff2c22 thru 0x3ff79a1 (0x4d80 bytes) 2024-09-22T01:36:41.198 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:41.192+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:41.207 INFO:teuthology.orchestra.run.smithi018.stdout:4981 trunc from 0xec5edd7 to 0x2173579 2024-09-22T01:36:41.213 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:41.214 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:41.245 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:41.245 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:41.255 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:41.255 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:41.264 INFO:teuthology.orchestra.run.smithi018.stdout:4983 punch from 0x12bfa42 to 0x12cf799, (0xfd57 bytes) 2024-09-22T01:36:41.264 INFO:teuthology.orchestra.run.smithi018.stdout:4984 read 0x1725d83 thru 0x17332df (0xd55d bytes) 2024-09-22T01:36:41.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:41.282 INFO:teuthology.orchestra.run.smithi018.stdout:4986 write 0x4cc16cb thru 0x4cc9a30 (0x8366 bytes) 2024-09-22T01:36:41.288 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.299 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:41.294+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:41.307 INFO:teuthology.orchestra.run.smithi018.stdout:4990 write 0x997e4bf thru 0x9985d60 (0x78a2 bytes) 2024-09-22T01:36:41.313 INFO:teuthology.orchestra.run.smithi018.stdout:4991 punch from 0x718f45b to 0x7196fe6, (0x7b8b bytes) 2024-09-22T01:36:41.313 INFO:teuthology.orchestra.run.smithi018.stdout:4992 write 0x13bc3e0 thru 0x13c10c5 (0x4ce6 bytes) 2024-09-22T01:36:41.320 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.320 INFO:teuthology.orchestra.run.smithi018.stdout:4994 read 0x52c5117 thru 0x52ca003 (0x4eed bytes) 2024-09-22T01:36:41.333 INFO:teuthology.orchestra.run.smithi018.stdout:4995 trunc from 0x9985d61 to 0x5d701d 2024-09-22T01:36:41.386 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.400 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:41.394+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:41.419 INFO:teuthology.orchestra.run.smithi018.stdout:4998 write 0xe60a0cd thru 0xe60cc36 (0x2b6a bytes) 2024-09-22T01:36:41.419 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:41.419 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:41.425 INFO:teuthology.orchestra.run.smithi018.stdout:4999 read 0x7551014 thru 0x7555ec5 (0x4eb2 bytes) 2024-09-22T01:36:41.425 INFO:teuthology.orchestra.run.smithi018.stdout:5000 write 0x784bad6 thru 0x7850aca (0x4ff5 bytes) 2024-09-22T01:36:41.430 INFO:teuthology.orchestra.run.smithi018.stdout:5001 read 0x6983f31 thru 0x698fbc3 (0xbc93 bytes) 2024-09-22T01:36:41.431 INFO:teuthology.orchestra.run.smithi018.stdout:5003 writesame 0xa4ec0e2 thru 0xa4fa34a data_size 0x1(0xe269 bytes) 2024-09-22T01:36:41.437 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:41.458 INFO:teuthology.orchestra.run.smithi018.stdout:5004 writesame 0x8ff8c7f thru 0x8ffeeab data_size 0x1(0x622d bytes) 2024-09-22T01:36:41.471 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:41.471 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:41.491 INFO:teuthology.orchestra.run.smithi018.stdout:5005 read 0x8d12543 thru 0x8d131a7 (0xc65 bytes) 2024-09-22T01:36:41.491 INFO:teuthology.orchestra.run.smithi018.stdout:5006 read 0x6a24576 thru 0x6a282ee (0x3d79 bytes) 2024-09-22T01:36:41.491 INFO:teuthology.orchestra.run.smithi018.stdout:5007 writesame 0xe5361e0 thru 0xe53ab25 data_size 0x2(0x4946 bytes) 2024-09-22T01:36:41.492 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:41.492 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:41.500 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:41.494+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:41.505 INFO:teuthology.orchestra.run.smithi018.stdout:5008 write 0xaa0c696 thru 0xaa195c8 (0xcf33 bytes) 2024-09-22T01:36:41.512 INFO:teuthology.orchestra.run.smithi018.stdout:5009 read 0xaf39a6d thru 0xaf448c4 (0xae58 bytes) 2024-09-22T01:36:41.512 INFO:teuthology.orchestra.run.smithi018.stdout:5011 punch from 0x31aa97b to 0x31b9e83, (0xf508 bytes) 2024-09-22T01:36:41.512 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.512 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.513 INFO:teuthology.orchestra.run.smithi018.stdout:5014 write 0x23dbf4 thru 0x24a0af (0xc4bc bytes) 2024-09-22T01:36:41.516 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.516 INFO:teuthology.orchestra.run.smithi018.stdout:5016 read 0xe369edd thru 0xe376625 (0xc749 bytes) 2024-09-22T01:36:41.517 INFO:teuthology.orchestra.run.smithi018.stdout:5018 write 0x1215621 thru 0x1223201 (0xdbe1 bytes) 2024-09-22T01:36:41.522 INFO:teuthology.orchestra.run.smithi018.stdout:5019 read 0x6408d08 thru 0x6416328 (0xd621 bytes) 2024-09-22T01:36:41.522 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.522 INFO:teuthology.orchestra.run.smithi018.stdout:5021 read 0x91ad680 thru 0x91b0795 (0x3116 bytes) 2024-09-22T01:36:41.522 INFO:teuthology.orchestra.run.smithi018.stdout:5022 writesame 0xb3d6787 thru 0xb3d6c78 data_size 0x3(0x4f2 bytes) 2024-09-22T01:36:41.527 INFO:teuthology.orchestra.run.smithi018.stdout:5023 read 0x34db9c1 thru 0x34e347f (0x7abf bytes) 2024-09-22T01:36:41.527 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.536 INFO:teuthology.orchestra.run.smithi018.stdout:5025 trunc from 0xe60cc37 to 0x7d16338 2024-09-22T01:36:41.559 INFO:teuthology.orchestra.run.smithi018.stdout:5026 read 0x6180e59 thru 0x6181ffd (0x11a5 bytes) 2024-09-22T01:36:41.559 INFO:teuthology.orchestra.run.smithi018.stdout:5027 read 0x25cd0d1 thru 0x25ce52a (0x145a bytes) 2024-09-22T01:36:41.559 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.559 INFO:teuthology.orchestra.run.smithi018.stdout:5031 read 0x3d9bb9a thru 0x3d9c132 (0x599 bytes) 2024-09-22T01:36:41.559 INFO:teuthology.orchestra.run.smithi018.stdout:5032 read 0x57c3418 thru 0x57c75c7 (0x41b0 bytes) 2024-09-22T01:36:41.560 INFO:teuthology.orchestra.run.smithi018.stdout:5034 read 0x5627309 thru 0x5630294 (0x8f8c bytes) 2024-09-22T01:36:41.575 INFO:teuthology.orchestra.run.smithi018.stdout:5035 write 0xc104a3c thru 0xc10dd31 (0x92f6 bytes) 2024-09-22T01:36:41.580 INFO:teuthology.orchestra.run.smithi018.stdout:5037 read 0xc059454 thru 0xc05d191 (0x3d3e bytes) 2024-09-22T01:36:41.580 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.580 INFO:teuthology.orchestra.run.smithi018.stdout:5039 write 0x4ef4447 thru 0x4efc590 (0x814a bytes) 2024-09-22T01:36:41.582 INFO:teuthology.orchestra.run.smithi018.stdout:5040 read 0x17bfcec thru 0x17ce8b7 (0xebcc bytes) 2024-09-22T01:36:41.592 INFO:teuthology.orchestra.run.smithi018.stdout:5041 trunc from 0xc10dd32 to 0x4a95468 2024-09-22T01:36:41.592 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:41.592 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:41.601 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:41.594+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:41.608 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:41.611 INFO:teuthology.orchestra.run.smithi018.stdout:5043 read 0x2a51164 thru 0x2a5e4b5 (0xd352 bytes) 2024-09-22T01:36:41.611 INFO:teuthology.orchestra.run.smithi018.stdout:5045 read 0x1f378d5 thru 0x1f393da (0x1b06 bytes) 2024-09-22T01:36:41.611 INFO:teuthology.orchestra.run.smithi018.stdout:5046 read 0x4a4f88b thru 0x4a5b588 (0xbcfe bytes) 2024-09-22T01:36:41.611 INFO:teuthology.orchestra.run.smithi018.stdout:5048 write 0x2d6a082 thru 0x2d79e3d (0xfdbc bytes) 2024-09-22T01:36:41.617 INFO:teuthology.orchestra.run.smithi018.stdout:5049 read 0xf8ba62 thru 0xf8bd89 (0x328 bytes) 2024-09-22T01:36:41.617 INFO:teuthology.orchestra.run.smithi018.stdout:5050 punch from 0xffd449 to 0x100a2ec, (0xcea3 bytes) 2024-09-22T01:36:41.639 INFO:teuthology.orchestra.run.smithi018.stdout:5051 writesame 0xbf06e56 thru 0xbf072bf data_size 0x1(0x46a bytes) 2024-09-22T01:36:41.654 INFO:teuthology.orchestra.run.smithi018.stdout:5054 writesame 0xeb5e90d thru 0xeb67c69 data_size 0x19(0x935d bytes) 2024-09-22T01:36:41.655 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.655 INFO:teuthology.orchestra.run.smithi018.stdout:5056 read 0xbbbeca7 thru 0xbbc1a74 (0x2dce bytes) 2024-09-22T01:36:41.655 INFO:teuthology.orchestra.run.smithi018.stdout:5058 write 0xa2823d8 thru 0xa28ac60 (0x8889 bytes) 2024-09-22T01:36:41.660 INFO:teuthology.orchestra.run.smithi018.stdout:5059 read 0xaca303b thru 0xacb27a7 (0xf76d bytes) 2024-09-22T01:36:41.660 INFO:teuthology.orchestra.run.smithi018.stdout:5060 punch from 0xc6135dd to 0xc61803e, (0x4a61 bytes) 2024-09-22T01:36:41.661 INFO:teuthology.orchestra.run.smithi018.stdout:5061 writesame 0x5e355ff thru 0x5e435f6 data_size 0xc(0xdff8 bytes) 2024-09-22T01:36:41.667 INFO:teuthology.orchestra.run.smithi018.stdout:5063 writesame 0x2e5c594 thru 0x2e5e2d1 data_size 0x13(0x1d3e bytes) 2024-09-22T01:36:41.670 INFO:teuthology.orchestra.run.smithi018.stdout:5064 read 0x3cdba71 thru 0x3ce2ef9 (0x7489 bytes) 2024-09-22T01:36:41.670 INFO:teuthology.orchestra.run.smithi018.stdout:5065 read 0xca184dd thru 0xca21944 (0x9468 bytes) 2024-09-22T01:36:41.670 INFO:teuthology.orchestra.run.smithi018.stdout:5066 write 0xda68faa thru 0xda73dbf (0xae16 bytes) 2024-09-22T01:36:41.676 INFO:teuthology.orchestra.run.smithi018.stdout:5067 writesame 0x2c4756d thru 0x2c52315 data_size 0x1d(0xada9 bytes) 2024-09-22T01:36:41.690 INFO:teuthology.orchestra.run.smithi018.stdout:5068 trunc from 0xeb67c6a to 0x8937ab4 2024-09-22T01:36:41.701 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:41.696+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:41.722 INFO:teuthology.orchestra.run.smithi018.stdout:5069 write 0xb78d1c0 thru 0xb79c88c (0xf6cd bytes) 2024-09-22T01:36:41.729 INFO:teuthology.orchestra.run.smithi018.stdout:5070 write 0x1c43d08 thru 0x1c4a7bb (0x6ab4 bytes) 2024-09-22T01:36:41.742 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:41.742 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:41.750 INFO:teuthology.orchestra.run.smithi018.stdout:5071 trunc from 0xb79c88d to 0xf54c07 2024-09-22T01:36:41.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:41.774 INFO:teuthology.orchestra.run.smithi018.stdout:5072 read 0x54f847 thru 0x559e17 (0xa5d1 bytes) 2024-09-22T01:36:41.776 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.798 INFO:teuthology.orchestra.run.smithi018.stdout:5074 write 0x662b7a2 thru 0x6635e73 (0xa6d2 bytes) 2024-09-22T01:36:41.803 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:41.798+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:41.812 INFO:teuthology.orchestra.run.smithi018.stdout:5075 trunc from 0x6635e74 to 0x30d0638 2024-09-22T01:36:41.829 INFO:teuthology.orchestra.run.smithi018.stdout:5076 read 0x9bdebb thru 0x9c8e6f (0xafb5 bytes) 2024-09-22T01:36:41.829 INFO:teuthology.orchestra.run.smithi018.stdout:5077 write 0x16ba737 thru 0x16bf8d2 (0x519c bytes) 2024-09-22T01:36:41.836 INFO:teuthology.orchestra.run.smithi018.stdout:5079 read 0xf40469 thru 0xf4ada0 (0xa938 bytes) 2024-09-22T01:36:41.837 INFO:teuthology.orchestra.run.smithi018.stdout:5081 read 0x250b22d thru 0x251ab9d (0xf971 bytes) 2024-09-22T01:36:41.857 INFO:teuthology.orchestra.run.smithi018.stdout:5082 trunc from 0x30d0638 to 0xca4404e 2024-09-22T01:36:41.861 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:36:41.878 INFO:teuthology.orchestra.run.smithi018.stdout:5083 read 0x1e290d8 thru 0x1e2fcb0 (0x6bd9 bytes) 2024-09-22T01:36:41.878 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:41.879 INFO:teuthology.orchestra.run.smithi018.stdout:5085 read 0xac31174 thru 0xac3def3 (0xcd80 bytes) 2024-09-22T01:36:41.892 INFO:teuthology.orchestra.run.smithi018.stdout:5086 trunc from 0xca4404e to 0x175baed 2024-09-22T01:36:41.899 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:41.899 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:41.903 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:41.898+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:41.913 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:41.934 INFO:teuthology.orchestra.run.smithi018.stdout:5087 writesame 0xc13472d thru 0xc13c7a2 data_size 0x12(0x8076 bytes) 2024-09-22T01:36:41.934 INFO:teuthology.orchestra.run.smithi018.stdout:5088 punch from 0xe8c197 to 0xe8ff0f, (0x3d78 bytes) 2024-09-22T01:36:41.935 INFO:teuthology.orchestra.run.smithi018.stdout:5089 writesame 0x4aca048 thru 0x4ad0693 data_size 0x2(0x664c bytes) 2024-09-22T01:36:41.945 INFO:teuthology.orchestra.run.smithi018.stdout:5090 writesame 0x1b8f261 thru 0x1b9019e data_size 0x1(0xf3e bytes) 2024-09-22T01:36:41.949 INFO:teuthology.orchestra.run.smithi018.stdout:5091 writesame 0xb30a4ad thru 0xb315f5b data_size 0x1(0xbaaf bytes) 2024-09-22T01:36:41.981 INFO:teuthology.orchestra.run.smithi018.stdout:5092 punch from 0x5ce88c4 to 0x5cf0355, (0x7a91 bytes) 2024-09-22T01:36:41.981 INFO:teuthology.orchestra.run.smithi018.stdout:5093 read 0xa97bf29 thru 0xa985827 (0x98ff bytes) 2024-09-22T01:36:41.981 INFO:teuthology.orchestra.run.smithi018.stdout:5096 writesame 0x7292850 thru 0x72a2401 data_size 0x3(0xfbb2 bytes) 2024-09-22T01:36:41.993 INFO:teuthology.orchestra.run.smithi018.stdout:5097 writesame 0x5b1696a thru 0x5b19016 data_size 0x1(0x26ad bytes) 2024-09-22T01:36:42.004 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:41.998+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:42.010 INFO:teuthology.orchestra.run.smithi018.stdout:5098 punch from 0x5ca5b7a to 0x5cb5147, (0xf5cd bytes) 2024-09-22T01:36:42.010 INFO:teuthology.orchestra.run.smithi018.stdout:5100 write 0x395cc4f thru 0x3969dbc (0xd16e bytes) 2024-09-22T01:36:42.033 INFO:teuthology.orchestra.run.smithi018.stdout:5101 writesame 0xdafd3c3 thru 0xdaff97e data_size 0x3c(0x25bc bytes) 2024-09-22T01:36:42.033 INFO:teuthology.orchestra.run.smithi018.stdout:5103 write 0x744128a thru 0x7446f7b (0x5cf2 bytes) 2024-09-22T01:36:42.051 INFO:teuthology.orchestra.run.smithi018.stdout:5104 write 0xdf6ad5e thru 0xdf6b54f (0x7f2 bytes) 2024-09-22T01:36:42.057 INFO:teuthology.orchestra.run.smithi018.stdout:5105 write 0xd786039 thru 0xd78c45f (0x6427 bytes) 2024-09-22T01:36:42.062 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:42.062 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:42.064 INFO:teuthology.orchestra.run.smithi018.stdout:5106 write 0xab7d460 thru 0xab84e62 (0x7a03 bytes) 2024-09-22T01:36:42.072 INFO:teuthology.orchestra.run.smithi018.stdout:5107 punch from 0x98e285d to 0x98f07ac, (0xdf4f bytes) 2024-09-22T01:36:42.072 INFO:teuthology.orchestra.run.smithi018.stdout:5108 write 0x7a3b38b thru 0x7a47ed0 (0xcb46 bytes) 2024-09-22T01:36:42.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:42.080 INFO:teuthology.orchestra.run.smithi018.stdout:5109 punch from 0x6149071 to 0x615001c, (0x6fab bytes) 2024-09-22T01:36:42.081 INFO:teuthology.orchestra.run.smithi018.stdout:5110 writesame 0x60af3e3 thru 0x60b91bf data_size 0x1(0x9ddd bytes) 2024-09-22T01:36:42.113 INFO:teuthology.orchestra.run.smithi018.stdout:5111 punch from 0xd8a585c to 0xd8b4bcb, (0xf36f bytes) 2024-09-22T01:36:42.113 INFO:teuthology.orchestra.run.smithi018.stdout:5112 write 0x88bd911 thru 0x88c10f6 (0x37e6 bytes) 2024-09-22T01:36:42.113 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:42.108+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:42.120 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:42.120 INFO:teuthology.orchestra.run.smithi018.stdout:5115 punch from 0x5794c43 to 0x579d90a, (0x8cc7 bytes) 2024-09-22T01:36:42.120 INFO:teuthology.orchestra.run.smithi018.stdout:5117 read 0xa3fb01b thru 0xa40041e (0x5404 bytes) 2024-09-22T01:36:42.126 INFO:teuthology.orchestra.run.smithi018.stdout:5118 trunc from 0xdf6b550 to 0x945129f 2024-09-22T01:36:42.149 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:42.149 INFO:teuthology.orchestra.run.smithi018.stdout:5120 read 0x1dfe4a7 thru 0x1e06245 (0x7d9f bytes) 2024-09-22T01:36:42.149 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:42.158 INFO:teuthology.orchestra.run.smithi018.stdout:5124 trunc from 0x945129f to 0x2adb8be 2024-09-22T01:36:42.184 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:42.206 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:42.202+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:42.206 INFO:teuthology.orchestra.run.smithi018.stdout:5126 writesame 0x737ac55 thru 0x7382321 data_size 0x1(0x76cd bytes) 2024-09-22T01:36:42.214 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:42.214 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:42.217 INFO:teuthology.orchestra.run.smithi018.stdout:5127 trunc from 0x7382322 to 0xc224407 2024-09-22T01:36:42.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:42.230 INFO:teuthology.orchestra.run.smithi018.stdout:5128 read 0x9fed99a thru 0x9ff382b (0x5e92 bytes) 2024-09-22T01:36:42.230 INFO:teuthology.orchestra.run.smithi018.stdout:5130 punch from 0x40be260 to 0x40c77f4, (0x9594 bytes) 2024-09-22T01:36:42.231 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:42.231 INFO:teuthology.orchestra.run.smithi018.stdout:5133 read 0x201279c thru 0x2012e4a (0x6af bytes) 2024-09-22T01:36:42.248 INFO:teuthology.orchestra.run.smithi018.stdout:5135 write 0xdf2cd25 thru 0xdf3a6cb (0xd9a7 bytes) 2024-09-22T01:36:42.254 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:42.269 INFO:teuthology.orchestra.run.smithi018.stdout:5137 trunc from 0xdf3a6cc to 0x4661329 2024-09-22T01:36:42.306 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:42.300+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:42.308 INFO:teuthology.orchestra.run.smithi018.stdout:5138 write 0x85d9374 thru 0x85da74f (0x13dc bytes) 2024-09-22T01:36:42.319 INFO:teuthology.orchestra.run.smithi018.stdout:5139 trunc from 0x85da750 to 0xc414f84 2024-09-22T01:36:42.336 INFO:teuthology.orchestra.run.smithi018.stdout:5140 trunc from 0xc414f84 to 0x9c729dd 2024-09-22T01:36:42.369 INFO:teuthology.orchestra.run.smithi018.stdout:5141 writesame 0xb0e00ef thru 0xb0e5f0d data_size 0x1(0x5e1f bytes) 2024-09-22T01:36:42.370 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:42.370 INFO:teuthology.orchestra.run.smithi018.stdout:5144 write 0xacc34dc thru 0xacc8701 (0x5226 bytes) 2024-09-22T01:36:42.388 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:42.388 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:42.399 INFO:teuthology.orchestra.run.smithi018.stdout:5146 write 0xebfc30f thru 0xec05cca (0x99bc bytes) 2024-09-22T01:36:42.403 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:42.407 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:42.402+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:42.409 INFO:teuthology.orchestra.run.smithi018.stdout:5150 read 0x1a15ace thru 0x1a24a21 (0xef54 bytes) 2024-09-22T01:36:42.409 INFO:teuthology.orchestra.run.smithi018.stdout:5151 read 0xd13301f thru 0xd139b83 (0x6b65 bytes) 2024-09-22T01:36:42.409 INFO:teuthology.orchestra.run.smithi018.stdout:5152 writesame 0xddf9de thru 0xdedf92 data_size 0x13(0xe5b5 bytes) 2024-09-22T01:36:42.420 INFO:teuthology.orchestra.run.smithi018.stdout:5153 read 0x6f89408 thru 0x6f8c586 (0x317f bytes) 2024-09-22T01:36:42.420 INFO:teuthology.orchestra.run.smithi018.stdout:5154 read 0x1111a thru 0x15da8 (0x4c8f bytes) 2024-09-22T01:36:42.421 INFO:teuthology.orchestra.run.smithi018.stdout:5155 write 0xdf6fa0f thru 0xdf78e88 (0x947a bytes) 2024-09-22T01:36:42.428 INFO:teuthology.orchestra.run.smithi018.stdout:5156 write 0xbe0ffa2 thru 0xbe16fa8 (0x7007 bytes) 2024-09-22T01:36:42.465 INFO:teuthology.orchestra.run.smithi018.stdout:5157 trunc from 0xec05ccb to 0xc87995 2024-09-22T01:36:42.493 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:42.493 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:42.508 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:42.502+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:42.525 INFO:teuthology.orchestra.run.smithi018.stdout:5160 write 0xa7088e7 thru 0xa70a217 (0x1931 bytes) 2024-09-22T01:36:42.532 INFO:teuthology.orchestra.run.smithi018.stdout:5162 punch from 0x4f6d548 to 0x4f73171, (0x5c29 bytes) 2024-09-22T01:36:42.532 INFO:teuthology.orchestra.run.smithi018.stdout:5163 writesame 0x620703e thru 0x6211a69 data_size 0x2(0xaa2c bytes) 2024-09-22T01:36:42.538 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:42.538 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:42.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:42.559 INFO:teuthology.orchestra.run.smithi018.stdout:5164 write 0x982e41f thru 0x9834446 (0x6028 bytes) 2024-09-22T01:36:42.569 INFO:teuthology.orchestra.run.smithi018.stdout:5165 clone 39 order 21 su 8192 sc 5 2024-09-22T01:36:42.642 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:42.638+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:42.709 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:42.702+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:42.720 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:42.720 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:42.736 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:42.826 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:42.822+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:42.905 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:42.905 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:42.911 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:42.906+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:42.920 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:43.012 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:43.008+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:43.088 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:43.088 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:43.103 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:43.113 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:43.108+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:43.121 INFO:teuthology.orchestra.run.smithi018.stdout:flattening image image_client.0-clone38 2024-09-22T01:36:43.214 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:43.210+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:43.219 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:43.220 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:43.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:43.322 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:43.318+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:43.402 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:43.402 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:43.415 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:43.408+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:43.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:43.426 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-22T01:36:43.475 INFO:teuthology.orchestra.run.smithi018.stdout:5166 write 0xecbe794 thru 0xeccace8 (0xc555 bytes) 2024-09-22T01:36:43.494 INFO:teuthology.orchestra.run.smithi018.stdout:5170 read 0x2e0f1e9 thru 0x2e16b94 (0x79ac bytes) 2024-09-22T01:36:43.494 INFO:teuthology.orchestra.run.smithi018.stdout:5171 writesame 0x5bce9b1 thru 0x5bd8b66 data_size 0x7(0xa1b6 bytes) 2024-09-22T01:36:43.516 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:43.512+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:43.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:43.519 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:43.519 INFO:teuthology.orchestra.run.smithi018.stdout:5174 write 0xb2868ca thru 0xb28d87c (0x6fb3 bytes) 2024-09-22T01:36:43.533 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:43.534 INFO:teuthology.orchestra.run.smithi018.stdout:5177 read 0x5befa58 thru 0x5bf143d (0x19e6 bytes) 2024-09-22T01:36:43.535 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:43.535 INFO:teuthology.orchestra.run.smithi018.stdout:5179 write 0x4ad0452 thru 0x4ad8a14 (0x85c3 bytes) 2024-09-22T01:36:43.549 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:43.549 INFO:teuthology.orchestra.run.smithi018.stdout:5181 write 0xbf7aaf3 thru 0xbf7d865 (0x2d73 bytes) 2024-09-22T01:36:43.562 INFO:teuthology.orchestra.run.smithi018.stdout:5182 trunc from 0xeccace9 to 0xb6ee555 2024-09-22T01:36:43.581 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:43.581 INFO:teuthology.orchestra.run.smithi018.stdout:5185 write 0x75a1740 thru 0x75b0f53 (0xf814 bytes) 2024-09-22T01:36:43.594 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:43.594 INFO:teuthology.orchestra.run.smithi018.stdout:5187 write 0x6a1745c thru 0x6a19d10 (0x28b5 bytes) 2024-09-22T01:36:43.606 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:43.606 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:43.618 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:43.610+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:43.620 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:43.621 INFO:teuthology.orchestra.run.smithi018.stdout:5188 trunc from 0xb6ee555 to 0x43c6be7 2024-09-22T01:36:43.679 INFO:teuthology.orchestra.run.smithi018.stdout:5189 writesame 0xd58996d thru 0xd58fb59 data_size 0x35(0x61ed bytes) 2024-09-22T01:36:43.679 INFO:teuthology.orchestra.run.smithi018.stdout:5190 read 0x7e1d3c9 thru 0x7e24d98 (0x79d0 bytes) 2024-09-22T01:36:43.679 INFO:teuthology.orchestra.run.smithi018.stdout:5191 read 0x154ee8 thru 0x1585a2 (0x36bb bytes) 2024-09-22T01:36:43.680 INFO:teuthology.orchestra.run.smithi018.stdout:5192 write 0x40fdd1b thru 0x4105aeb (0x7dd1 bytes) 2024-09-22T01:36:43.684 INFO:teuthology.orchestra.run.smithi018.stdout:5193 write 0x19348d6 thru 0x1939153 (0x487e bytes) 2024-09-22T01:36:43.691 INFO:teuthology.orchestra.run.smithi018.stdout:5197 read 0x212a691 thru 0x212ef47 (0x48b7 bytes) 2024-09-22T01:36:43.691 INFO:teuthology.orchestra.run.smithi018.stdout:5198 punch from 0x97b2c46 to 0x97be199, (0xb553 bytes) 2024-09-22T01:36:43.691 INFO:teuthology.orchestra.run.smithi018.stdout:5199 write 0x45b15c6 thru 0x45b4baf (0x35ea bytes) 2024-09-22T01:36:43.693 INFO:teuthology.orchestra.run.smithi018.stdout:5200 read 0xb7f3862 thru 0xb7f8bdd (0x537c bytes) 2024-09-22T01:36:43.693 INFO:teuthology.orchestra.run.smithi018.stdout:5202 write 0x80672aa thru 0x8071f0a (0xac61 bytes) 2024-09-22T01:36:43.701 INFO:teuthology.orchestra.run.smithi018.stdout:5204 read 0x390f970 thru 0x3910a27 (0x10b8 bytes) 2024-09-22T01:36:43.701 INFO:teuthology.orchestra.run.smithi018.stdout:5205 punch from 0x6a58110 to 0x6a5a186, (0x2076 bytes) 2024-09-22T01:36:43.701 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:43.701 INFO:teuthology.orchestra.run.smithi018.stdout:5208 writesame 0x2594e5f thru 0x259c180 data_size 0x1(0x7322 bytes) 2024-09-22T01:36:43.702 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:43.702 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:43.718 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:43.714+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:43.719 INFO:teuthology.orchestra.run.smithi018.stdout:5209 read 0x5f644e2 thru 0x5f71f82 (0xdaa1 bytes) 2024-09-22T01:36:43.720 INFO:teuthology.orchestra.run.smithi018.stdout:5210 read 0x320f531 thru 0x321bdd8 (0xc8a8 bytes) 2024-09-22T01:36:43.720 INFO:teuthology.orchestra.run.smithi018.stdout:5211 writesame 0x6c49602 thru 0x6c52e9e data_size 0x3(0x989d bytes) 2024-09-22T01:36:43.722 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:43.722 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:43.729 INFO:teuthology.orchestra.run.smithi018.stdout:5212 trunc from 0xd58fb5a to 0xd0939fe 2024-09-22T01:36:43.737 INFO:teuthology.orchestra.run.smithi018.stdout:5213 punch from 0xa420ea2 to 0xa42f01b, (0xe179 bytes) 2024-09-22T01:36:43.737 INFO:teuthology.orchestra.run.smithi018.stdout:5214 write 0x6f58158 thru 0x6f5f1f8 (0x70a1 bytes) 2024-09-22T01:36:43.743 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:43.743 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:43.748 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:43.759 INFO:teuthology.orchestra.run.smithi018.stdout:5216 trunc from 0xd0939fe to 0x62eac08 2024-09-22T01:36:43.769 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:43.769 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:43.777 INFO:teuthology.orchestra.run.smithi018.stdout:5217 clone 40 order 21 su 262144 sc 14 2024-09-22T01:36:43.787 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:43.787 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:43.794 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:43.794 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:43.807 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:43.807 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:43.808 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:43.819 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:43.812+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:43.826 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:43.826 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:43.844 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:43.844 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:43.871 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7, 0, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:36:43.871 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:36:43.871 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-22T01:36:43.871 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-22T01:36:43.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:36:43.948 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:43.944+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:43.965 INFO:teuthology.orchestra.run.smithi018.stdout:flattening image image_client.0-clone39 2024-09-22T01:36:43.994 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:43.994 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.917350752000004, 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:36:43.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:36:43.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:36:43.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:36:43.998 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.917313723999996, 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:43.999 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:36:44.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.905763264000001, 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:44.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.005 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.905729257000004, 2024-09-22T01:36:44.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:36:44.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.901861906999997, 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.010 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.901816358999994, 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.014 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:36:44.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:36:44.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.018 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.901771151000005, 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:36:44.022 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.901736559, 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.023 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:36:44.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.901702911000001, 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.027 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:36:44.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:36:44.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:36:44.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.897973421000003, 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.031 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.032 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.897936917999999, 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.035 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:36:44.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.897892279000004, 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.039 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:36:44.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:36:44.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.897842053000005, 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:36:44.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:36:44.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.897803611000001, 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:36:44.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.897759616000002, 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:36:44.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:44.054 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.897720465999996, 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.055 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:36:44.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.893877298000007, 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.058 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.059 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:44.062 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.893796972000004, 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:44.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.189243676000004, 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:36:44.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:36:44.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 74.195102108, 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:36:44.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:36:44.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:36:44.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:36:44.077 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.077 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.077 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.077 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.077 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.077 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:44.078 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:44.078 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:44.074+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:44.165 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-22T01:36:44.179 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:44.172+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:44.262 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:44.262 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:44.262 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:44.262 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:44.276 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:44.277 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 114, 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "2d4626ba-577e-46d9-ad53-8451e5733f43", 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-22T01:34:18.722829+0000", 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-22T01:36:43.871830+0000", 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-22T01:34:31.284224+0000", 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-22T01:36:08.612770+0000", 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5804032, 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-22T01:36:44.278 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 3, 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-22T01:36:44.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:31.452919+0000", 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:36:44.280 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "16", 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:36:44.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:36:44.282 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:36:44.283 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-22T01:36:44.284 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.90166282653808594, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "rbd", 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:36.960578+0000", 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:36:44.285 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:36:44.286 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "20", 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 2, 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 20, 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:36:44.287 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:36:44.288 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:36:44.289 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.9900000095367432, 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.9900000095367432, 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.87999999523162842, 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.90166282653808594, 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.290 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "pool_client.0", 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:46.686791+0000", 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:36:44.291 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "114", 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:36:44.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 42, 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 114, 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:36:44.293 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:36:44.294 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-22T01:36:44.295 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.90166282653808594, 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "8de621b1-0a3b-4b8b-b982-70e8db073085", 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:44.296 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 106, 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.297 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-22T01:36:44.298 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-22T01:36:44.299 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.300 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/1213730345", 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/1213730345", 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/1213730345", 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/1213730345", 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "798cbd57-ebd4-461a-9bbf-68e683d1049e", 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:44.301 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.4805145263671875, 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 110, 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.303 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:44.304 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.305 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3361514324", 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3361514324", 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3361514324", 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3361514324", 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9294585f-3dc9-4b04-8cae-f8d78c92791e", 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.7327880859375, 2024-09-22T01:36:44.306 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 89, 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-22T01:36:44.307 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:44.308 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.309 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/4002178714", 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/4002178714", 2024-09-22T01:36:44.310 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/4002178714", 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/4002178714", 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "1ff1abf7-fdbb-4f8a-85e5-90f102abcec2", 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:44.311 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 107, 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.312 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:44.313 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/2610959301", 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/2610959301", 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/2610959301", 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/2610959301", 2024-09-22T01:36:44.315 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9aa2579a-ada1-45f3-9341-f46697c28212", 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 89, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:44.316 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6824", 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6825", 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6826", 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6827", 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6830", 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6831", 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6828", 2024-09-22T01:36:44.319 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6829", 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6825/482886379", 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6827/482886379", 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6831/482886379", 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6829/482886379", 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:44.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4a6678eb-28ca-4b05-96ae-e9deeb60ca96", 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 86, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6816", 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6817", 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.322 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6818", 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6819", 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6822", 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:44.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6823", 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6820", 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6821", 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6817/2695689817", 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6819/2695689817", 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6823/2695689817", 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6821/2695689817", 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.325 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "775b01e8-5705-4b98-a3ab-f15a78271355", 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 84, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.326 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6808", 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6809", 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6810", 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6811", 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6814", 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:44.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6815", 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6812", 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6813", 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6809/1840779137", 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6811/1840779137", 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6815/1840779137", 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6813/1840779137", 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.330 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "15f6d6c1-8a16-42c6-9e43-f3a92e511735", 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 83, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.331 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6800", 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6801", 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6802", 2024-09-22T01:36:44.332 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6803", 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6806", 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:44.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6807", 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6804", 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6805", 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6801/4222842386", 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6803/4222842386", 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6807/4222842386", 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6805/4222842386", 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-22T01:36:44.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.339566+0000", 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:44.336 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.065958+0000", 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.261750+0000", 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:44.337 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.463117+0000", 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.557372+0000", 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.195553+0000", 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:44.339 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.008891+0000", 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:27.839466+0000", 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-22T01:36:44.340 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "3.3", 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 4, 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 6 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-22T01:36:44.341 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-22T01:36:44.342 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-22T01:36:44.343 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-22T01:36:44.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:44.343 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:44.345 INFO:tasks.thrashosds.thrasher:j is {'epoch': 114, 'fsid': '2d4626ba-577e-46d9-ad53-8451e5733f43', 'created': '2024-09-22T01:34:18.722829+0000', 'modified': '2024-09-22T01:36:43.871830+0000', 'last_up_change': '2024-09-22T01:34:31.284224+0000', 'last_in_change': '2024-09-22T01:36:08.612770+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-22T01:34:31.452919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9016628265380859, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-22T01:34:36.960578+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9016628265380859, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-22T01:34:46.686791+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 42, 'snap_epoch': 114, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9016628265380859, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': '8de621b1-0a3b-4b8b-b982-70e8db073085', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 106, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6824', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6825', 'nonce': 1213730345}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6826', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6827', 'nonce': 1213730345}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6830', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6831', 'nonce': 1213730345}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6828', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6829', 'nonce': 1213730345}]}, 'public_addr': '172.21.15.18:6825/1213730345', 'cluster_addr': '172.21.15.18:6827/1213730345', 'heartbeat_back_addr': '172.21.15.18:6831/1213730345', 'heartbeat_front_addr': '172.21.15.18:6829/1213730345', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '798cbd57-ebd4-461a-9bbf-68e683d1049e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.4805145263671875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 110, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6800', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6801', 'nonce': 3361514324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6803', 'nonce': 3361514324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6807', 'nonce': 3361514324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6805', 'nonce': 3361514324}]}, 'public_addr': '172.21.15.18:6801/3361514324', 'cluster_addr': '172.21.15.18:6803/3361514324', 'heartbeat_back_addr': '172.21.15.18:6807/3361514324', 'heartbeat_front_addr': '172.21.15.18:6805/3361514324', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '9294585f-3dc9-4b04-8cae-f8d78c92791e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7327880859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6817', 'nonce': 4002178714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6818', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6819', 'nonce': 4002178714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6822', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6823', 'nonce': 4002178714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6820', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6821', 'nonce': 4002178714}]}, 'public_addr': '172.21.15.18:6817/4002178714', 'cluster_addr': '172.21.15.18:6819/4002178714', 'heartbeat_back_addr': '172.21.15.18:6823/4002178714', 'heartbeat_front_addr': '172.21.15.18:6821/4002178714', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1ff1abf7-fdbb-4f8a-85e5-90f102abcec2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 107, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6809', 'nonce': 2610959301}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6811', 'nonce': 2610959301}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6815', 'nonce': 2610959301}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6813', 'nonce': 2610959301}]}, 'public_addr': '172.21.15.18:6809/2610959301', 'cluster_addr': '172.21.15.18:6811/2610959301', 'heartbeat_back_addr': '172.21.15.18:6815/2610959301', 'heartbeat_front_addr': '172.21.15.18:6813/2610959301', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '9aa2579a-ada1-45f3-9341-f46697c28212', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 89, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6824', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6825', 'nonce': 482886379}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6826', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6827', 'nonce': 482886379}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6830', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6831', 'nonce': 482886379}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6828', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6829', 'nonce': 482886379}]}, 'public_addr': '172.21.15.179:6825/482886379', 'cluster_addr': '172.21.15.179:6827/482886379', 'heartbeat_back_addr': '172.21.15.179:6831/482886379', 'heartbeat_front_addr': '172.21.15.179:6829/482886379', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4a6678eb-28ca-4b05-96ae-e9deeb60ca96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6816', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6817', 'nonce': 2695689817}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6818', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6819', 'nonce': 2695689817}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6822', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6823', 'nonce': 2695689817}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6820', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6821', 'nonce': 2695689817}]}, 'public_addr': '172.21.15.179:6817/2695689817', 'cluster_addr': '172.21.15.179:6819/2695689817', 'heartbeat_back_addr': '172.21.15.179:6823/2695689817', 'heartbeat_front_addr': '172.21.15.179:6821/2695689817', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '775b01e8-5705-4b98-a3ab-f15a78271355', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6808', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6809', 'nonce': 1840779137}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6810', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6811', 'nonce': 1840779137}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6814', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6815', 'nonce': 1840779137}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6812', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6813', 'nonce': 1840779137}]}, 'public_addr': '172.21.15.179:6809/1840779137', 'cluster_addr': '172.21.15.179:6811/1840779137', 'heartbeat_back_addr': '172.21.15.179:6815/1840779137', 'heartbeat_front_addr': '172.21.15.179:6813/1840779137', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '15f6d6c1-8a16-42c6-9e43-f3a92e511735', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6800', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6801', 'nonce': 4222842386}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6802', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6803', 'nonce': 4222842386}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6806', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6807', 'nonce': 4222842386}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6804', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6805', 'nonce': 4222842386}]}, 'public_addr': '172.21.15.179:6801/4222842386', 'cluster_addr': '172.21.15.179:6803/4222842386', 'heartbeat_back_addr': '172.21.15.179:6807/4222842386', 'heartbeat_front_addr': '172.21.15.179:6805/4222842386', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.339566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.065958+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.261750+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.463117+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.557372+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.195553+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.008891+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:27.839466+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.3', 'mappings': [{'from': 4, 'to': 6}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-22T01:36:44.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:36:44.345 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:44.340+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:44.397 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:44.397 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:44.397 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:44.397 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:44.397 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:44.411 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:44.445 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:44.440+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:44.468 INFO:teuthology.orchestra.run.smithi018.stdout:5218 read 0x61fb431 thru 0x6202535 (0x7105 bytes) 2024-09-22T01:36:44.469 INFO:teuthology.orchestra.run.smithi018.stdout:5219 write 0x5b59b3 thru 0x5be4db (0x8b29 bytes) 2024-09-22T01:36:44.483 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:44.483 INFO:teuthology.orchestra.run.smithi018.stdout:5223 punch from 0x3e6d464 to 0x3e76682, (0x921e bytes) 2024-09-22T01:36:44.483 INFO:teuthology.orchestra.run.smithi018.stdout:5224 read 0x44eef5d thru 0x44f7346 (0x83ea bytes) 2024-09-22T01:36:44.484 INFO:teuthology.orchestra.run.smithi018.stdout:5227 read 0x30794a9 thru 0x30885ef (0xf147 bytes) 2024-09-22T01:36:44.484 INFO:teuthology.orchestra.run.smithi018.stdout:5228 writesame 0x37d3a thru 0x47ae4 data_size 0x1(0xfdab bytes) 2024-09-22T01:36:44.531 INFO:teuthology.orchestra.run.smithi018.stdout:5232 punch from 0x28f93ce to 0x2901d06, (0x8938 bytes) 2024-09-22T01:36:44.531 INFO:teuthology.orchestra.run.smithi018.stdout:5233 read 0x1f8550 thru 0x1fd022 (0x4ad3 bytes) 2024-09-22T01:36:44.532 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:44.532 INFO:teuthology.orchestra.run.smithi018.stdout:5236 read 0x1ccc1a3 thru 0x1cce994 (0x27f2 bytes) 2024-09-22T01:36:44.532 INFO:teuthology.orchestra.run.smithi018.stdout:5238 punch from 0x3f67822 to 0x3f6a83a, (0x3018 bytes) 2024-09-22T01:36:44.539 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:44.539 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 131.22771664999999, 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:36:44.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:36:44.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:36:44.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:36:44.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.545 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.696943954000005, 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.546 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:36:44.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.549 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.696716674000001, 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.550 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:36:44.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:36:44.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.693548390000004, 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.554 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:36:44.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.693464125999995, 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.558 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:44.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:36:44.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.693412629999997, 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.562 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:36:44.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.693367309999999, 2024-09-22T01:36:44.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.570 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.689887053000007, 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:36:44.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.689582240999997, 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.578 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.689532796999998, 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.579 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:36:44.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.689488243, 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:36:44.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:44.586 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.689444593000005, 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.588 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:36:44.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.689397372000002, 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:36:44.590 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:44.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:36:44.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.689202366000004, 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.594 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:36:44.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.689152879000005, 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.598 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:36:44.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.601 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.686001820000001, 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:36:44.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:36:44.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:36:44.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.605 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.685656191999996, 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.606 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.685560769000006, 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.609 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:44.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.685508189999993, 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:36:44.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:36:44.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 99.685466422999994, 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:44.616 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:44.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:36:44.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:36:44.619 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.620 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.620 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.620 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:44.620 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:44.620 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:44.622 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:44.614+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:44.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:44.622 INFO:teuthology.orchestra.run.smithi018.stdout:5240 write 0x69c491f thru 0x69d3502 (0xebe4 bytes) 2024-09-22T01:36:44.623 INFO:teuthology.orchestra.run.smithi018.stdout:5241 trunc from 0x69d3503 to 0x27b13fc 2024-09-22T01:36:44.623 INFO:teuthology.orchestra.run.smithi018.stdout:5242 write 0x4d76a8f thru 0x4d856a3 (0xec15 bytes) 2024-09-22T01:36:44.623 INFO:teuthology.orchestra.run.smithi018.stdout:5243 punch from 0x1f12094 to 0x1f14a0e, (0x297a bytes) 2024-09-22T01:36:44.623 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:44.623 INFO:teuthology.orchestra.run.smithi018.stdout:5247 read 0x2809328 thru 0x2817b98 (0xe871 bytes) 2024-09-22T01:36:44.623 INFO:teuthology.orchestra.run.smithi018.stdout:5249 read 0x1f4aa8c thru 0x1f51a71 (0x6fe6 bytes) 2024-09-22T01:36:44.623 INFO:teuthology.orchestra.run.smithi018.stdout:5250 writesame 0x10d7252 thru 0x10e1589 data_size 0xc(0xa338 bytes) 2024-09-22T01:36:44.623 INFO:teuthology.orchestra.run.smithi018.stdout:5251 punch from 0x1596edf to 0x15a5b1c, (0xec3d bytes) 2024-09-22T01:36:44.623 INFO:teuthology.orchestra.run.smithi018.stdout:5252 trunc from 0x4d856a4 to 0x67331bf 2024-09-22T01:36:44.628 INFO:teuthology.orchestra.run.smithi018.stdout:5253 trunc from 0x67331bf to 0xcf87535 2024-09-22T01:36:44.645 INFO:teuthology.orchestra.run.smithi018.stdout:5255 write 0xed1203a thru 0xed1c084 (0xa04b bytes) 2024-09-22T01:36:44.650 INFO:teuthology.orchestra.run.smithi018.stdout:5257 write 0x7a5c9a5 thru 0x7a648ac (0x7f08 bytes) 2024-09-22T01:36:44.656 INFO:teuthology.orchestra.run.smithi018.stdout:5258 trunc from 0xed1c085 to 0xded65de 2024-09-22T01:36:44.669 INFO:teuthology.orchestra.run.smithi018.stdout:5259 punch from 0x1797981 to 0x1799856, (0x1ed5 bytes) 2024-09-22T01:36:44.669 INFO:teuthology.orchestra.run.smithi018.stdout:5261 write 0x73ffcd9 thru 0x7408455 (0x877d bytes) 2024-09-22T01:36:44.675 INFO:teuthology.orchestra.run.smithi018.stdout:5262 read 0xcfc4492 thru 0xcfc980e (0x537d bytes) 2024-09-22T01:36:44.675 INFO:teuthology.orchestra.run.smithi018.stdout:5263 read 0x95287b5 thru 0x952c4c3 (0x3d0f bytes) 2024-09-22T01:36:44.675 INFO:teuthology.orchestra.run.smithi018.stdout:5266 write 0xda59e04 thru 0xda6631b (0xc518 bytes) 2024-09-22T01:36:44.679 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:44.679 INFO:teuthology.orchestra.run.smithi018.stdout:5270 write 0x2063617 thru 0x2072f45 (0xf92f bytes) 2024-09-22T01:36:44.683 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:44.683 INFO:teuthology.orchestra.run.smithi018.stdout:5273 writesame 0x4fd87de thru 0x4fe3fa0 data_size 0x3(0xb7c3 bytes) 2024-09-22T01:36:44.708 INFO:teuthology.orchestra.run.smithi018.stdout:5274 writesame 0x7054057 thru 0x705b621 data_size 0x25(0x75cb bytes) 2024-09-22T01:36:44.711 INFO:teuthology.orchestra.run.smithi018.stdout:5275 write 0x559facb thru 0x55aad8c (0xb2c2 bytes) 2024-09-22T01:36:44.717 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:44.717 INFO:teuthology.orchestra.run.smithi018.stdout:5277 write 0x993eebb thru 0x9944e22 (0x5f68 bytes) 2024-09-22T01:36:44.722 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:44.716+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:44.733 INFO:teuthology.orchestra.run.smithi018.stdout:5278 trunc from 0xded65de to 0xa0934e6 2024-09-22T01:36:44.750 INFO:teuthology.orchestra.run.smithi018.stdout:5279 write 0x55584ec thru 0x556071c (0x8231 bytes) 2024-09-22T01:36:44.753 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:36:44.753 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:36:44.756 INFO:teuthology.orchestra.run.smithi018.stdout:5280 clone 41 order 21 su 8192 sc 14 2024-09-22T01:36:44.758 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:44.758 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:44.758 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:44.758 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:44.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:44.776 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-22T01:36:43.877106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1903384576,"num_objects":1460,"num_object_clones":482,"num_object_copies":2920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1460,"num_whiteouts":443,"num_read":152128,"num_read_kb":865314,"num_write":14123,"num_write_kb":453083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2282,"num_bytes_recovered":169012220,"num_keys_recovered":442,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11573,"ondisk_log_size":11573,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":858864,"kb_used_data":556572,"kb_used_omap":12,"kb_used_meta":302067,"kb_avail":754115856,"statfs":{"total":773094113280,"available":772214636544,"internally_reserved":0,"allocated":569929728,"data_stored":712976165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":309317168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43545747,"num_objects":50,"num_object_clones":15,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":8,"num_read":7406,"num_read_kb":76335,"num_write":1002,"num_write_kb":42170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.466913"},"pg_stats":[{"pgid":"3.1f","version":"111'386","reported_seq":3584,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.457624+0000","last_change":"2024-09-22T01:36:06.627109+0000","last_active":"2024-09-22T01:36:41.457624+0000","last_peered":"2024-09-22T01:36:41.457624+0000","last_clean":"2024-09-22T01:36:41.457624+0000","last_became_active":"2024-09-22T01:36:06.623922+0000","last_became_peered":"2024-09-22T01:36:06.623922+0000","last_unstale":"2024-09-22T01:36:41.457624+0000","last_undegraded":"2024-09-22T01:36:41.457624+0000","last_fullsized":"2024-09-22T01:36:41.457624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:38.811859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001437504,"stat_sum":{"num_bytes":51151166,"num_objects":35,"num_object_clones":12,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":4384,"num_read_kb":25076,"num_write":545,"num_write_kb":11949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":3071623,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"111'369","reported_seq":3227,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.341661+0000","last_change":"2024-09-22T01:34:50.528432+0000","last_active":"2024-09-22T01:36:41.341661+0000","last_peered":"2024-09-22T01:36:41.341661+0000","last_clean":"2024-09-22T01:36:41.341661+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:36:41.341661+0000","last_undegraded":"2024-09-22T01:36:41.341661+0000","last_fullsized":"2024-09-22T01:36:41.341661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:21:24.666347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00178118,"stat_sum":{"num_bytes":60903466,"num_objects":40,"num_object_clones":12,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":4829,"num_read_kb":41076,"num_write":430,"num_write_kb":19462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"111'426","reported_seq":2006,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.288767+0000","last_change":"2024-09-22T01:34:50.542416+0000","last_active":"2024-09-22T01:36:41.288767+0000","last_peered":"2024-09-22T01:36:41.288767+0000","last_clean":"2024-09-22T01:36:41.288767+0000","last_became_active":"2024-09-22T01:34:48.547909+0000","last_became_peered":"2024-09-22T01:34:48.547909+0000","last_unstale":"2024-09-22T01:36:41.288767+0000","last_undegraded":"2024-09-22T01:36:41.288767+0000","last_fullsized":"2024-09-22T01:36:41.288767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:18:50.793145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031538109999999999,"stat_sum":{"num_bytes":63288244,"num_objects":45,"num_object_clones":16,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":15,"num_read":2601,"num_read_kb":30237,"num_write":584,"num_write_kb":14489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"111'181","reported_seq":1705,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.517253+0000","last_change":"2024-09-22T01:34:50.541509+0000","last_active":"2024-09-22T01:36:41.517253+0000","last_peered":"2024-09-22T01:36:41.517253+0000","last_clean":"2024-09-22T01:36:41.517253+0000","last_became_active":"2024-09-22T01:34:48.546869+0000","last_became_peered":"2024-09-22T01:34:48.546869+0000","last_unstale":"2024-09-22T01:36:41.517253+0000","last_undegraded":"2024-09-22T01:36:41.517253+0000","last_fullsized":"2024-09-22T01:36:41.517253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:48:24.264168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025435940000000001,"stat_sum":{"num_bytes":38771096,"num_objects":28,"num_object_clones":9,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":7,"num_read":1441,"num_read_kb":32565,"num_write":184,"num_write_kb":14631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"111'913","reported_seq":3906,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.727624+0000","last_change":"2024-09-22T01:36:07.627276+0000","last_active":"2024-09-22T01:36:41.727624+0000","last_peered":"2024-09-22T01:36:41.727624+0000","last_clean":"2024-09-22T01:36:41.727624+0000","last_became_active":"2024-09-22T01:36:07.623588+0000","last_became_peered":"2024-09-22T01:36:07.623588+0000","last_unstale":"2024-09-22T01:36:41.727624+0000","last_undegraded":"2024-09-22T01:36:41.727624+0000","last_fullsized":"2024-09-22T01:36:41.727624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":913,"log_dups_size":0,"ondisk_log_size":913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:35:47.384203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015758949999999999,"stat_sum":{"num_bytes":53928636,"num_objects":47,"num_object_clones":15,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":16,"num_read":8302,"num_read_kb":20024,"num_write":1436,"num_write_kb":11596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":13691067,"num_keys_recovered":116,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"111'298","reported_seq":3411,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.797414+0000","last_change":"2024-09-22T01:34:50.527581+0000","last_active":"2024-09-22T01:36:41.797414+0000","last_peered":"2024-09-22T01:36:41.797414+0000","last_clean":"2024-09-22T01:36:41.797414+0000","last_became_active":"2024-09-22T01:34:48.539769+0000","last_became_peered":"2024-09-22T01:34:48.539769+0000","last_unstale":"2024-09-22T01:36:41.797414+0000","last_undegraded":"2024-09-22T01:36:41.797414+0000","last_fullsized":"2024-09-22T01:36:41.797414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:16:58.508635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088464700000000002,"stat_sum":{"num_bytes":53768378,"num_objects":61,"num_object_clones":20,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":17,"num_read":3559,"num_read_kb":36891,"num_write":353,"num_write_kb":23401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"111'691","reported_seq":8671,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.617530+0000","last_change":"2024-09-22T01:34:50.534647+0000","last_active":"2024-09-22T01:36:41.617530+0000","last_peered":"2024-09-22T01:36:41.617530+0000","last_clean":"2024-09-22T01:36:41.617530+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:36:41.617530+0000","last_undegraded":"2024-09-22T01:36:41.617530+0000","last_fullsized":"2024-09-22T01:36:41.617530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:29.181015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039451500000000001,"stat_sum":{"num_bytes":101356378,"num_objects":55,"num_object_clones":20,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":12,"num_read":10148,"num_read_kb":61036,"num_write":1003,"num_write_kb":20389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"111'309","reported_seq":1494,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.823424+0000","last_change":"2024-09-22T01:36:03.611788+0000","last_active":"2024-09-22T01:36:41.823424+0000","last_peered":"2024-09-22T01:36:41.823424+0000","last_clean":"2024-09-22T01:36:41.823424+0000","last_became_active":"2024-09-22T01:36:03.522736+0000","last_became_peered":"2024-09-22T01:36:03.522736+0000","last_unstale":"2024-09-22T01:36:41.823424+0000","last_undegraded":"2024-09-22T01:36:41.823424+0000","last_fullsized":"2024-09-22T01:36:41.823424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:06.974128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133074,"stat_sum":{"num_bytes":70741460,"num_objects":33,"num_object_clones":11,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":10,"num_read":1768,"num_read_kb":10870,"num_write":431,"num_write_kb":4459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1215906,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"111'347","reported_seq":4137,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.516379+0000","last_change":"2024-09-22T01:36:06.627125+0000","last_active":"2024-09-22T01:36:41.516379+0000","last_peered":"2024-09-22T01:36:41.516379+0000","last_clean":"2024-09-22T01:36:41.516379+0000","last_became_active":"2024-09-22T01:36:06.623688+0000","last_became_peered":"2024-09-22T01:36:06.623688+0000","last_unstale":"2024-09-22T01:36:41.516379+0000","last_undegraded":"2024-09-22T01:36:41.516379+0000","last_fullsized":"2024-09-22T01:36:41.516379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:48:19.081692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015742040000000001,"stat_sum":{"num_bytes":48497162,"num_objects":55,"num_object_clones":19,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":18,"num_read":4771,"num_read_kb":24192,"num_write":365,"num_write_kb":29878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":9440366,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"111'469","reported_seq":12998,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.828278+0000","last_change":"2024-09-22T01:36:00.567710+0000","last_active":"2024-09-22T01:36:41.828278+0000","last_peered":"2024-09-22T01:36:41.828278+0000","last_clean":"2024-09-22T01:36:41.828278+0000","last_became_active":"2024-09-22T01:36:00.566214+0000","last_became_peered":"2024-09-22T01:36:00.566214+0000","last_unstale":"2024-09-22T01:36:41.828278+0000","last_undegraded":"2024-09-22T01:36:41.828278+0000","last_fullsized":"2024-09-22T01:36:41.828278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:56:05.131329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000879137,"stat_sum":{"num_bytes":84508840,"num_objects":67,"num_object_clones":26,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":21,"num_read":13179,"num_read_kb":28642,"num_write":530,"num_write_kb":9188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":10027868,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"111'180","reported_seq":4301,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.666707+0000","last_change":"2024-09-22T01:36:00.575390+0000","last_active":"2024-09-22T01:36:41.666707+0000","last_peered":"2024-09-22T01:36:41.666707+0000","last_clean":"2024-09-22T01:36:41.666707+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:36:41.666707+0000","last_undegraded":"2024-09-22T01:36:41.666707+0000","last_fullsized":"2024-09-22T01:36:41.666707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:46:07.065956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016832139999999999,"stat_sum":{"num_bytes":59376985,"num_objects":46,"num_object_clones":19,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":17,"num_read":3801,"num_read_kb":30601,"num_write":160,"num_write_kb":7087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"111'255","reported_seq":5316,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.516499+0000","last_change":"2024-09-22T01:36:00.566907+0000","last_active":"2024-09-22T01:36:41.516499+0000","last_peered":"2024-09-22T01:36:41.516499+0000","last_clean":"2024-09-22T01:36:41.516499+0000","last_became_active":"2024-09-22T01:36:00.564509+0000","last_became_peered":"2024-09-22T01:36:00.564509+0000","last_unstale":"2024-09-22T01:36:41.516499+0000","last_undegraded":"2024-09-22T01:36:41.516499+0000","last_fullsized":"2024-09-22T01:36:41.516499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:19:14.820011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092607900000000001,"stat_sum":{"num_bytes":47594459,"num_objects":46,"num_object_clones":15,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":10,"num_read":5634,"num_read_kb":47016,"num_write":233,"num_write_kb":16110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":5198452,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":211,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:39.852448+0000","last_change":"2024-09-22T01:35:57.529367+0000","last_active":"2024-09-22T01:36:39.852448+0000","last_peered":"2024-09-22T01:36:39.852448+0000","last_clean":"2024-09-22T01:36:39.852448+0000","last_became_active":"2024-09-22T01:35:57.528484+0000","last_became_peered":"2024-09-22T01:35:57.528484+0000","last_unstale":"2024-09-22T01:36:39.852448+0000","last_undegraded":"2024-09-22T01:36:39.852448+0000","last_fullsized":"2024-09-22T01:36:39.852448+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:00.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"111'249","reported_seq":3663,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.546368+0000","last_change":"2024-09-22T01:36:06.619666+0000","last_active":"2024-09-22T01:36:41.546368+0000","last_peered":"2024-09-22T01:36:41.546368+0000","last_clean":"2024-09-22T01:36:41.546368+0000","last_became_active":"2024-09-22T01:36:06.618495+0000","last_became_peered":"2024-09-22T01:36:06.618495+0000","last_unstale":"2024-09-22T01:36:41.546368+0000","last_undegraded":"2024-09-22T01:36:41.546368+0000","last_fullsized":"2024-09-22T01:36:41.546368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:24:17.843024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014179189999999999,"stat_sum":{"num_bytes":82032930,"num_objects":59,"num_object_clones":22,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":23,"num_read":3370,"num_read_kb":25203,"num_write":222,"num_write_kb":31477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":25063433,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":201,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:39.846618+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:36:39.846618+0000","last_peered":"2024-09-22T01:36:39.846618+0000","last_clean":"2024-09-22T01:36:39.846618+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:36:39.846618+0000","last_undegraded":"2024-09-22T01:36:39.846618+0000","last_fullsized":"2024-09-22T01:36:39.846618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"111'212","reported_seq":2282,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.676598+0000","last_change":"2024-09-22T01:36:00.568511+0000","last_active":"2024-09-22T01:36:41.676598+0000","last_peered":"2024-09-22T01:36:41.676598+0000","last_clean":"2024-09-22T01:36:41.676598+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:36:41.676598+0000","last_undegraded":"2024-09-22T01:36:41.676598+0000","last_fullsized":"2024-09-22T01:36:41.676598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:54:07.484044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001738353,"stat_sum":{"num_bytes":31237183,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":2455,"num_read_kb":17503,"num_write":227,"num_write_kb":5594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:39.858926+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:36:39.858926+0000","last_peered":"2024-09-22T01:36:39.858926+0000","last_clean":"2024-09-22T01:36:39.858926+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:36:39.858926+0000","last_undegraded":"2024-09-22T01:36:39.858926+0000","last_fullsized":"2024-09-22T01:36:39.858926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"111'390","reported_seq":2992,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.582865+0000","last_change":"2024-09-22T01:36:12.662809+0000","last_active":"2024-09-22T01:36:41.582865+0000","last_peered":"2024-09-22T01:36:41.582865+0000","last_clean":"2024-09-22T01:36:41.582865+0000","last_became_active":"2024-09-22T01:36:12.660207+0000","last_became_peered":"2024-09-22T01:36:12.660207+0000","last_unstale":"2024-09-22T01:36:41.582865+0000","last_undegraded":"2024-09-22T01:36:41.582865+0000","last_fullsized":"2024-09-22T01:36:41.582865+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:56:52.696797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078463999999999997,"stat_sum":{"num_bytes":75749775,"num_objects":47,"num_object_clones":14,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":4100,"num_read_kb":35112,"num_write":440,"num_write_kb":9944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:40.038273+0000","last_change":"2024-09-22T01:36:03.520390+0000","last_active":"2024-09-22T01:36:40.038273+0000","last_peered":"2024-09-22T01:36:40.038273+0000","last_clean":"2024-09-22T01:36:40.038273+0000","last_became_active":"2024-09-22T01:36:03.519493+0000","last_became_peered":"2024-09-22T01:36:03.519493+0000","last_unstale":"2024-09-22T01:36:40.038273+0000","last_undegraded":"2024-09-22T01:36:40.038273+0000","last_fullsized":"2024-09-22T01:36:40.038273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:25:49.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"111'317","reported_seq":6254,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.817095+0000","last_change":"2024-09-22T01:34:50.542664+0000","last_active":"2024-09-22T01:36:41.817095+0000","last_peered":"2024-09-22T01:36:41.817095+0000","last_clean":"2024-09-22T01:36:41.817095+0000","last_became_active":"2024-09-22T01:34:48.544812+0000","last_became_peered":"2024-09-22T01:34:48.544812+0000","last_unstale":"2024-09-22T01:36:41.817095+0000","last_undegraded":"2024-09-22T01:36:41.817095+0000","last_fullsized":"2024-09-22T01:36:41.817095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":317,"log_dups_size":0,"ondisk_log_size":317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:36:22.054155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032535960000000001,"stat_sum":{"num_bytes":104956888,"num_objects":46,"num_object_clones":14,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":12,"num_read":6979,"num_read_kb":44935,"num_write":354,"num_write_kb":14232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'147","reported_seq":580,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.365090+0000","last_change":"2024-09-22T01:36:07.624756+0000","last_active":"2024-09-22T01:36:41.365090+0000","last_peered":"2024-09-22T01:36:41.365090+0000","last_clean":"2024-09-22T01:36:41.365090+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:36:41.365090+0000","last_undegraded":"2024-09-22T01:36:41.365090+0000","last_fullsized":"2024-09-22T01:36:41.365090+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:53:28.315179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010842180000000001,"stat_sum":{"num_bytes":12042956,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":13,"num_read":862,"num_read_kb":4906,"num_write":138,"num_write_kb":2196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":203,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:39.881602+0000","last_change":"2024-09-22T01:34:40.376225+0000","last_active":"2024-09-22T01:36:39.881602+0000","last_peered":"2024-09-22T01:36:39.881602+0000","last_clean":"2024-09-22T01:36:39.881602+0000","last_became_active":"2024-09-22T01:34:38.360269+0000","last_became_peered":"2024-09-22T01:34:38.360269+0000","last_unstale":"2024-09-22T01:36:39.881602+0000","last_undegraded":"2024-09-22T01:36:39.881602+0000","last_fullsized":"2024-09-22T01:36:39.881602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:12:20.227363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023923949999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"108'283","reported_seq":2267,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:39.855941+0000","last_change":"2024-09-22T01:36:39.854817+0000","last_active":"2024-09-22T01:36:39.855941+0000","last_peered":"2024-09-22T01:36:39.855941+0000","last_clean":"2024-09-22T01:36:39.855941+0000","last_became_active":"2024-09-22T01:36:39.852969+0000","last_became_peered":"2024-09-22T01:36:39.852969+0000","last_unstale":"2024-09-22T01:36:39.855941+0000","last_undegraded":"2024-09-22T01:36:39.855941+0000","last_fullsized":"2024-09-22T01:36:39.855941+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:54:32.708607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050027299999999997,"stat_sum":{"num_bytes":43145106,"num_objects":39,"num_object_clones":13,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":14,"num_read":2391,"num_read_kb":11248,"num_write":346,"num_write_kb":22182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:39.850991+0000","last_change":"2024-09-22T01:36:09.627096+0000","last_active":"2024-09-22T01:36:39.850991+0000","last_peered":"2024-09-22T01:36:39.850991+0000","last_clean":"2024-09-22T01:36:39.850991+0000","last_became_active":"2024-09-22T01:36:09.626669+0000","last_became_peered":"2024-09-22T01:36:09.626669+0000","last_unstale":"2024-09-22T01:36:39.850991+0000","last_undegraded":"2024-09-22T01:36:39.850991+0000","last_fullsized":"2024-09-22T01:36:39.850991+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:35.787005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"111'381","reported_seq":2096,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.521609+0000","last_change":"2024-09-22T01:36:07.626478+0000","last_active":"2024-09-22T01:36:41.521609+0000","last_peered":"2024-09-22T01:36:41.521609+0000","last_clean":"2024-09-22T01:36:41.521609+0000","last_became_active":"2024-09-22T01:36:07.624550+0000","last_became_peered":"2024-09-22T01:36:07.624550+0000","last_unstale":"2024-09-22T01:36:41.521609+0000","last_undegraded":"2024-09-22T01:36:41.521609+0000","last_fullsized":"2024-09-22T01:36:41.521609+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:44:44.174144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00150643,"stat_sum":{"num_bytes":37204509,"num_objects":46,"num_object_clones":13,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":16,"num_read":3316,"num_read_kb":19008,"num_write":433,"num_write_kb":7831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":4737369,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:39.858630+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:36:39.858630+0000","last_peered":"2024-09-22T01:36:39.858630+0000","last_clean":"2024-09-22T01:36:39.858630+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:36:39.858630+0000","last_undegraded":"2024-09-22T01:36:39.858630+0000","last_fullsized":"2024-09-22T01:36:39.858630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"111'217","reported_seq":1075,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.579816+0000","last_change":"2024-09-22T01:34:50.527359+0000","last_active":"2024-09-22T01:36:41.579816+0000","last_peered":"2024-09-22T01:36:41.579816+0000","last_clean":"2024-09-22T01:36:41.579816+0000","last_became_active":"2024-09-22T01:34:48.535726+0000","last_became_peered":"2024-09-22T01:34:48.535726+0000","last_unstale":"2024-09-22T01:36:41.579816+0000","last_undegraded":"2024-09-22T01:36:41.579816+0000","last_fullsized":"2024-09-22T01:36:41.579816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:44:45.288149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075466699999999999,"stat_sum":{"num_bytes":26642350,"num_objects":47,"num_object_clones":14,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":16,"num_read":1295,"num_read_kb":8871,"num_write":213,"num_write_kb":4948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":238,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:39.881604+0000","last_change":"2024-09-22T01:36:09.635008+0000","last_active":"2024-09-22T01:36:39.881604+0000","last_peered":"2024-09-22T01:36:39.881604+0000","last_clean":"2024-09-22T01:36:39.881604+0000","last_became_active":"2024-09-22T01:36:09.630836+0000","last_became_peered":"2024-09-22T01:36:09.630836+0000","last_unstale":"2024-09-22T01:36:39.881604+0000","last_undegraded":"2024-09-22T01:36:39.881604+0000","last_fullsized":"2024-09-22T01:36:39.881604+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:55:23.262665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":330,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:39.858742+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:36:39.858742+0000","last_peered":"2024-09-22T01:36:39.858742+0000","last_clean":"2024-09-22T01:36:39.858742+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:36:39.858742+0000","last_undegraded":"2024-09-22T01:36:39.858742+0000","last_fullsized":"2024-09-22T01:36:39.858742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"111'545","reported_seq":1748,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.731728+0000","last_change":"2024-09-22T01:36:36.824540+0000","last_active":"2024-09-22T01:36:41.731728+0000","last_peered":"2024-09-22T01:36:41.731728+0000","last_clean":"2024-09-22T01:36:41.731728+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:36:41.731728+0000","last_undegraded":"2024-09-22T01:36:41.731728+0000","last_fullsized":"2024-09-22T01:36:41.731728+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:31:00.665140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001463764,"stat_sum":{"num_bytes":71176780,"num_objects":49,"num_object_clones":17,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":6640,"num_read_kb":50781,"num_write":759,"num_write_kb":24754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"111'334","reported_seq":4567,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.542732+0000","last_change":"2024-09-22T01:36:12.659736+0000","last_active":"2024-09-22T01:36:41.542732+0000","last_peered":"2024-09-22T01:36:41.542732+0000","last_clean":"2024-09-22T01:36:41.542732+0000","last_became_active":"2024-09-22T01:36:12.658535+0000","last_became_peered":"2024-09-22T01:36:12.658535+0000","last_unstale":"2024-09-22T01:36:41.542732+0000","last_undegraded":"2024-09-22T01:36:41.542732+0000","last_fullsized":"2024-09-22T01:36:41.542732+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:28:41.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093062799999999997,"stat_sum":{"num_bytes":87460292,"num_objects":48,"num_object_clones":17,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":3928,"num_read_kb":52164,"num_write":355,"num_write_kb":17242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2982858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"111'351","reported_seq":12845,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.357811+0000","last_change":"2024-09-22T01:34:50.552879+0000","last_active":"2024-09-22T01:36:41.357811+0000","last_peered":"2024-09-22T01:36:41.357811+0000","last_clean":"2024-09-22T01:36:41.357811+0000","last_became_active":"2024-09-22T01:34:48.551682+0000","last_became_peered":"2024-09-22T01:34:48.551682+0000","last_unstale":"2024-09-22T01:36:41.357811+0000","last_undegraded":"2024-09-22T01:36:41.357811+0000","last_fullsized":"2024-09-22T01:36:41.357811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:36:31.469941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013073900000000001,"stat_sum":{"num_bytes":94270616,"num_objects":50,"num_object_clones":16,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":16,"num_read":14265,"num_read_kb":17371,"num_write":377,"num_write_kb":16299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"111'253","reported_seq":1812,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.214178+0000","last_change":"2024-09-22T01:36:07.624543+0000","last_active":"2024-09-22T01:36:41.214178+0000","last_peered":"2024-09-22T01:36:41.214178+0000","last_clean":"2024-09-22T01:36:41.214178+0000","last_became_active":"2024-09-22T01:36:07.622932+0000","last_became_peered":"2024-09-22T01:36:07.622932+0000","last_unstale":"2024-09-22T01:36:41.214178+0000","last_undegraded":"2024-09-22T01:36:41.214178+0000","last_fullsized":"2024-09-22T01:36:41.214178+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:15.540962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000665578,"stat_sum":{"num_bytes":25126874,"num_objects":34,"num_object_clones":10,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":2017,"num_read_kb":12647,"num_write":301,"num_write_kb":8427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":4742308,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"111'371","reported_seq":3832,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.249329+0000","last_change":"2024-09-22T01:34:50.541507+0000","last_active":"2024-09-22T01:36:41.249329+0000","last_peered":"2024-09-22T01:36:41.249329+0000","last_clean":"2024-09-22T01:36:41.249329+0000","last_became_active":"2024-09-22T01:34:48.544792+0000","last_became_peered":"2024-09-22T01:34:48.544792+0000","last_unstale":"2024-09-22T01:36:41.249329+0000","last_undegraded":"2024-09-22T01:36:41.249329+0000","last_fullsized":"2024-09-22T01:36:41.249329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:00:35.942574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002331039,"stat_sum":{"num_bytes":80756320,"num_objects":53,"num_object_clones":18,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":17,"num_read":4486,"num_read_kb":29107,"num_write":383,"num_write_kb":13232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"111'341","reported_seq":2918,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.697436+0000","last_change":"2024-09-22T01:36:00.573813+0000","last_active":"2024-09-22T01:36:41.697436+0000","last_peered":"2024-09-22T01:36:41.697436+0000","last_clean":"2024-09-22T01:36:41.697436+0000","last_became_active":"2024-09-22T01:36:00.571500+0000","last_became_peered":"2024-09-22T01:36:00.571500+0000","last_unstale":"2024-09-22T01:36:41.697436+0000","last_undegraded":"2024-09-22T01:36:41.697436+0000","last_fullsized":"2024-09-22T01:36:41.697436+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:58:06.118053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015841550000000001,"stat_sum":{"num_bytes":72623219,"num_objects":48,"num_object_clones":18,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":14,"num_read":4160,"num_read_kb":12536,"num_write":430,"num_write_kb":12683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":3937469,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"111'563","reported_seq":2996,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.758828+0000","last_change":"2024-09-22T01:36:00.569408+0000","last_active":"2024-09-22T01:36:41.758828+0000","last_peered":"2024-09-22T01:36:41.758828+0000","last_clean":"2024-09-22T01:36:41.758828+0000","last_became_active":"2024-09-22T01:36:00.566088+0000","last_became_peered":"2024-09-22T01:36:00.566088+0000","last_unstale":"2024-09-22T01:36:41.758828+0000","last_undegraded":"2024-09-22T01:36:41.758828+0000","last_fullsized":"2024-09-22T01:36:41.758828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:19:27.896560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016331309999999999,"stat_sum":{"num_bytes":35476353,"num_objects":53,"num_object_clones":17,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":19,"num_read":3850,"num_read_kb":13431,"num_write":776,"num_write_kb":11015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":4264442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"111'458","reported_seq":2349,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.249651+0000","last_change":"2024-09-22T01:36:01.570787+0000","last_active":"2024-09-22T01:36:41.249651+0000","last_peered":"2024-09-22T01:36:41.249651+0000","last_clean":"2024-09-22T01:36:41.249651+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:36:41.249651+0000","last_undegraded":"2024-09-22T01:36:41.249651+0000","last_fullsized":"2024-09-22T01:36:41.249651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:37:12.544164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010627220000000001,"stat_sum":{"num_bytes":106976701,"num_objects":45,"num_object_clones":14,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":10,"num_read":4069,"num_read_kb":22887,"num_write":626,"num_write_kb":20215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"111'423","reported_seq":1885,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.368745+0000","last_change":"2024-09-22T01:36:06.621453+0000","last_active":"2024-09-22T01:36:41.368745+0000","last_peered":"2024-09-22T01:36:41.368745+0000","last_clean":"2024-09-22T01:36:41.368745+0000","last_became_active":"2024-09-22T01:36:06.619734+0000","last_became_peered":"2024-09-22T01:36:06.619734+0000","last_unstale":"2024-09-22T01:36:41.368745+0000","last_undegraded":"2024-09-22T01:36:41.368745+0000","last_fullsized":"2024-09-22T01:36:41.368745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:26:57.032890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000712264,"stat_sum":{"num_bytes":50340982,"num_objects":43,"num_object_clones":12,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":14,"num_read":3394,"num_read_kb":11803,"num_write":511,"num_write_kb":15098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":4400829,"num_keys_recovered":58,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"111'251","reported_seq":4157,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.142987+0000","last_change":"2024-09-22T01:36:01.564545+0000","last_active":"2024-09-22T01:36:41.142987+0000","last_peered":"2024-09-22T01:36:41.142987+0000","last_clean":"2024-09-22T01:36:41.142987+0000","last_became_active":"2024-09-22T01:36:01.562260+0000","last_became_peered":"2024-09-22T01:36:01.562260+0000","last_unstale":"2024-09-22T01:36:41.142987+0000","last_undegraded":"2024-09-22T01:36:41.142987+0000","last_fullsized":"2024-09-22T01:36:41.142987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:35.008239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002148418,"stat_sum":{"num_bytes":62272817,"num_objects":55,"num_object_clones":18,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":16,"num_read":3660,"num_read_kb":39663,"num_write":232,"num_write_kb":18734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"111'289","reported_seq":4051,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.681883+0000","last_change":"2024-09-22T01:36:07.627824+0000","last_active":"2024-09-22T01:36:41.681883+0000","last_peered":"2024-09-22T01:36:41.681883+0000","last_clean":"2024-09-22T01:36:41.681883+0000","last_became_active":"2024-09-22T01:36:07.626370+0000","last_became_peered":"2024-09-22T01:36:07.626370+0000","last_unstale":"2024-09-22T01:36:41.681883+0000","last_undegraded":"2024-09-22T01:36:41.681883+0000","last_fullsized":"2024-09-22T01:36:41.681883+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:26.966781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086911499999999995,"stat_sum":{"num_bytes":15505074,"num_objects":26,"num_object_clones":9,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":10,"num_read":4533,"num_read_kb":13646,"num_write":350,"num_write_kb":6831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":5846025,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"111'254","reported_seq":7778,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-22T01:36:41.617632+0000","last_change":"2024-09-22T01:36:01.568141+0000","last_active":"2024-09-22T01:36:41.617632+0000","last_peered":"2024-09-22T01:36:41.617632+0000","last_clean":"2024-09-22T01:36:41.617632+0000","last_became_active":"2024-09-22T01:36:01.565891+0000","last_became_peered":"2024-09-22T01:36:01.565891+0000","last_unstale":"2024-09-22T01:36:41.617632+0000","last_undegraded":"2024-09-22T01:36:41.617632+0000","last_fullsized":"2024-09-22T01:36:41.617632+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:05:43.708614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095816200000000003,"stat_sum":{"num_bytes":53910194,"num_objects":37,"num_object_clones":12,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":7825,"num_read_kb":34166,"num_write":235,"num_write_kb":5092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":5871820,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1902794189,"num_objects":1456,"num_object_clones":482,"num_object_copies":2912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1456,"num_whiteouts":443,"num_read":152012,"num_read_kb":865214,"num_write":13962,"num_write_kb":450665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2274,"num_bytes_recovered":167831484,"num_keys_recovered":442,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":559783936,"data_stored":708428242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11453,"ondisk_log_size":11453,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120904,"kb_used_data":71672,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94250936,"statfs":{"total":96636764160,"available":96512958464,"internally_reserved":0,"allocated":73392128,"data_stored":93234110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64508,"kb_used_data":29160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94307332,"statfs":{"total":96636764160,"available":96570707968,"internally_reserved":0,"allocated":29859840,"data_stored":38070008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116220,"kb_used_data":76716,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94255620,"statfs":{"total":96636764160,"available":96517754880,"internally_reserved":0,"allocated":78557184,"data_stored":97868724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163932,"kb_used_data":114632,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94207908,"statfs":{"total":96636764160,"available":96468897792,"internally_reserved":0,"allocated":117383168,"data_stored":144652642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130396,"kb_used_data":99212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94241444,"statfs":{"total":96636764160,"available":96503238656,"internally_reserved":0,"allocated":101593088,"data_stored":122036519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58152,"kb_used_data":18644,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94313688,"statfs":{"total":96636764160,"available":96577216512,"internally_reserved":0,"allocated":19091456,"data_stored":24924549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108340,"kb_used_data":81308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94263500,"statfs":{"total":96636764160,"available":96525824000,"internally_reserved":0,"allocated":83259392,"data_stored":102772051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96412,"kb_used_data":65228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94275428,"statfs":{"total":96636764160,"available":96538038272,"internally_reserved":0,"allocated":66793472,"data_stored":89417562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65597440,"data_stored":88924660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82128896,"data_stored":102345217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17768448,"data_stored":24301126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":100282368,"data_stored":121422345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":116109312,"data_stored":144072326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77230080,"data_stored":97245282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28991488,"data_stored":37903867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71675904,"data_stored":92213419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:36:44.778 INFO:tasks.thrashosds.thrasher:Setting 3.b to [3, 2] 2024-09-22T01:36:44.778 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.b', '3', '2'] 2024-09-22T01:36:44.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.b 3 2 2024-09-22T01:36:44.822 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:44.818+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:44.886 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:36:44.923 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:44.918+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:44.946 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:44.946 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:44.946 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:44.946 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:44.946 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:44.964 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:44.997 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone40 from 0xa0934e6 (overlap 0x27b13fc) to 0x0 2024-09-22T01:36:45.044 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:45.040+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:45.125 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:45.118+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:45.127 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.662734438000001, 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:36:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:36:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.662660028000005, 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:36:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.662603497000006, 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:36:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:36:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:36:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.662545902999994, 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.662488565000004, 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:36:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.662431123999994, 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.662395215000004, 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:36:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:36:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:36:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.657351516999995, 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:36:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.657288076, 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.657232839000002, 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.657159524999997, 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:36:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.657105443999995, 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:36:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.657051006000003, 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 96.656995144999996, 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:36:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:36:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93498 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.556828387000003, 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93801259999999997, 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93498 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576580+0000", 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8600000000000003e-06 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576600+0000", 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9746e-05 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576650+0000", 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0419e-05 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576678+0000", 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7858999999999999e-05 2024-09-22T01:36:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580737+0000", 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040585939999999996 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580754+0000", 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7102e-05 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514561+0000", 2024-09-22T01:36:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93380681700000001 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514589+0000", 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8203000000000001e-05 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93499 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.553962673999997, 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93524844100000004, 2024-09-22T01:36:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93499 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579444+0000", 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2369999999999999e-06 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579455+0000", 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0655e-05 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579486+0000", 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1473999999999997e-05 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579506+0000", 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9513000000000001e-05 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581124+0000", 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016177050000000001 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581135+0000", 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1534e-05 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514663+0000", 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93352768399999997 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514691+0000", 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7639000000000001e-05 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94339 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch reconnect cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.511585441999998, 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0158427670000001, 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94339 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621821+0000", 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.55e-06 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621827+0000", 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1299999999999998e-06 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621843+0000", 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5542000000000001e-05 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621853+0000", 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0445000000000001e-05 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621924+0000", 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1262999999999999e-05 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621936+0000", 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.131e-05 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625444+0000", 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0035085479999999 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625845+0000", 2024-09-22T01:36:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040067999999999999 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.637662+0000", 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011817299 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94342 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [notify cookie 140215384087984] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.497415273000001, 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99234641400000001, 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94342 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635992+0000", 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.12e-06 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636002+0000", 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636032+0000", 2024-09-22T01:36:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0463e-05 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636053+0000", 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1002999999999999e-05 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636187+0000", 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013359299999999999 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636206+0000", 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9327e-05 2024-09-22T01:36:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627756+0000", 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99154943799999995 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627997+0000", 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024163200000000001 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628336+0000", 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033850200000000002 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94343 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch ping cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.425247407000001, 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92041710600000004, 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94343 2024-09-22T01:36:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708160+0000", 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8559999999999998e-06 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708178+0000", 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.73e-05 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708212+0000", 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4573000000000003e-05 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708238+0000", 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5792e-05 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708344+0000", 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106508 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708357+0000", 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2183e-05 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628387+0000", 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92003072600000002 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628449+0000", 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1828000000000005e-05 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628574+0000", 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012533999999999999 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:95531 3.8 3:11293fc5:::rbd_object_map.110f30608ae1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e89)", 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 33.486238053000001, 2024-09-22T01:36:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.012680681, 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 95531 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647169+0000", 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9649999999999998e-06 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647177+0000", 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0439999999999996e-06 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647196+0000", 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9400000000000001e-05 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647204+0000", 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647266+0000", 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2117000000000002e-05 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:36:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647275+0000", 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0679999999999997e-06 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651032+0000", 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037574980000000002 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651044+0000", 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-05 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659538+0000", 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0084937460000001 2024-09-22T01:36:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659847+0000", 2024-09-22T01:36:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000309587 2024-09-22T01:36:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.217 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:45.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:45.225 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:45.218+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:45.317 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:45.326 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:45.320+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:45.346 INFO:teuthology.orchestra.run.smithi018.stdout:5282 write 0xea2110f thru 0xea2f2ab (0xe19d bytes) 2024-09-22T01:36:45.372 INFO:teuthology.orchestra.run.smithi018.stdout:5284 write 0xbfd7e7a thru 0xbfe5f58 (0xe0df bytes) 2024-09-22T01:36:45.378 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:45.379 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:45.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:45.401 INFO:teuthology.orchestra.run.smithi018.stdout:5286 trunc from 0xea2f2ac to 0xbc6d899 2024-09-22T01:36:45.431 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:45.431 INFO:teuthology.orchestra.run.smithi018.stdout:5288 punch from 0x611cdf to 0x613a7d, (0x1d9e bytes) 2024-09-22T01:36:45.431 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:45.424+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:45.432 INFO:teuthology.orchestra.run.smithi018.stdout:5290 writesame 0x9f42d thru 0xaa2c6 data_size 0x1(0xae9a bytes) 2024-09-22T01:36:45.528 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:45.522+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:45.574 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:45.574 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:45.574 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:45.585 INFO:teuthology.orchestra.run.smithi018.stdout:5291 writesame 0x794966b thru 0x7956008 data_size 0x83(0xc99e bytes) 2024-09-22T01:36:45.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:45.629 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:45.622+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:45.643 INFO:teuthology.orchestra.run.smithi018.stdout:5292 read 0x442c52f thru 0x443b91e (0xf3f0 bytes) 2024-09-22T01:36:45.644 INFO:teuthology.orchestra.run.smithi018.stdout:5293 write 0xba366ed thru 0xba45c7c (0xf590 bytes) 2024-09-22T01:36:45.655 INFO:teuthology.orchestra.run.smithi018.stdout:5294 write 0x116fea1 thru 0x1172ebf (0x301f bytes) 2024-09-22T01:36:45.727 INFO:teuthology.orchestra.run.smithi018.stdout:5295 write 0x9e9bcc0 thru 0x9ea1268 (0x55a9 bytes) 2024-09-22T01:36:45.730 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:45.724+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:45.760 INFO:teuthology.orchestra.run.smithi018.stdout:5296 read 0x55d8104 thru 0x55dc586 (0x4483 bytes) 2024-09-22T01:36:45.760 INFO:teuthology.orchestra.run.smithi018.stdout:5297 writesame 0x7d0f5b1 thru 0x7d1de87 data_size 0x1(0xe8d7 bytes) 2024-09-22T01:36:45.783 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.981530179999993, 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.981475004000004, 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:36:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:36:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.981409890999998, 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:36:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:36:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.981344144000005, 2024-09-22T01:36:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:36:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:36:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:36:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.981306673999995, 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:36:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.981256058, 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:36:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:36:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:36:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.980070718999997, 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:36:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.980008892000001, 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:36:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:36:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979960093000003, 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:36:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979886539999995, 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:36:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979816077999999, 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:36:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979745574999995, 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:36:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979698342999995, 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979635466999994, 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979594801000005, 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979499934000003, 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979458897000001, 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:36:45.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979421406, 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:36:45.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979381257, 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:36:45.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:36:45.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:36:45.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:36:45.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:45.889 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 76.979338462000001, 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:36:45.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:36:45.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:36:45.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.894 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:45.895 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:45.895 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:45.895 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:45.896 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:45.897 INFO:teuthology.orchestra.run.smithi018.stdout:5298 write 0xda8914a thru 0xda95967 (0xc81e bytes) 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:5300 read 0x9e80fa1 thru 0x9e8aa8f (0x9aef bytes) 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:5301 writesame 0x92ad8ec thru 0x92b5c81 data_size 0x1(0x8396 bytes) 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:5302 write 0xafc1fee thru 0xafc8bde (0x6bf1 bytes) 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:5303 punch from 0x61752d0 to 0x617bc77, (0x69a7 bytes) 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:5304 read 0x50eb1a1 thru 0x50ec4d2 (0x1332 bytes) 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:5305 punch from 0x3a261bf to 0x3a2c64c, (0x648d bytes) 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:5308 read 0x5db38b1 thru 0x5dba4c1 (0x6c11 bytes) 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:5310 punch from 0x93139e8 to 0x9316fbe, (0x35d6 bytes) 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:5311 trunc from 0xda95968 to 0xe9995f2 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:45.898 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:45.899 INFO:teuthology.orchestra.run.smithi018.stdout:5316 punch from 0x8a56f5c to 0x8a5fd21, (0x8dc5 bytes) 2024-09-22T01:36:45.899 INFO:teuthology.orchestra.run.smithi018.stdout:5317 write 0x23ef38a thru 0x23f4c9e (0x5915 bytes) 2024-09-22T01:36:45.899 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:45.892+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:45.902 INFO:teuthology.orchestra.run.smithi018.stderr:set 3.b pg_upmap mapping to [3,2] 2024-09-22T01:36:45.997 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:45.990+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:46.018 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:46.018 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:46.018 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:46.019 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:46.037 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:46.045 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:46.045 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:46.062 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:46.062 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:46.079 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:46.079 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:46.095 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:46.095 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:46.098 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:46.094+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:46.116 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:46.136 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:46.137 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:46.149 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:46.149 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:46.157 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:46.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:46.179 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:46.179 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:46.199 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:46.194+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:46.290 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:46.291 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:46.299 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:46.292+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:46.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:46.400 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:46.394+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:46.468 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:46.468 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:46.482 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:46.528 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:46.524+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:46.601 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:46.596+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:46.697 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:46.697 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:46.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:46.740 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:46.736+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:46.804 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:46.798+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:46.868 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:46.868 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:46.883 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:46.905 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:46.900+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:46.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:36:47.006 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:47.000+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:47.018 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:47.018 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:47.033 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:47.106 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:47.102+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:47.155 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:47.155 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:47.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:47.207 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:47.200+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:47.308 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:47.302+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:47.332 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:47.333 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:47.346 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:47.409 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:47.404+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:47.510 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:47.506+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:47.513 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:47.513 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:47.527 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:47.618 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:47.614+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:47.695 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:47.696 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:47.709 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:47.712 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:47.708+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:47.813 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:47.808+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:47.874 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:47.874 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:47.888 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:47.918 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:36:47.934 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:47.930+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:47.958 INFO:teuthology.orchestra.run.smithi018.stdout:5318 writesame 0xe12615a thru 0xe12dfa6 data_size 0x1f(0x7e4d bytes) 2024-09-22T01:36:47.969 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:47.969 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:47.969 INFO:teuthology.orchestra.run.smithi018.stdout:5321 write 0x939c171 thru 0x93a6fc9 (0xae59 bytes) 2024-09-22T01:36:48.014 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:48.008+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:48.023 INFO:teuthology.orchestra.run.smithi018.stdout:5323 write 0xecdefb8 thru 0xece1369 (0x23b2 bytes) 2024-09-22T01:36:48.024 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:48.024 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:48.026 INFO:teuthology.orchestra.run.smithi018.stdout:5324 write 0xb1e55ce thru 0xb1edf8f (0x89c2 bytes) 2024-09-22T01:36:48.029 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:48.040 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:48.055 INFO:teuthology.orchestra.run.smithi018.stdout:5326 trunc from 0xece136a to 0x25fa6f4 2024-09-22T01:36:48.130 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:48.126+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:48.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:48.218 INFO:teuthology.orchestra.run.smithi018.stdout:5327 read 0x76a510 thru 0x76e52d (0x401e bytes) 2024-09-22T01:36:48.218 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:48.212+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:48.229 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:48.229 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:48.240 INFO:teuthology.orchestra.run.smithi018.stdout:5328 writesame 0xec946f4 thru 0xec9e181 data_size 0x2(0x9a8e bytes) 2024-09-22T01:36:48.241 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:48.241 INFO:teuthology.orchestra.run.smithi018.stdout:5330 read 0xab7364b thru 0xab73745 (0xfb bytes) 2024-09-22T01:36:48.241 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:48.241 INFO:teuthology.orchestra.run.smithi018.stdout:5333 write 0x1719d24 thru 0x171e960 (0x4c3d bytes) 2024-09-22T01:36:48.245 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:48.316 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:48.312+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:48.325 INFO:teuthology.orchestra.run.smithi018.stdout:5334 trunc from 0xec9e182 to 0x1fad781 2024-09-22T01:36:48.336 INFO:teuthology.orchestra.run.smithi018.stdout:5335 punch from 0x1e9ca07 to 0x1ea3b92, (0x718b bytes) 2024-09-22T01:36:48.347 INFO:teuthology.orchestra.run.smithi018.stdout:5336 trunc from 0x1fad781 to 0xa8a2e80 2024-09-22T01:36:48.364 INFO:teuthology.orchestra.run.smithi018.stdout:5338 trunc from 0xa8a2e80 to 0x3494bf6 2024-09-22T01:36:48.370 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:48.370 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:48.375 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:48.375 INFO:teuthology.orchestra.run.smithi018.stdout:5340 punch from 0x1f7cd51 to 0x1f82108, (0x53b7 bytes) 2024-09-22T01:36:48.375 INFO:teuthology.orchestra.run.smithi018.stdout:5342 read 0x528a79 thru 0x52910c (0x694 bytes) 2024-09-22T01:36:48.392 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:48.392 INFO:teuthology.orchestra.run.smithi018.stdout:5343 writesame 0xa54ab27 thru 0xa54d635 data_size 0x1(0x2b0f bytes) 2024-09-22T01:36:48.398 INFO:teuthology.orchestra.run.smithi018.stdout:5344 write 0xab013a2 thru 0xab06726 (0x5385 bytes) 2024-09-22T01:36:48.406 INFO:teuthology.orchestra.run.smithi018.stdout:5345 read 0xf267cd thru 0xf2a48d (0x3cc1 bytes) 2024-09-22T01:36:48.406 INFO:teuthology.orchestra.run.smithi018.stdout:5346 read 0x891e3ae thru 0x892a643 (0xc296 bytes) 2024-09-22T01:36:48.408 INFO:teuthology.orchestra.run.smithi018.stdout:5347 trunc from 0xab06727 to 0x94e57d1 2024-09-22T01:36:48.410 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:48.417 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:48.412+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:48.418 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:48.418 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:48.422 INFO:teuthology.orchestra.run.smithi018.stdout:5348 read 0x2f09e7e thru 0x2f10fe3 (0x7166 bytes) 2024-09-22T01:36:48.423 INFO:teuthology.orchestra.run.smithi018.stdout:5349 read 0x796a24 thru 0x7a29a4 (0xbf81 bytes) 2024-09-22T01:36:48.424 INFO:teuthology.orchestra.run.smithi018.stdout:5350 read 0x75be9ad thru 0x75cb65c (0xccb0 bytes) 2024-09-22T01:36:48.424 INFO:teuthology.orchestra.run.smithi018.stdout:5351 write 0x1949f64 thru 0x194c9d1 (0x2a6e bytes) 2024-09-22T01:36:48.427 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:48.427 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:48.434 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:48.438 INFO:teuthology.orchestra.run.smithi018.stdout:5352 writesame 0xca05337 thru 0xca08535 data_size 0x1(0x31ff bytes) 2024-09-22T01:36:48.447 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:48.447 INFO:teuthology.orchestra.run.smithi018.stdout:5354 writesame 0xd7efedf thru 0xd7fde14 data_size 0x1(0xdf36 bytes) 2024-09-22T01:36:48.448 INFO:teuthology.orchestra.run.smithi018.stdout:5356 read 0x35b0f7 thru 0x35e652 (0x355c bytes) 2024-09-22T01:36:48.448 INFO:teuthology.orchestra.run.smithi018.stdout:5359 read 0x9d111de thru 0x9d1c2f2 (0xb115 bytes) 2024-09-22T01:36:48.449 INFO:teuthology.orchestra.run.smithi018.stdout:5360 read 0x6b852f5 thru 0x6b8de3d (0x8b49 bytes) 2024-09-22T01:36:48.449 INFO:teuthology.orchestra.run.smithi018.stdout:5363 writesame 0x869d9d4 thru 0x86aaec7 data_size 0x9a(0xd4f4 bytes) 2024-09-22T01:36:48.461 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:48.465 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:48.465 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:48.469 INFO:teuthology.orchestra.run.smithi018.stdout:5366 write 0xe3af581 thru 0xe3be587 (0xf007 bytes) 2024-09-22T01:36:48.484 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:48.486 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:48.486 INFO:teuthology.orchestra.run.smithi018.stdout:5372 writesame 0x5e42d9d thru 0x5e46ad1 data_size 0x3(0x3d35 bytes) 2024-09-22T01:36:48.495 INFO:teuthology.orchestra.run.smithi018.stdout:5373 punch from 0x48c1c4a to 0x48cc4d9, (0xa88f bytes) 2024-09-22T01:36:48.495 INFO:teuthology.orchestra.run.smithi018.stdout:5374 write 0x2876166 thru 0x28821e0 (0xc07b bytes) 2024-09-22T01:36:48.497 INFO:teuthology.orchestra.run.smithi018.stdout:5375 read 0x403d602 thru 0x404b8ba (0xe2b9 bytes) 2024-09-22T01:36:48.498 INFO:teuthology.orchestra.run.smithi018.stdout:5377 write 0x1483189 thru 0x1485fa1 (0x2e19 bytes) 2024-09-22T01:36:48.508 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:48.509 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:48.518 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:48.514+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:48.529 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:48.530 INFO:teuthology.orchestra.run.smithi018.stdout:5382 read 0xccac61f thru 0xccb5163 (0x8b45 bytes) 2024-09-22T01:36:48.530 INFO:teuthology.orchestra.run.smithi018.stdout:5384 read 0x41a374 thru 0x4249ce (0xa65b bytes) 2024-09-22T01:36:48.531 INFO:teuthology.orchestra.run.smithi018.stdout:5387 write 0x266615e thru 0x2671ecd (0xbd70 bytes) 2024-09-22T01:36:48.534 INFO:teuthology.orchestra.run.smithi018.stdout:5388 write 0xcc97fc4 thru 0xcc9bceb (0x3d28 bytes) 2024-09-22T01:36:48.569 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:48.569 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:48.569 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:36:48.569 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:48.583 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:48.630 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:48.626+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:48.719 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:48.714+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:48.752 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:48.752 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:36:48.752 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:36:48.752 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:36:48.752 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:48.766 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:48.820 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:48.812+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:48.921 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:48.914+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:48.937 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:36:48.937 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 135.62727200099999, 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:36:48.938 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:36:48.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:36:48.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.944 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.09649930499999, 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.945 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:36:48.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:36:48.948 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.096272025, 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.949 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.09310374099999, 2024-09-22T01:36:48.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:48.954 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.957 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.093019477, 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.958 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:36:48.959 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.960 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.961 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.092967981, 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.963 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.964 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.965 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.092922661, 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.966 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.967 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:36:48.968 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:36:48.969 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.970 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.089442404, 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.971 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.972 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.973 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.974 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.089137592, 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.975 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.976 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:36:48.977 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.978 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.089088148, 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.979 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:36:48.980 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:36:48.981 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.982 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:48.983 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.089043594, 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.984 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:36:48.985 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:36:48.986 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.987 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.08899994399999, 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:36:48.988 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.989 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.990 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:36:48.991 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.08895272300001, 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.992 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.993 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:36:48.994 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:36:48.995 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.08875771699999, 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:48.996 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:48.997 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:36:48.998 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:36:48.999 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.08870822999999, 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:49.000 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:49.001 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:36:49.002 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.003 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:49.004 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.085557171, 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.005 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.006 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.007 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.008 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.085211543, 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:49.009 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:36:49.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.012 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.08511612, 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:36:49.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:49.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:49.016 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.085063541, 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:36:49.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:36:49.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:36:49.020 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.085021774, 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:36:49.021 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:36:49.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:36:49.025 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.025 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:49.025 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.025 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:36:49.025 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:36:49.025 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:36:49.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:49.027 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:49.020+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:49.128 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:49.122+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:49.161 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:49.161 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:49.161 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:49.161 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:49.175 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:49.229 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:49.224+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:49.295 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:49.296 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:49.296 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:49.296 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:49.296 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:49.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:49.352 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:49.348+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:49.431 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:49.426+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:49.484 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:49.484 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:49.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:49.484 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:49.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.484 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.010125777, 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:49.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.010051367, 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:36:49.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:36:49.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:36:49.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.009994836, 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.493 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:36:49.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.496 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.00993724200001, 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.497 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.009879904, 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.501 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:36:49.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:36:49.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.00982246300001, 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.505 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:36:49.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.009786554, 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.509 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:36:49.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.513 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.00474285599999, 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:49.514 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:36:49.515 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.516 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.004679415, 2024-09-22T01:36:49.517 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:36:49.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.521 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.004624178, 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.524 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.004550864, 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:36:49.525 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:36:49.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:36:49.528 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.529 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.00449678299999, 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.530 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:36:49.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:36:49.532 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.533 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.004442345, 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.534 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.535 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.536 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.537 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:49.538 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 101.00438648399999, 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.539 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:36:49.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:36:49.542 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93498 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.904219726000001, 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93801259999999997, 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93498 2024-09-22T01:36:49.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576580+0000", 2024-09-22T01:36:49.544 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8600000000000003e-06 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576600+0000", 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9746e-05 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576650+0000", 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0419e-05 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576678+0000", 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7858999999999999e-05 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580737+0000", 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040585939999999996 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580754+0000", 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7102e-05 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514561+0000", 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93380681700000001 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514589+0000", 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8203000000000001e-05 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93499 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.901354013000002, 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93524844100000004, 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.547 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93499 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.548 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579444+0000", 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2369999999999999e-06 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579455+0000", 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0655e-05 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579486+0000", 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1473999999999997e-05 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.549 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579506+0000", 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9513000000000001e-05 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581124+0000", 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016177050000000001 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581135+0000", 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1534e-05 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.550 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514663+0000", 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93352768399999997 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514691+0000", 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7639000000000001e-05 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94339 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch reconnect cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:49.551 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.858976781000003, 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0158427670000001, 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94339 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.552 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621821+0000", 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.55e-06 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621827+0000", 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1299999999999998e-06 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621843+0000", 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5542000000000001e-05 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621853+0000", 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0445000000000001e-05 2024-09-22T01:36:49.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621924+0000", 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1262999999999999e-05 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621936+0000", 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.131e-05 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625444+0000", 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0035085479999999 2024-09-22T01:36:49.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625845+0000", 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040067999999999999 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.637662+0000", 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011817299 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.556 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94342 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [notify cookie 140215384087984] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.844806611999999, 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99234641400000001, 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94342 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635992+0000", 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.12e-06 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.558 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636002+0000", 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636032+0000", 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0463e-05 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636053+0000", 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1002999999999999e-05 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636187+0000", 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013359299999999999 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636206+0000", 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9327e-05 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627756+0000", 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99154943799999995 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627997+0000", 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024163200000000001 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628336+0000", 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033850200000000002 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.561 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94343 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch ping cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.772638745999998, 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92041710600000004, 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94343 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:49.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708160+0000", 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8559999999999998e-06 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708178+0000", 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.73e-05 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708212+0000", 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4573000000000003e-05 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708238+0000", 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5792e-05 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.564 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708344+0000", 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106508 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708357+0000", 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2183e-05 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628387+0000", 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92003072600000002 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628449+0000", 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1828000000000005e-05 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628574+0000", 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012533999999999999 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:95531 3.8 3:11293fc5:::rbd_object_map.110f30608ae1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e89)", 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:49.566 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.833629391999999, 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.012680681, 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 95531 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647169+0000", 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9649999999999998e-06 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647177+0000", 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0439999999999996e-06 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:49.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647196+0000", 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9400000000000001e-05 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647204+0000", 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647266+0000", 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2117000000000002e-05 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647275+0000", 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0679999999999997e-06 2024-09-22T01:36:49.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651032+0000", 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037574980000000002 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651044+0000", 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-05 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:49.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659538+0000", 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0084937460000001 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659847+0000", 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000309587 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:49.571 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:49.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:49.574 INFO:teuthology.orchestra.run.smithi018.stdout:5389 punch from 0xca3d3bb to 0xca3ee7a, (0x1abf bytes) 2024-09-22T01:36:49.574 INFO:teuthology.orchestra.run.smithi018.stdout:5390 read 0x2e6688c thru 0x2e68445 (0x1bba bytes) 2024-09-22T01:36:49.574 INFO:teuthology.orchestra.run.smithi018.stdout:5392 trunc from 0xe3be588 to 0xae5eaa0 2024-09-22T01:36:49.574 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:49.568+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:49.586 INFO:teuthology.orchestra.run.smithi018.stdout:5395 write 0xdc224c0 thru 0xdc3070d (0xe24e bytes) 2024-09-22T01:36:49.611 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:49.611 INFO:teuthology.orchestra.run.smithi018.stdout:5397 writesame 0x61e0a25 thru 0x61edb59 data_size 0x7(0xd135 bytes) 2024-09-22T01:36:49.648 INFO:teuthology.orchestra.run.smithi018.stdout:5399 trunc from 0xdc3070e to 0x31cb845 2024-09-22T01:36:49.674 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:49.668+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:49.689 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:49.689 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:49.719 INFO:teuthology.orchestra.run.smithi018.stdout:5402 write 0xc5251c4 thru 0xc52b7de (0x661b bytes) 2024-09-22T01:36:49.731 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:49.731 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:49.731 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:49.731 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:49.734 INFO:teuthology.orchestra.run.smithi018.stdout:5403 punch from 0x8775d93 to 0x87783c7, (0x2634 bytes) 2024-09-22T01:36:49.734 INFO:teuthology.orchestra.run.smithi018.stdout:5406 punch from 0x84d32fe to 0x84d4476, (0x1178 bytes) 2024-09-22T01:36:49.735 INFO:teuthology.orchestra.run.smithi018.stdout:5410 punch from 0x4b69c08 to 0x4b6ecf8, (0x50f0 bytes) 2024-09-22T01:36:49.735 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:49.735 INFO:teuthology.orchestra.run.smithi018.stdout:5412 read 0x5708823 thru 0x5713951 (0xb12f bytes) 2024-09-22T01:36:49.735 INFO:teuthology.orchestra.run.smithi018.stdout:5413 write 0x6f67ca2 thru 0x6f6ab2c (0x2e8b bytes) 2024-09-22T01:36:49.746 INFO:teuthology.orchestra.run.smithi018.stdout:5414 read 0x8ae13c7 thru 0x8af1043 (0xfc7d bytes) 2024-09-22T01:36:49.746 INFO:teuthology.orchestra.run.smithi018.stdout:5416 writesame 0x25aa315 thru 0x25b5837 data_size 0x57(0xb523 bytes) 2024-09-22T01:36:49.749 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:49.752 INFO:teuthology.orchestra.run.smithi018.stdout:5417 read 0xc378af4 thru 0xc381905 (0x8e12 bytes) 2024-09-22T01:36:49.756 INFO:teuthology.orchestra.run.smithi018.stdout:5418 trunc from 0xc52b7df to 0xe226ba6 2024-09-22T01:36:49.775 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:49.770+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:49.871 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:49.871 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:49.871 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:49.871 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:49.871 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:49.876 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:49.870+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:49.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:49.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:36:49.976 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:49.972+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:49.978 INFO:teuthology.orchestra.run.smithi018.stdout:5419 read 0x777fa42 thru 0x778b6d1 (0xbc90 bytes) 2024-09-22T01:36:49.978 INFO:teuthology.orchestra.run.smithi018.stdout:5420 punch from 0x853314d to 0x853a3a9, (0x725c bytes) 2024-09-22T01:36:49.978 INFO:teuthology.orchestra.run.smithi018.stdout:5421 punch from 0xb65a3fc to 0xb65e1d7, (0x3ddb bytes) 2024-09-22T01:36:49.978 INFO:teuthology.orchestra.run.smithi018.stdout:5423 read 0x7b16193 thru 0x7b220f0 (0xbf5e bytes) 2024-09-22T01:36:49.978 INFO:teuthology.orchestra.run.smithi018.stdout:5424 write 0x335b376 thru 0x335e05d (0x2ce8 bytes) 2024-09-22T01:36:49.981 INFO:teuthology.orchestra.run.smithi018.stdout:5425 write 0xae8b7eb thru 0xae92104 (0x691a bytes) 2024-09-22T01:36:50.000 INFO:teuthology.orchestra.run.smithi018.stdout:5427 read 0x11a772c thru 0x11b76a7 (0xff7c bytes) 2024-09-22T01:36:50.003 INFO:teuthology.orchestra.run.smithi018.stdout:5428 write 0x2e8049c thru 0x2e8d526 (0xd08b bytes) 2024-09-22T01:36:50.009 INFO:teuthology.orchestra.run.smithi018.stdout:5430 trunc from 0xe226ba6 to 0xeb75709 2024-09-22T01:36:50.024 INFO:teuthology.orchestra.run.smithi018.stdout:5431 read 0x51cc0e9 thru 0x51cf5a9 (0x34c1 bytes) 2024-09-22T01:36:50.024 INFO:teuthology.orchestra.run.smithi018.stdout:5433 read 0xd72fda7 thru 0xd739735 (0x998f bytes) 2024-09-22T01:36:50.024 INFO:teuthology.orchestra.run.smithi018.stdout:5434 write 0xca50a37 thru 0xca60348 (0xf912 bytes) 2024-09-22T01:36:50.051 INFO:teuthology.orchestra.run.smithi018.stdout:5435 read 0x4debad1 thru 0x4defe89 (0x43b9 bytes) 2024-09-22T01:36:50.052 INFO:teuthology.orchestra.run.smithi018.stdout:5436 writesame 0x2025287 thru 0x2025dc6 data_size 0x1(0xb40 bytes) 2024-09-22T01:36:50.057 INFO:teuthology.orchestra.run.smithi018.stdout:5437 writesame 0xabe4e41 thru 0xabede3c data_size 0x61(0x8ffc bytes) 2024-09-22T01:36:50.069 INFO:teuthology.orchestra.run.smithi018.stdout:5438 write 0xb40c751 thru 0xb418215 (0xbac5 bytes) 2024-09-22T01:36:50.073 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.269205288999999, 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:36:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:36:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.269150112999995, 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:36:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.269085000000004, 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:36:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:36:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.269019252999996, 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.268981783000001, 2024-09-22T01:36:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.268931167000005, 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:36:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:36:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:36:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:36:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267745828000002, 2024-09-22T01:36:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267684001000006, 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267635201999994, 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267561649000001, 2024-09-22T01:36:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267491187000005, 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:36:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:36:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:36:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267420684000001, 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:36:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267373452000001, 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:36:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:36:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:36:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:36:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267310576, 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:36:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:36:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267269909999996, 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:36:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:36:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267175042999995, 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:36:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:36:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:36:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267134006000006, 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267096515000006, 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:36:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:36:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267056366000006, 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 81.267013571000007, 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:36:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:36:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:36:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.183 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:50.184 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:50.185 INFO:teuthology.orchestra.run.smithi018.stdout:5439 trunc from 0xeb75709 to 0x7143e61 2024-09-22T01:36:50.185 INFO:teuthology.orchestra.run.smithi018.stdout:5440 writesame 0xc03fb39 thru 0xc047d4b data_size 0x43(0x8213 bytes) 2024-09-22T01:36:50.185 INFO:teuthology.orchestra.run.smithi018.stdout:5441 writesame 0xac3dc0f thru 0xac4602a data_size 0x5f(0x841c bytes) 2024-09-22T01:36:50.185 INFO:teuthology.orchestra.run.smithi018.stdout:5442 writesame 0x9f4284c thru 0x9f4d7c2 data_size 0x45(0xaf77 bytes) 2024-09-22T01:36:50.185 INFO:teuthology.orchestra.run.smithi018.stdout:5443 read 0x7e0754d thru 0x7e14706 (0xd1ba bytes) 2024-09-22T01:36:50.185 INFO:teuthology.orchestra.run.smithi018.stdout:5444 write 0x4d67ebc thru 0x4d73c98 (0xbddd bytes) 2024-09-22T01:36:50.185 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:50.180+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:50.188 INFO:teuthology.orchestra.run.smithi018.stdout:5446 punch from 0x9a50725 to 0x9a5e3b1, (0xdc8c bytes) 2024-09-22T01:36:50.188 INFO:teuthology.orchestra.run.smithi018.stdout:5447 write 0x18e1b7c thru 0x18e9d5f (0x81e4 bytes) 2024-09-22T01:36:50.191 INFO:teuthology.orchestra.run.smithi018.stdout:5448 punch from 0xb00938b to 0xb0147ba, (0xb42f bytes) 2024-09-22T01:36:50.191 INFO:teuthology.orchestra.run.smithi018.stdout:5449 write 0x31784e0 thru 0x3186126 (0xdc47 bytes) 2024-09-22T01:36:50.195 INFO:teuthology.orchestra.run.smithi018.stdout:5450 read 0xb850d4f thru 0xb85534e (0x4600 bytes) 2024-09-22T01:36:50.195 INFO:teuthology.orchestra.run.smithi018.stdout:5451 punch from 0x2863b11 to 0x286905a, (0x5549 bytes) 2024-09-22T01:36:50.195 INFO:teuthology.orchestra.run.smithi018.stdout:5452 write 0x1064af5 thru 0x1070e86 (0xc392 bytes) 2024-09-22T01:36:50.199 INFO:teuthology.orchestra.run.smithi018.stdout:5453 write 0x50d0970 thru 0x50d475c (0x3ded bytes) 2024-09-22T01:36:50.202 INFO:teuthology.orchestra.run.smithi018.stdout:5455 punch from 0x4a5dc3b to 0x4a62c7d, (0x5042 bytes) 2024-09-22T01:36:50.202 INFO:teuthology.orchestra.run.smithi018.stdout:5456 writesame 0x880376e thru 0x88128e1 data_size 0xca(0xf174 bytes) 2024-09-22T01:36:50.222 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:50.222 INFO:teuthology.orchestra.run.smithi018.stdout:5458 write 0x56db382 thru 0x56e908c (0xdd0b bytes) 2024-09-22T01:36:50.247 INFO:teuthology.orchestra.run.smithi018.stdout:5459 trunc from 0xc047d4c to 0x5a5a31f 2024-09-22T01:36:50.270 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:50.271 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:50.271 INFO:teuthology.orchestra.run.smithi018.stdout:5462 read 0x6a2708 thru 0x6a28ed (0x1e6 bytes) 2024-09-22T01:36:50.285 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:50.280+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:50.285 INFO:teuthology.orchestra.run.smithi018.stdout:5464 write 0x890545f thru 0x890ebcc (0x976e bytes) 2024-09-22T01:36:50.298 INFO:teuthology.orchestra.run.smithi018.stdout:5465 read 0x8281090 thru 0x828b10e (0xa07f bytes) 2024-09-22T01:36:50.299 INFO:teuthology.orchestra.run.smithi018.stdout:5466 trunc from 0x890ebcd to 0x8a4be95 2024-09-22T01:36:50.306 INFO:teuthology.orchestra.run.smithi018.stdout:5467 read 0x688acc5 thru 0x688dd6a (0x30a6 bytes) 2024-09-22T01:36:50.306 INFO:teuthology.orchestra.run.smithi018.stdout:5470 write 0x2afca2b thru 0x2afe0ab (0x1681 bytes) 2024-09-22T01:36:50.309 INFO:teuthology.orchestra.run.smithi018.stdout:5472 read 0x2694425 thru 0x26a0535 (0xc111 bytes) 2024-09-22T01:36:50.310 INFO:teuthology.orchestra.run.smithi018.stdout:5475 read 0x3997fad thru 0x39a2360 (0xa3b4 bytes) 2024-09-22T01:36:50.310 INFO:teuthology.orchestra.run.smithi018.stdout:5476 punch from 0x67cb833 to 0x67d012d, (0x48fa bytes) 2024-09-22T01:36:50.310 INFO:teuthology.orchestra.run.smithi018.stdout:5477 punch from 0x74ab6ce to 0x74b47dc, (0x910e bytes) 2024-09-22T01:36:50.321 INFO:teuthology.orchestra.run.smithi018.stdout:5478 write 0xa41b3ad thru 0xa41cfc8 (0x1c1c bytes) 2024-09-22T01:36:50.321 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:50.322 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:50.322 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:50.322 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:50.326 INFO:teuthology.orchestra.run.smithi018.stdout:5479 punch from 0x73d7c98 to 0x73dd67f, (0x59e7 bytes) 2024-09-22T01:36:50.326 INFO:teuthology.orchestra.run.smithi018.stdout:5480 write 0x23389bd thru 0x2344a5e (0xc0a2 bytes) 2024-09-22T01:36:50.331 INFO:teuthology.orchestra.run.smithi018.stdout:5481 write 0x2283acc thru 0x228cd81 (0x92b6 bytes) 2024-09-22T01:36:50.335 INFO:teuthology.orchestra.run.smithi018.stdout:5482 writesame 0x4097eb7 thru 0x40a504a data_size 0x11(0xd194 bytes) 2024-09-22T01:36:50.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:50.343 INFO:teuthology.orchestra.run.smithi018.stdout:5483 read 0x435b86c thru 0x43638fb (0x8090 bytes) 2024-09-22T01:36:50.344 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:50.344 INFO:teuthology.orchestra.run.smithi018.stdout:5485 write 0x4e700cb thru 0x4e72d87 (0x2cbd bytes) 2024-09-22T01:36:50.349 INFO:teuthology.orchestra.run.smithi018.stdout:5486 read 0x4d14e98 thru 0x4d19a53 (0x4bbc bytes) 2024-09-22T01:36:50.351 INFO:teuthology.orchestra.run.smithi018.stdout:5488 punch from 0x7968ee4 to 0x796f213, (0x632f bytes) 2024-09-22T01:36:50.351 INFO:teuthology.orchestra.run.smithi018.stdout:5490 writesame 0xa2f29c2 thru 0xa2ff6f5 data_size 0x2e(0xcd34 bytes) 2024-09-22T01:36:50.373 INFO:teuthology.orchestra.run.smithi018.stdout:5491 trunc from 0xa41cfc9 to 0x55fc61f 2024-09-22T01:36:50.387 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:50.380+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:50.407 INFO:teuthology.orchestra.run.smithi018.stdout:5494 write 0x7e3e29b thru 0x7e447fb (0x6561 bytes) 2024-09-22T01:36:50.426 INFO:teuthology.orchestra.run.smithi018.stdout:5495 trunc from 0x7e447fc to 0x45958d2 2024-09-22T01:36:50.452 INFO:teuthology.orchestra.run.smithi018.stdout:5496 read 0x286fa3 thru 0x28d843 (0x68a1 bytes) 2024-09-22T01:36:50.467 INFO:teuthology.orchestra.run.smithi018.stdout:5497 write 0x6c47e91 thru 0x6c4a0fc (0x226c bytes) 2024-09-22T01:36:50.476 INFO:teuthology.orchestra.run.smithi018.stdout:5498 read 0x28c7370 thru 0x28ccb77 (0x5808 bytes) 2024-09-22T01:36:50.480 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:50.480 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:50.480 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:50.480 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:50.480 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:50.486 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:50.482+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:50.489 INFO:teuthology.orchestra.run.smithi018.stdout:5499 write 0x815a59c thru 0x8160276 (0x5cdb bytes) 2024-09-22T01:36:50.495 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:50.503 INFO:teuthology.orchestra.run.smithi018.stdout:5500 read 0x8083554 thru 0x8086e43 (0x38f0 bytes) 2024-09-22T01:36:50.503 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:50.503 INFO:teuthology.orchestra.run.smithi018.stdout:5502 read 0x4d48c8a thru 0x4d52e79 (0xa1f0 bytes) 2024-09-22T01:36:50.504 INFO:teuthology.orchestra.run.smithi018.stdout:5504 write 0x89af58 thru 0x8a3087 (0x8130 bytes) 2024-09-22T01:36:50.508 INFO:teuthology.orchestra.run.smithi018.stdout:5505 punch from 0x2f659f to 0x2ff23a, (0x8c9b bytes) 2024-09-22T01:36:50.508 INFO:teuthology.orchestra.run.smithi018.stdout:5506 trunc from 0x8160277 to 0x800c0dd 2024-09-22T01:36:50.526 INFO:teuthology.orchestra.run.smithi018.stdout:5507 trunc from 0x800c0dd to 0x9aea88e 2024-09-22T01:36:50.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:50.534 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:50.534 INFO:teuthology.orchestra.run.smithi018.stdout:5509 read 0x1a05d59 thru 0x1a0741e (0x16c6 bytes) 2024-09-22T01:36:50.535 INFO:teuthology.orchestra.run.smithi018.stdout:5510 write 0x38be4ce thru 0x38c6832 (0x8365 bytes) 2024-09-22T01:36:50.552 INFO:teuthology.orchestra.run.smithi018.stdout:5512 trunc from 0x9aea88e to 0xdb9825 2024-09-22T01:36:50.588 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:50.580+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:50.591 INFO:teuthology.orchestra.run.smithi018.stdout:5513 punch from 0x72193b to 0x7261ef, (0x48b4 bytes) 2024-09-22T01:36:50.591 INFO:teuthology.orchestra.run.smithi018.stdout:5516 punch from 0xbf299a to 0xbf52d6, (0x293c bytes) 2024-09-22T01:36:50.614 INFO:teuthology.orchestra.run.smithi018.stdout:5517 write 0x97c14f8 thru 0x97ceb54 (0xd65d bytes) 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223914324999999, 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.642 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:36:50.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223884135999999, 2024-09-22T01:36:50.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223855042, 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:36:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:36:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:36:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223825417, 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223775524000001, 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223743813999999, 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223714375, 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:36:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:36:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223684919, 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:36:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223654895999999, 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:36:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:36:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223609483000001, 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:36:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223579913999998, 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:36:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223550104000001, 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:36:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:36:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223520818000001, 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:36:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:36:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223487511999998, 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223457606, 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:36:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223427823000002, 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:36:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:36:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:36:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223364007000001, 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223329070999998, 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:36:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:36:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:36:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:36:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223299331, 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:36:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:36:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.223269205000001, 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:50.727 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:50.728 INFO:teuthology.orchestra.run.smithi018.stdout:5518 write 0xa0200d1 thru 0xa0261ec (0x611c bytes) 2024-09-22T01:36:50.728 INFO:teuthology.orchestra.run.smithi018.stdout:5519 write 0x55bbda8 thru 0x55c96e1 (0xd93a bytes) 2024-09-22T01:36:50.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:50.730 INFO:teuthology.orchestra.run.smithi018.stdout:5520 write 0xdb34d6f thru 0xdb3b4a1 (0x6733 bytes) 2024-09-22T01:36:50.730 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:50.730 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:50.730 INFO:teuthology.orchestra.run.smithi018.stdout:5522 write 0xa6e9ecc thru 0xa6f3409 (0x953e bytes) 2024-09-22T01:36:50.731 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:50.731 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:50.731 INFO:teuthology.orchestra.run.smithi018.stdout:5523 trunc from 0xdb3b4a2 to 0x109d74b 2024-09-22T01:36:50.731 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:50.732 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:50.732 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:50.722+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:50.747 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:50.747 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:50.759 INFO:teuthology.orchestra.run.smithi018.stdout:5526 write 0x4dbe1b6 thru 0x4dc59c7 (0x7812 bytes) 2024-09-22T01:36:50.766 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:50.770 INFO:teuthology.orchestra.run.smithi018.stdout:5527 punch from 0x232e477 to 0x2331aee, (0x3677 bytes) 2024-09-22T01:36:50.786 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:50.786 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:50.794 INFO:teuthology.orchestra.run.smithi018.stdout:5530 writesame 0xee028f7 thru 0xee0432d data_size 0x3(0x1a37 bytes) 2024-09-22T01:36:50.794 INFO:teuthology.orchestra.run.smithi018.stdout:5533 writesame 0x7abce62 thru 0x7abd34e data_size 0x1(0x4ed bytes) 2024-09-22T01:36:50.798 INFO:teuthology.orchestra.run.smithi018.stdout:5534 writesame 0x59628bc thru 0x5970401 data_size 0x22(0xdb46 bytes) 2024-09-22T01:36:50.807 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:50.807 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:50.819 INFO:teuthology.orchestra.run.smithi018.stdout:5535 write 0x2bc612 thru 0x2c353d (0x6f2c bytes) 2024-09-22T01:36:50.822 INFO:teuthology.orchestra.run.smithi018.stdout:5536 writesame 0x191619b thru 0x19173e4 data_size 0x1(0x124a bytes) 2024-09-22T01:36:50.827 INFO:teuthology.orchestra.run.smithi018.stdout:5537 read 0xabc8004 thru 0xabd23fe (0xa3fb bytes) 2024-09-22T01:36:50.827 INFO:teuthology.orchestra.run.smithi018.stdout:5538 punch from 0xc02d919 to 0xc038cb4, (0xb39b bytes) 2024-09-22T01:36:50.827 INFO:teuthology.orchestra.run.smithi018.stdout:5539 read 0xcd05f1d thru 0xcd12779 (0xc85d bytes) 2024-09-22T01:36:50.829 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:50.829 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:50.829 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:50.822+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:50.848 INFO:teuthology.orchestra.run.smithi018.stdout:5540 trunc from 0xee0432e to 0x1d16470 2024-09-22T01:36:50.878 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:50.878 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:50.887 INFO:teuthology.orchestra.run.smithi018.stdout:5542 write 0x38bbc00 thru 0x38bcfa4 (0x13a5 bytes) 2024-09-22T01:36:50.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:50.922 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:36:50.929 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 5, 6, 7, 0, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:36:50.930 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:36:50.930 INFO:tasks.thrashosds.thrasher:Removing osd 5, in_osds are: [1, 3, 4, 5, 6, 7, 0, 2] 2024-09-22T01:36:50.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 5 2024-09-22T01:36:50.969 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:50.926+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:51.001 INFO:teuthology.orchestra.run.smithi018.stdout:5543 write 0x9ce1b2c thru 0x9ceb5e4 (0x9ab9 bytes) 2024-09-22T01:36:51.031 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:51.024+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:51.036 INFO:teuthology.orchestra.run.smithi018.stdout:5545 write 0xb3425f1 thru 0xb346102 (0x3b12 bytes) 2024-09-22T01:36:51.044 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:51.044 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:51.048 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:51.048 INFO:teuthology.orchestra.run.smithi018.stdout:5547 write 0x9319be0 thru 0x931ef54 (0x5375 bytes) 2024-09-22T01:36:51.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:51.079 INFO:teuthology.orchestra.run.smithi018.stdout:5548 write 0xbcbc2af thru 0xbcc5aee (0x9840 bytes) 2024-09-22T01:36:51.099 INFO:teuthology.orchestra.run.smithi018.stdout:5549 write 0x2aa54ae thru 0x2aacc9c (0x77ef bytes) 2024-09-22T01:36:51.131 INFO:teuthology.orchestra.run.smithi018.stdout:5550 writesame 0xcc34def thru 0xcc44b2d data_size 0x1(0xfd3f bytes) 2024-09-22T01:36:51.132 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:51.126+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:51.143 INFO:teuthology.orchestra.run.smithi018.stdout:5551 writesame 0xe3879ac thru 0xe38da89 data_size 0x3(0x60de bytes) 2024-09-22T01:36:51.154 INFO:teuthology.orchestra.run.smithi018.stdout:5552 write 0xe62142c thru 0xe62cc07 (0xb7dc bytes) 2024-09-22T01:36:51.181 INFO:teuthology.orchestra.run.smithi018.stdout:5553 trunc from 0xe62cc08 to 0xb466259 2024-09-22T01:36:51.207 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:51.207 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:51.209 INFO:teuthology.orchestra.run.smithi018.stdout:5554 read 0x356408e thru 0x35691f3 (0x5166 bytes) 2024-09-22T01:36:51.210 INFO:teuthology.orchestra.run.smithi018.stdout:5555 read 0xa3aef66 thru 0xa3b717b (0x8216 bytes) 2024-09-22T01:36:51.211 INFO:teuthology.orchestra.run.smithi018.stdout:5558 read 0x780d008 thru 0x7814cb9 (0x7cb2 bytes) 2024-09-22T01:36:51.211 INFO:teuthology.orchestra.run.smithi018.stdout:5563 read 0x647f3 thru 0x6f3eb (0xabf9 bytes) 2024-09-22T01:36:51.212 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:51.215 INFO:teuthology.orchestra.run.smithi018.stdout:5567 trunc from 0xb466259 to 0xa03d93c 2024-09-22T01:36:51.224 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:51.243 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:51.243 INFO:teuthology.orchestra.run.smithi018.stdout:5571 read 0x2a794b6 thru 0x2a7b82d (0x2378 bytes) 2024-09-22T01:36:51.243 INFO:teuthology.orchestra.run.smithi018.stdout:5573 read 0x625d7d7 thru 0x625d9a0 (0x1ca bytes) 2024-09-22T01:36:51.244 INFO:teuthology.orchestra.run.smithi018.stdout:5574 trunc from 0xa03d93c to 0xac989e2 2024-09-22T01:36:51.259 INFO:teuthology.orchestra.run.smithi018.stdout:5575 trunc from 0xac989e2 to 0xebd5958 2024-09-22T01:36:51.268 INFO:teuthology.orchestra.run.smithi018.stdout:5576 write 0x4ab366c thru 0x4ac23e8 (0xed7d bytes) 2024-09-22T01:36:51.270 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:51.266+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:51.283 INFO:teuthology.orchestra.run.smithi018.stdout:5577 read 0x8f8d25d thru 0x8f93f59 (0x6cfd bytes) 2024-09-22T01:36:51.284 INFO:teuthology.orchestra.run.smithi018.stdout:5578 write 0xc8b4b35 thru 0xc8b5493 (0x95f bytes) 2024-09-22T01:36:51.288 INFO:teuthology.orchestra.run.smithi018.stdout:5579 writesame 0xe08a857 thru 0xe09203f data_size 0x1(0x77e9 bytes) 2024-09-22T01:36:51.307 INFO:teuthology.orchestra.run.smithi018.stdout:5580 writesame 0x81c01d0 thru 0x81cce2e data_size 0x1(0xcc5f bytes) 2024-09-22T01:36:51.315 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-22T01:36:51.308+0000 7fb667fae640 -1 mon.a@0(leader).osd e121 definitely_dead 0 2024-09-22T01:36:51.334 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:51.330+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:51.348 INFO:teuthology.orchestra.run.smithi018.stdout:5581 trunc from 0xebd5958 to 0x883efbf 2024-09-22T01:36:51.378 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:51.378 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:51.387 INFO:teuthology.orchestra.run.smithi018.stdout:5582 writesame 0xbc18697 thru 0xbc1cfd4 data_size 0x4b(0x493e bytes) 2024-09-22T01:36:51.387 INFO:teuthology.orchestra.run.smithi018.stdout:5583 punch from 0x5425b3b to 0x54281a5, (0x266a bytes) 2024-09-22T01:36:51.387 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:51.387 INFO:teuthology.orchestra.run.smithi018.stdout:5588 punch from 0xbbd0f18 to 0xbbd8b98, (0x7c80 bytes) 2024-09-22T01:36:51.387 INFO:teuthology.orchestra.run.smithi018.stdout:5589 punch from 0xae492f3 to 0xae51867, (0x8574 bytes) 2024-09-22T01:36:51.387 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:51.388 INFO:teuthology.orchestra.run.smithi018.stdout:5592 writesame 0x3c8e7a2 thru 0x3c91fe8 data_size 0x1(0x3847 bytes) 2024-09-22T01:36:51.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:51.401 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:51.401 INFO:teuthology.orchestra.run.smithi018.stdout:5595 read 0x6335307 thru 0x633b677 (0x6371 bytes) 2024-09-22T01:36:51.401 INFO:teuthology.orchestra.run.smithi018.stdout:5596 read 0xb7cbb1f thru 0xb7ce3c6 (0x28a8 bytes) 2024-09-22T01:36:51.402 INFO:teuthology.orchestra.run.smithi018.stdout:5597 writesame 0x359886b thru 0x35a76e5 data_size 0x1(0xee7b bytes) 2024-09-22T01:36:51.434 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:51.430+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:51.454 INFO:teuthology.orchestra.run.smithi018.stdout:5598 write 0xe3d4cc7 thru 0xe3df844 (0xab7e bytes) 2024-09-22T01:36:51.466 INFO:teuthology.orchestra.run.smithi018.stdout:5600 write 0xae55fca thru 0xae63495 (0xd4cc bytes) 2024-09-22T01:36:51.481 INFO:teuthology.orchestra.run.smithi018.stdout:5602 read 0x3a52820 thru 0x3a5bc71 (0x9452 bytes) 2024-09-22T01:36:51.482 INFO:teuthology.orchestra.run.smithi018.stdout:5603 clone 42 order 20 su 524288 sc 6 2024-09-22T01:36:51.534 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:51.530+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:51.558 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:51.558 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:51.571 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:51.636 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:51.628+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:51.737 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:51.730+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:51.739 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:51.739 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:51.753 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:51.838 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:51.834+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:51.920 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:51.920 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:51.930 INFO:teuthology.orchestra.run.smithi018.stderr:marked out osd.5. 2024-09-22T01:36:51.939 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:51.934+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:51.940 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:52.039 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:52.032+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:52.106 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:52.106 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:52.119 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:52.166 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:52.162+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:52.241 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:52.234+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:52.242 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:52.242 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:52.257 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:52.343 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:52.336+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:52.416 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:52.416 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:52.430 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:52.444 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:52.436+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:52.544 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:52.540+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:52.548 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:52.548 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:52.562 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:52.645 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:52.640+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:52.684 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:52.685 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:52.698 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:52.746 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:52.740+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:52.821 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:52.821 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:52.835 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:52.847 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:52.840+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:52.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:52.942 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:36:52.961 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:52.961 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:52.976 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:52.988 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:52.984+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:53.028 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:53.028 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:53.046 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:53.046 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:53.048 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:53.042+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:53.064 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:53.086 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:53.086 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:53.099 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:53.099 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:53.104 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:53.105 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:53.114 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:53.124 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:53.124 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:53.142 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:53.143 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:53.158 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:53.154+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:53.163 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:53.163 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:53.239 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:53.239 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:53.239 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:53.250 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:53.244+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:53.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:53.351 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:53.344+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:53.415 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:53.415 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:53.415 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:53.415 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:53.415 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:53.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:53.452 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:53.446+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:53.553 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:53.548+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:53.602 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:53.602 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:53.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:53.602 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:53.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.602 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.602 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.127866076, 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:53.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:36:53.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:36:53.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.12779166599999, 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.610 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.12773513499999, 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:36:53.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:36:53.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.127677541, 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:36:53.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:36:53.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:36:53.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:36:53.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.12762020300001, 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:36:53.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:36:53.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.127562762, 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.623 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:36:53.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:36:53.626 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.12752685300001, 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:36:53.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:36:53.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.122483155, 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:36:53.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:36:53.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:36:53.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:36:53.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:36:53.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.122419714, 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:36:53.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.122364477, 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:36:53.639 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.122291163, 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.644 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:36:53.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.122237082, 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.648 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:36:53.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:36:53.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:36:53.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.12218264400001, 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.652 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:36:53.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:36:53.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 105.122126783, 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93498 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.021960024999998, 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93801259999999997, 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:53.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93498 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576580+0000", 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8600000000000003e-06 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576600+0000", 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9746e-05 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576650+0000", 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0419e-05 2024-09-22T01:36:53.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576678+0000", 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7858999999999999e-05 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580737+0000", 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040585939999999996 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580754+0000", 2024-09-22T01:36:53.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7102e-05 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514561+0000", 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93380681700000001 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514589+0000", 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8203000000000001e-05 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93499 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.019094312, 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93524844100000004, 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93499 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579444+0000", 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2369999999999999e-06 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579455+0000", 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0655e-05 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579486+0000", 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1473999999999997e-05 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579506+0000", 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9513000000000001e-05 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581124+0000", 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016177050000000001 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581135+0000", 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1534e-05 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514663+0000", 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93352768399999997 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514691+0000", 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7639000000000001e-05 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94339 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch reconnect cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.97671708, 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0158427670000001, 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94339 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621821+0000", 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.55e-06 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621827+0000", 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1299999999999998e-06 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621843+0000", 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5542000000000001e-05 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621853+0000", 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0445000000000001e-05 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621924+0000", 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1262999999999999e-05 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:53.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621936+0000", 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.131e-05 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625444+0000", 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0035085479999999 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625845+0000", 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040067999999999999 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.637662+0000", 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011817299 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94342 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [notify cookie 140215384087984] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.962546910999997, 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99234641400000001, 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.674 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94342 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635992+0000", 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.12e-06 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636002+0000", 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636032+0000", 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0463e-05 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636053+0000", 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1002999999999999e-05 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636187+0000", 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013359299999999999 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636206+0000", 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9327e-05 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627756+0000", 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99154943799999995 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627997+0000", 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024163200000000001 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628336+0000", 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033850200000000002 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.678 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94343 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch ping cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.890379045000003, 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92041710600000004, 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94343 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708160+0000", 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8559999999999998e-06 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708178+0000", 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.73e-05 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708212+0000", 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4573000000000003e-05 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708238+0000", 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5792e-05 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708344+0000", 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106508 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708357+0000", 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2183e-05 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628387+0000", 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92003072600000002 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628449+0000", 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1828000000000005e-05 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628574+0000", 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012533999999999999 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.683 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:95531 3.8 3:11293fc5:::rbd_object_map.110f30608ae1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e89)", 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.951369690999996, 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.012680681, 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:53.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 95531 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:53.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647169+0000", 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9649999999999998e-06 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647177+0000", 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0439999999999996e-06 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647196+0000", 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9400000000000001e-05 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:53.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647204+0000", 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647266+0000", 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2117000000000002e-05 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647275+0000", 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0679999999999997e-06 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651032+0000", 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037574980000000002 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651044+0000", 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-05 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659538+0000", 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0084937460000001 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659847+0000", 2024-09-22T01:36:53.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000309587 2024-09-22T01:36:53.689 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.689 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.689 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.689 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:53.689 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:53.689 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:53.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:53.690 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:53.686+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:53.791 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:53.784+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:53.866 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:53.866 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:53.866 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:53.866 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:53.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:53.892 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:53.886+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:53.925 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:36:53.993 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:53.986+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:54.085 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:54.086 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:54.086 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:54.086 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:54.086 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:54.094 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:54.090+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:54.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:54.195 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:54.190+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:54.254 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.450332896000006, 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:36:54.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:36:54.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:36:54.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:36:54.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.260 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.450277720000003, 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:36:54.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:36:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:36:54.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.450212606999997, 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.267 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:36:54.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:36:54.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:36:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.272 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.450146860000004, 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.450109389999994, 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:36:54.278 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:36:54.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:36:54.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.450058773999999, 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.284 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:54.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:36:54.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448873434999996, 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:36:54.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:36:54.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:36:54.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448811608, 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.296 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:36:54.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:36:54.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:36:54.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.301 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448762809000002, 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:36:54.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:36:54.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448689255999994, 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:54.312 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448618793999998, 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:36:54.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:36:54.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:36:54.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:36:54.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448548290999994, 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.318 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.323 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448501058999994, 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:54.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:36:54.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:36:54.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:36:54.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:36:54.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448438182999993, 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.330 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.330 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:36:54.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.330 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:54.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:54.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:36:54.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:36:54.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:36:54.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:36:54.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:36:54.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:36:54.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:36:54.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:36:54.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:36:54.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:36:54.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:36:54.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:36:54.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:36:54.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:36:54.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:36:54.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448397517000004, 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:36:54.338 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448302650000002, 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.344 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:36:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.345 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:36:54.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:54.350 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448261613, 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:36:54.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448224121999999, 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:36:54.356 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:36:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:36:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:36:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:36:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448183972999999, 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.362 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:36:54.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:36:54.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:36:54.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 85.448141178, 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:36:54.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:36:54.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:36:54.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:36:54.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.374 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.374 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.374 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:54.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:54.378 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:54.368+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:54.476 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:54.470+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:54.481 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone41 from 0xe3df845 (overlap 0xdb9825) to 0x83c1af 2024-09-22T01:36:54.520 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:54.520 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:54.520 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:54.520 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:54.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:54.580 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:54.576+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:54.633 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-22T01:36:54.634 INFO:teuthology.orchestra.run.smithi018.stdout:5604 punch from 0xa11c941 to 0xa11ee3b, (0x24fa bytes) 2024-09-22T01:36:54.642 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:54.642 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:54.642 INFO:teuthology.orchestra.run.smithi018.stdout:5607 punch from 0x1c7fe to 0x2b0c0, (0xe8c2 bytes) 2024-09-22T01:36:54.642 INFO:teuthology.orchestra.run.smithi018.stdout:5609 read 0x2975ba0 thru 0x297713f (0x15a0 bytes) 2024-09-22T01:36:54.648 INFO:teuthology.orchestra.run.smithi018.stdout:5610 trunc from 0xe3df845 to 0xa098a04 2024-09-22T01:36:54.663 INFO:teuthology.orchestra.run.smithi018.stdout:5611 write 0x38e0398 thru 0x38e55ab (0x5214 bytes) 2024-09-22T01:36:54.665 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:54.665 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:54.665 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:54.666 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:54.671 INFO:teuthology.orchestra.run.smithi018.stdout:5612 punch from 0x1fcae80 to 0x1fd67fb, (0xb97b bytes) 2024-09-22T01:36:54.671 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:54.671 INFO:teuthology.orchestra.run.smithi018.stdout:5617 punch from 0x7e4d59d to 0x7e5c51d, (0xef80 bytes) 2024-09-22T01:36:54.671 INFO:teuthology.orchestra.run.smithi018.stdout:5619 read 0x9623276 thru 0x9629a8c (0x6817 bytes) 2024-09-22T01:36:54.671 INFO:teuthology.orchestra.run.smithi018.stdout:5620 write 0x9967232 thru 0x996ef66 (0x7d35 bytes) 2024-09-22T01:36:54.675 INFO:teuthology.orchestra.run.smithi018.stdout:5621 writesame 0x87e2f87 thru 0x87ee506 data_size 0x2c(0xb580 bytes) 2024-09-22T01:36:54.678 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:54.674+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:54.681 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:54.682 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:54.688 INFO:teuthology.orchestra.run.smithi018.stdout:5624 trunc from 0xa098a04 to 0x50c21ff 2024-09-22T01:36:54.742 INFO:teuthology.orchestra.run.smithi018.stdout:5626 write 0xd8533b3 thru 0xd85b229 (0x7e77 bytes) 2024-09-22T01:36:54.746 INFO:teuthology.orchestra.run.smithi018.stdout:5627 read 0x399d279 thru 0x399f245 (0x1fcd bytes) 2024-09-22T01:36:54.747 INFO:teuthology.orchestra.run.smithi018.stdout:5628 write 0x104ab0a thru 0x1056706 (0xbbfd bytes) 2024-09-22T01:36:54.754 INFO:teuthology.orchestra.run.smithi018.stdout:5629 read 0x759fc37 thru 0x75a4306 (0x46d0 bytes) 2024-09-22T01:36:54.755 INFO:teuthology.orchestra.run.smithi018.stdout:5630 write 0x385fa3f thru 0x386e58a (0xeb4c bytes) 2024-09-22T01:36:54.762 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:54.762 INFO:teuthology.orchestra.run.smithi018.stdout:5632 read 0x626178e thru 0x62694bc (0x7d2f bytes) 2024-09-22T01:36:54.762 INFO:teuthology.orchestra.run.smithi018.stdout:5633 write 0x573c06c thru 0x5748654 (0xc5e9 bytes) 2024-09-22T01:36:54.779 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:54.774+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:54.783 INFO:teuthology.orchestra.run.smithi018.stdout:5636 trunc from 0xd85b22a to 0x23b379a 2024-09-22T01:36:54.826 INFO:teuthology.orchestra.run.smithi018.stdout:5637 write 0x9bf7cd2 thru 0x9c02a1a (0xad49 bytes) 2024-09-22T01:36:54.831 INFO:teuthology.orchestra.run.smithi018.stdout:5639 read 0x6f78cf0 thru 0x6f7e893 (0x5ba4 bytes) 2024-09-22T01:36:54.831 INFO:teuthology.orchestra.run.smithi018.stdout:5640 write 0x76daf thru 0x80201 (0x9453 bytes) 2024-09-22T01:36:54.841 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:54.841 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:54.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:54.841 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:54.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.841 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.841 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:54.841 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422905333999999, 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:36:54.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422875144999999, 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.846 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:36:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:36:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:36:54.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:36:54.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422846051000001, 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:36:54.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:36:54.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:36:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422816426000001, 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.855 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422766533000001, 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:36:54.859 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.863 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422734822999999, 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.867 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422705384, 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.868 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:36:54.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422675928, 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.876 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422645905, 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:36:54.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422600492000001, 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:54.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:36:54.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:36:54.884 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422570922999999, 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.885 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:36:54.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:36:54.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422541113000001, 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.889 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:36:54.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422511827000001, 2024-09-22T01:36:54.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:36:54.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:36:54.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.897 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422478520999999, 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:54.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:36:54.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:36:54.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422448615, 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:36:54.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:36:54.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:36:54.905 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422418832000002, 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422355016000001, 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.910 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.914 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422320079999999, 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:36:54.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.918 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.42229034, 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.919 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:36:54.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.422260214000001, 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:54.923 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:54.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:54.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:54.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:54.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:36:54.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:36:54.927 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.927 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.927 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.927 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:54.927 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:54.927 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:54.928 INFO:teuthology.orchestra.run.smithi018.stdout:5641 punch from 0xcba686 to 0xcc1484, (0x6dfe bytes) 2024-09-22T01:36:54.929 INFO:teuthology.orchestra.run.smithi018.stdout:5642 writesame 0x79163ee thru 0x79178d7 data_size 0x1(0x14ea bytes) 2024-09-22T01:36:54.929 INFO:teuthology.orchestra.run.smithi018.stdout:5643 read 0x6d268a2 thru 0x6d2ecd3 (0x8432 bytes) 2024-09-22T01:36:54.929 INFO:teuthology.orchestra.run.smithi018.stdout:5644 read 0x336d1c2 thru 0x337032f (0x316e bytes) 2024-09-22T01:36:54.929 INFO:teuthology.orchestra.run.smithi018.stdout:5645 punch from 0x18b2703 to 0x18b2da1, (0x69e bytes) 2024-09-22T01:36:54.929 INFO:teuthology.orchestra.run.smithi018.stdout:5646 write 0xa94e1 thru 0xb5350 (0xbe70 bytes) 2024-09-22T01:36:54.929 INFO:teuthology.orchestra.run.smithi018.stdout:5647 write 0x8d693b thru 0x8e5fa5 (0xf66b bytes) 2024-09-22T01:36:54.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:54.931 INFO:teuthology.orchestra.run.smithi018.stdout:5649 read 0x46f442e thru 0x46fc347 (0x7f1a bytes) 2024-09-22T01:36:54.931 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:54.931 INFO:teuthology.orchestra.run.smithi018.stdout:5652 read 0x2b53723 thru 0x2b5f2a6 (0xbb84 bytes) 2024-09-22T01:36:54.931 INFO:teuthology.orchestra.run.smithi018.stdout:5654 writesame 0x6cae3a9 thru 0x6cbb93d data_size 0x7(0xd595 bytes) 2024-09-22T01:36:54.931 INFO:teuthology.orchestra.run.smithi018.stdout:5656 writesame 0x8e7c1a2 thru 0x8e7ed5f data_size 0xb(0x2bbe bytes) 2024-09-22T01:36:54.931 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:54.931 INFO:teuthology.orchestra.run.smithi018.stdout:5658 read 0x74363ef thru 0x7440f01 (0xab13 bytes) 2024-09-22T01:36:54.931 INFO:teuthology.orchestra.run.smithi018.stdout:5659 write 0xbb6b2e thru 0xbbdd8a (0x725d bytes) 2024-09-22T01:36:54.932 INFO:teuthology.orchestra.run.smithi018.stdout:5660 writesame 0xa34dda1 thru 0xa350aca data_size 0x52(0x2d2a bytes) 2024-09-22T01:36:54.932 INFO:teuthology.orchestra.run.smithi018.stdout:5661 write 0xde22645 thru 0xde259bb (0x3377 bytes) 2024-09-22T01:36:54.932 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:54.932 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:54.932 INFO:teuthology.orchestra.run.smithi018.stdout:5665 trunc from 0xde259bc to 0x34b013f 2024-09-22T01:36:54.932 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:54.924+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:54.933 INFO:teuthology.orchestra.run.smithi018.stdout:5666 read 0x2d1dc14 thru 0x2d2b396 (0xd783 bytes) 2024-09-22T01:36:54.933 INFO:teuthology.orchestra.run.smithi018.stdout:5667 read 0x11a5546 thru 0x11b3187 (0xdc42 bytes) 2024-09-22T01:36:54.933 INFO:teuthology.orchestra.run.smithi018.stdout:5668 clone 43 order 20 su 4096 sc 5 2024-09-22T01:36:55.029 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:55.024+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:55.061 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:55.061 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:55.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.061 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "MOSDPGRecoveryDeleteReply(3.c e125,123 3:365c7853:::rbd_data.110fd7681e79.0000000000000085:head,58'232)", 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:55.060618+0000", 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.00030713300000000002, 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034803999999999998, 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:55.060618+0000", 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:55.060618+0000", 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:55.060618+0000", 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4199999999999996e-07 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:55.060622+0000", 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4429999999999999e-06 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:55.060633+0000", 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0954999999999999e-05 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:55.060638+0000", 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6370000000000004e-06 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:55.060699+0000", 2024-09-22T01:36:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0485000000000001e-05 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:134547 3.2 3.e01d8ec2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e125)", 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:54.950344+0000", 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.11058098500000001, 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.11077936300000001, 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for peered", 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 134547 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:54.950344+0000", 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:54.950344+0000", 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:54.950345+0000", 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.203e-06 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:54.950350+0000", 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3660000000000002e-06 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:54.950358+0000", 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3590000000000008e-06 2024-09-22T01:36:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:54.950364+0000", 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0839999999999997e-06 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:54.950559+0000", 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00019468299999999999 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:54.950566+0000", 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:36:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 2 2024-09-22T01:36:55.069 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:55.075 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:55.130 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:55.126+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:55.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:55.231 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:55.226+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:55.237 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:55.237 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:55.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:55.319 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:55.320 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:55.332 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:55.328+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:55.336 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:55.336 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:55.353 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:55.365 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:55.365 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:55.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:55.365 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:55.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.238180059, 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:55.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:36:55.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:36:55.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.238154323, 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.370 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:36:55.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:36:55.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.23812854099999, 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:36:55.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.238083622, 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:55.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:36:55.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.238051466, 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.382 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:55.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:36:55.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.385 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.238023734, 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:36:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.389 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.23798791, 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.390 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:36:55.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.23795176599999, 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.394 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:36:55.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.397 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.23791556099999, 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.398 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:36:55.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:36:55.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.237888209, 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.237851131, 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.406 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:36:55.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:36:55.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.409 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.237827594, 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.237280394, 2024-09-22T01:36:55.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.237252637, 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.417 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:55.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:36:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.237230571, 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.421 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.237200411, 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:55.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:36:55.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:36:55.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.23677992099999, 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.428 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.23675414, 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.432 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:55.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:36:55.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:55.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 110.236732872, 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:36:55.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:36:55.439 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 6.825727477, 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:55.440 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:55.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:36:55.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:55.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:36:55.446 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:55.447 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:55.447 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:55.448 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:55.448 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:55.449 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:55.449 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:55.450 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:55.450 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:55.450 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:55.451 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:55.451 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:55.451 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:55.442+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:55.454 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:55.454 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:55.549 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:55.542+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:55.582 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:55.582 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:55.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:36:55.650 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:55.644+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:55.751 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:55.746+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:55.760 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:55.760 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:55.775 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:36:55.852 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:55.848+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:55.940 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:55.941 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:55.953 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:55.948+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:55.957 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:36:55.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:36:56.055 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:36:56.048+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:36:56.088 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:56.088 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:56.102 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:36:56.155 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:56.148+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:56.221 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:56.222 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:56.235 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:36:56.282 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:56.278+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:56.352 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:56.352 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:56.357 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:56.350+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:56.366 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:36:56.458 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:56.454+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:56.535 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:56.536 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:56.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:36:56.594 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:56.590+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:56.659 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:56.654+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:56.716 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:56.717 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:56.730 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:36:56.774 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:56.770+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:56.860 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:56.854+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:56.899 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:56.899 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:56.913 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:36:56.958 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 6, 7, 0, 2] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:36:56.958 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:36:56.958 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-22T01:36:56.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-22T01:36:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:36:56.998 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:56.994+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:57.055 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone42 from 0x34b013f (overlap 0x23b379a) to 0x391f29 2024-09-22T01:36:57.060 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:57.054+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:57.096 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:57.096 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:57.116 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:36:57.161 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:57.156+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:57.259 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-22T01:36:57.262 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:57.258+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:57.279 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:57.280 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:57.289 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:57.289 INFO:teuthology.orchestra.run.smithi018.stdout:5670 read 0x15a2487 thru 0x15afe29 (0xd9a3 bytes) 2024-09-22T01:36:57.294 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout:moved 0 / 82 (0%) 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout:avg 11.7143 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 1.90595 -> 1.90595 (expected baseline 3.16872) 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 8 -> 8 pgs (0.682927 -> 0.682927 * mean) 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.7 with 15 -> 15 pgs (1.28049 -> 1.28049 * mean) 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout:oload 1000 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 3 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0014 2024-09-22T01:36:57.327 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0142 2024-09-22T01:36:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-09-22T01:36:57.329 INFO:teuthology.orchestra.run.smithi018.stdout:5671 writesame 0xc060f1c thru 0xc06f537 data_size 0x6(0xe61c bytes) 2024-09-22T01:36:57.334 INFO:teuthology.orchestra.run.smithi018.stdout:5672 trunc from 0xc06f538 to 0x8cfb6d7 2024-09-22T01:36:57.342 INFO:teuthology.orchestra.run.smithi018.stdout:5673 punch from 0x63aba84 to 0x63afa9f, (0x401b bytes) 2024-09-22T01:36:57.342 INFO:teuthology.orchestra.run.smithi018.stdout:5674 write 0x81cfbc7 thru 0x81df048 (0xf482 bytes) 2024-09-22T01:36:57.349 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-22T01:36:57.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-22T01:36:57.355 INFO:teuthology.orchestra.run.smithi018.stdout:5675 punch from 0x6087ace to 0x608c5f5, (0x4b27 bytes) 2024-09-22T01:36:57.355 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:57.355 INFO:teuthology.orchestra.run.smithi018.stdout:5677 write 0x2a68f24 thru 0x2a6c815 (0x38f2 bytes) 2024-09-22T01:36:57.363 INFO:teuthology.orchestra.run.smithi018.stdout:5678 read 0x6d1594b thru 0x6d22096 (0xc74c bytes) 2024-09-22T01:36:57.365 INFO:teuthology.orchestra.run.smithi018.stdout:5680 trunc from 0x8cfb6d7 to 0x981e9e0 2024-09-22T01:36:57.371 INFO:teuthology.orchestra.run.smithi018.stdout:5682 punch from 0x4b69644 to 0x4b75075, (0xba31 bytes) 2024-09-22T01:36:57.383 INFO:teuthology.orchestra.run.smithi018.stdout:5683 trunc from 0x981e9e0 to 0xf9202b 2024-09-22T01:36:57.386 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:57.382+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:57.464 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:57.458+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:57.473 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:36:57.476 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:57.476 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:57.479 INFO:teuthology.orchestra.run.smithi018.stdout:5684 trunc from 0xf9202b to 0x5b44fd6 2024-09-22T01:36:57.487 INFO:teuthology.orchestra.run.smithi018.stdout:5687 read 0x105be48 thru 0x106796f (0xbb28 bytes) 2024-09-22T01:36:57.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:36:57.508 INFO:teuthology.orchestra.run.smithi018.stdout:5688 write 0xdd6e9d5 thru 0xdd71be9 (0x3215 bytes) 2024-09-22T01:36:57.537 INFO:teuthology.orchestra.run.smithi018.stdout:5689 trunc from 0xdd71bea to 0x1ddefcb 2024-09-22T01:36:57.564 INFO:teuthology.orchestra.run.smithi018.stdout:5690 write 0x6e58fb1 thru 0x6e5cf36 (0x3f86 bytes) 2024-09-22T01:36:57.565 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:36:57.560+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:36:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:5694 read 0x5cc71f6 thru 0x5ccdc5a (0x6a65 bytes) 2024-09-22T01:36:57.577 INFO:teuthology.orchestra.run.smithi018.stdout:5695 clone 44 order 18 su 4096 sc 12 2024-09-22T01:36:57.627 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:36:57.627 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:36:57.636 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:57.636 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:57.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:36:57.653 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:57.654 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:57.666 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:57.662+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:57.670 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:57.670 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:57.690 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:57.690 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:36:57.710 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:36:57.710 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:36:57.731 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:36:57.732 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:36:57.755 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:36:57.755 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:36:57.767 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:57.762+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:57.771 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:57.771 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:57.771 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:57.771 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:57.771 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:57.775 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:36:57.775 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:36:57.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:36:57.880 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:57.876+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:57.965 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:57.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:57.965 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:57.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.965 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48656 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 649216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:57.965 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:57.965 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.49005161700001, 2024-09-22T01:36:57.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086873840999999993, 2024-09-22T01:36:57.965 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48656 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470670+0000", 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470672+0000", 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2330000000000001e-06 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470679+0000", 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3189999999999997e-06 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470709+0000", 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0579e-05 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470724+0000", 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4386000000000001e-05 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557428+0000", 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086703889000000006 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557483+0000", 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5424999999999999e-05 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557544+0000", 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.101e-05 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48657 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 659456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:57.969 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.489977207, 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087076924, 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48657 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:57.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470745+0000", 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470746+0000", 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4e-07 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470752+0000", 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0290000000000002e-06 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470771+0000", 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9193000000000001e-05 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470785+0000", 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3653e-05 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557608+0000", 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086823877999999993 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557703+0000", 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-05 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557822+0000", 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118231 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.973 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48658 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 669696~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.489920676, 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087157929999999995, 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:57.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48658 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470801+0000", 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470802+0000", 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0330000000000001e-06 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470808+0000", 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2429999999999996e-06 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470824+0000", 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6426000000000002e-05 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:57.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470840+0000", 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5569999999999998e-05 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557841+0000", 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087001021999999997 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557890+0000", 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9589000000000002e-05 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:57.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.557959+0000", 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9047000000000005e-05 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48659 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.489863082, 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087373820000000005, 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:57.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48659 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470859+0000", 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470860+0000", 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1399999999999995e-07 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470866+0000", 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4760000000000003e-06 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470885+0000", 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9123e-05 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470898+0000", 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2401999999999999e-05 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558026+0000", 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087127982000000007 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558119+0000", 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3344000000000006e-05 2024-09-22T01:36:57.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558233+0000", 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000113579 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48660 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 690176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.48980574399999, 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087452650000000007, 2024-09-22T01:36:57.982 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48660 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470916+0000", 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470918+0000", 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.497e-06 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470923+0000", 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.3190000000000002e-06 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470940+0000", 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6855999999999999e-05 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470952+0000", 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2386e-05 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558251+0000", 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087298464000000006 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558302+0000", 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1227999999999998e-05 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558369+0000", 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.69e-05 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48661 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 700416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:57.986 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.489748303, 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087670417, 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48661 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:57.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470974+0000", 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470975+0000", 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2600000000000001e-07 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:57.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470981+0000", 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0399999999999998e-06 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470991+0000", 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0607e-05 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.470998+0000", 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0160000000000003e-06 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:57.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558436+0000", 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087437340000000002 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558526+0000", 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0348999999999998e-05 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558644+0000", 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118139 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:57.990 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48662 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 710656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.48971239399999, 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087769047000000003, 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48662 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:57.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471010+0000", 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2600000000000001e-07 2024-09-22T01:36:57.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471026+0000", 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5509e-05 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471038+0000", 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1776999999999999e-05 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.471047+0000", 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:36:57.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558662+0000", 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087614866 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558716+0000", 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4657999999999997e-05 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.558779+0000", 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2188999999999997e-05 2024-09-22T01:36:57.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48752 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 651264~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.484668696, 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087046058999999995, 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:57.995 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48752 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476053+0000", 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476054+0000", 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.11e-06 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476061+0000", 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1770000000000003e-06 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476080+0000", 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9712e-05 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476097+0000", 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7229000000000001e-05 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562880+0000", 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086782661999999997 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.562970+0000", 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9481999999999995e-05 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563099+0000", 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012968699999999999 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48753 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 661504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.48460525500001, 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087121632000000004, 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:57.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48753 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476117+0000", 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476118+0000", 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9699999999999994e-07 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476123+0000", 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9989999999999999e-06 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476141+0000", 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7816e-05 2024-09-22T01:36:58.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476155+0000", 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4389999999999999e-05 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563120+0000", 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.086964628000000002 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563180+0000", 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0331999999999998e-05 2024-09-22T01:36:58.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563238+0000", 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-05 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48754 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 671744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.48455001799999, 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087318613000000003, 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48754 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476172+0000", 2024-09-22T01:36:58.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476173+0000", 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7000000000000003e-07 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476178+0000", 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2800000000000003e-06 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476195+0000", 2024-09-22T01:36:58.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6325999999999999e-05 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476226+0000", 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1962000000000003e-05 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563294+0000", 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087067444999999993 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563383+0000", 2024-09-22T01:36:58.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8996e-05 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563491+0000", 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010763400000000001 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48755 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 681984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.484476704, 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087365591000000006, 2024-09-22T01:36:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48755 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476245+0000", 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476246+0000", 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499999999999999e-06 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476252+0000", 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7899999999999996e-06 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476270+0000", 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8031999999999999e-05 2024-09-22T01:36:58.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476284+0000", 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3487e-05 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563507+0000", 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087223700000000001 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563553+0000", 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5778000000000001e-05 2024-09-22T01:36:58.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563611+0000", 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7754000000000003e-05 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48756 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 692224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.484422623, 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087557100999999998, 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48756 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476299+0000", 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476300+0000", 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5999999999999991e-07 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476305+0000", 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9200000000000003e-06 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476323+0000", 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7348999999999999e-05 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476336+0000", 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3667e-05 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563671+0000", 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087334432000000004 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563753+0000", 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2060999999999999e-05 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563856+0000", 2024-09-22T01:36:58.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103712 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48757 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 702464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.48436818499999, 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087644437000000006, 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48757 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476354+0000", 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476355+0000", 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0139999999999999e-06 2024-09-22T01:36:58.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476361+0000", 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9789999999999998e-06 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476379+0000", 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7785999999999999e-05 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476392+0000", 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3436e-05 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563875+0000", 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087482940999999995 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563926+0000", 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1221000000000003e-05 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.563998+0000", 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2059999999999998e-05 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:48758 3.8 3:16142b91:::rbd_data.110fdce50b12.0000000000000070:8 [read 712704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36)", 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 109.484312324, 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087826846, 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 48758 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.019 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476410+0000", 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476424+0000", 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3463e-05 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476439+0000", 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5259000000000001e-05 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.476447+0000", 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6129999999999998e-06 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564057+0000", 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.087610002000000006 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564134+0000", 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7763999999999996e-05 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:08.564236+0000", 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010197800000000001 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93498 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.384145566000001, 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93801259999999997, 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93498 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576576+0000", 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576580+0000", 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8600000000000003e-06 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576600+0000", 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9746e-05 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576650+0000", 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0419e-05 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.576678+0000", 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7858999999999999e-05 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580737+0000", 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0040585939999999996 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.580754+0000", 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7102e-05 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514561+0000", 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93380681700000001 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514589+0000", 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8203000000000001e-05 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:93499 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 55.381279853000002, 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93524844100000004, 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:58.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 93499 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579442+0000", 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579444+0000", 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2369999999999999e-06 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579455+0000", 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0655e-05 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579486+0000", 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1473999999999997e-05 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.579506+0000", 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9513000000000001e-05 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581124+0000", 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016177050000000001 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:02.581135+0000", 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1534e-05 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514663+0000", 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.93352768399999997 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:03.514691+0000", 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7639000000000001e-05 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94339 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch reconnect cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:58.031 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.338902621000003, 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0158427670000001, 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94339 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621819+0000", 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621821+0000", 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.55e-06 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621827+0000", 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1299999999999998e-06 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621843+0000", 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5542000000000001e-05 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621853+0000", 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0445000000000001e-05 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621924+0000", 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1262999999999999e-05 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.621936+0000", 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.131e-05 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625444+0000", 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0035085479999999 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.625845+0000", 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00040067999999999999 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.637662+0000", 2024-09-22T01:36:58.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.011817299 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94342 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [notify cookie 140215384087984] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.324732451999999, 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99234641400000001, 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94342 2024-09-22T01:36:58.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635989+0000", 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.635992+0000", 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.12e-06 2024-09-22T01:36:58.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636002+0000", 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636032+0000", 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0463e-05 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636053+0000", 2024-09-22T01:36:58.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1002999999999999e-05 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636187+0000", 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013359299999999999 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.636206+0000", 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9327e-05 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627756+0000", 2024-09-22T01:36:58.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.99154943799999995 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.627997+0000", 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024163200000000001 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628336+0000", 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00033850200000000002 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:94343 3.1b 3:de6891f9:::rbd_header.110f34a7153d:head [watch ping cookie 140215381662816 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-09-22T01:36:58.040 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 51.252564585999998, 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92041710600000004, 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 94343 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708157+0000", 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708160+0000", 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8559999999999998e-06 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708178+0000", 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.73e-05 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708212+0000", 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4573000000000003e-05 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708238+0000", 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5792e-05 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708344+0000", 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000106508 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:06.708357+0000", 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2183e-05 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628387+0000", 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.92003072600000002 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628449+0000", 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1828000000000005e-05 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:07.628574+0000", 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012533999999999999 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:95531 3.8 3:11293fc5:::rbd_object_map.110f30608ae1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e89)", 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.313555231999999, 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.012680681, 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.045 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 95531 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647167+0000", 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647169+0000", 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9649999999999998e-06 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647177+0000", 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0439999999999996e-06 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647196+0000", 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.9400000000000001e-05 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647204+0000", 2024-09-22T01:36:58.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647266+0000", 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2117000000000002e-05 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op must wait for map", 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.647275+0000", 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0679999999999997e-06 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651032+0000", 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0037574980000000002 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:11.651044+0000", 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.204e-05 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659538+0000", 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0084937460000001 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:12.659847+0000", 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000309587 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.050 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.050 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:58.050 INFO:teuthology.orchestra.run.smithi018.stdout:moved 1 / 82 (1.21951%) 2024-09-22T01:36:58.050 INFO:teuthology.orchestra.run.smithi018.stdout:avg 11.7143 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 1.90595 -> 1.97949 (expected baseline 3.16872) 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 8 -> 8 pgs (0.682927 -> 0.682927 * mean) 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.7 with 15 -> 15 pgs (1.28049 -> 1.28049 * mean) 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 0.05 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0014 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0016 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 weight 1.0000 -> 0.9500 2024-09-22T01:36:58.051 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 weight 1.0000 -> 0.9500 2024-09-22T01:36:58.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:36:58.053 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-22T01:36:58.053 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2024-09-22T01:36:58.053 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:58.046+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:58.126 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone43 from 0x6e5cf37 (overlap 0xf9202b) to 0x18e99d 2024-09-22T01:36:58.172 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:58.164+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:58.252 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:58.246+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:58.266 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:58.266 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:58.266 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:58.266 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:58.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:36:58.372 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:58.368+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:58.440 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:58.440 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:58.440 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:58.440 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:58.440 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:58.454 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:36:58.454 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:58.448+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:58.518 INFO:teuthology.orchestra.run.smithi018.stdout:moved 0 / 82 (0%) 2024-09-22T01:36:58.518 INFO:teuthology.orchestra.run.smithi018.stdout:avg 11.7143 2024-09-22T01:36:58.518 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 1.97949 -> 1.97949 (expected baseline 3.16872) 2024-09-22T01:36:58.519 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 8 -> 8 pgs (0.682927 -> 0.682927 * mean) 2024-09-22T01:36:58.519 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.7 with 15 -> 15 pgs (1.28049 -> 1.28049 * mean) 2024-09-22T01:36:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:36:58.519 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-09-22T01:36:58.519 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 0.05 2024-09-22T01:36:58.519 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-22T01:36:58.519 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0014 2024-09-22T01:36:58.519 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0016 2024-09-22T01:36:58.519 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 weight 0.9500 -> 0.9000 2024-09-22T01:36:58.519 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3 weight 0.9500 -> 0.9000 2024-09-22T01:36:58.550 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-22T01:36:58.550 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2024-09-22T01:36:58.555 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:58.550+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:58.637 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:58.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.834911301000005, 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.638 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.834856125000002, 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:36:58.643 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.834791011999997, 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.649 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:36:58.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:36:58.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:36:58.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.834725265000003, 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.834687794999994, 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:36:58.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.834637178999998, 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.666 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:36:58.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.833451839999995, 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.833390012999999, 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:36:58.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:36:58.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:36:58.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.833341214000001, 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.833267660999994, 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.688 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:36:58.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:36:58.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:36:58.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.693 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.833197198999997, 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.833126695999994, 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.833079463999994, 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.705 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:36:58.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:36:58.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:36:58.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:36:58.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.833016588000007, 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:36:58.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:36:58.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.832975922000003, 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:36:58.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.832881055000001, 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:36:58.721 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:36:58.726 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.832840017999999, 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.727 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:36:58.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.732 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.832802526999998, 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.733 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:36:58.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:36:58.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.832762377999998, 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:58.743 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 89.832719582999999, 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:58.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:36:58.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:36:58.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:36:58.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:36:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:58.749 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:58.749 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:58.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:36:58.751 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:36:58.744+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:36:58.851 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:58.846+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:58.902 INFO:teuthology.orchestra.run.smithi018.stdout:moved 0 / 82 (0%) 2024-09-22T01:36:58.902 INFO:teuthology.orchestra.run.smithi018.stdout:avg 11.7143 2024-09-22T01:36:58.902 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 1.97949 -> 1.97949 (expected baseline 3.16872) 2024-09-22T01:36:58.902 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 8 -> 8 pgs (0.682927 -> 0.682927 * mean) 2024-09-22T01:36:58.902 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.7 with 15 -> 15 pgs (1.28049 -> 1.28049 * mean) 2024-09-22T01:36:58.902 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:36:58.902 INFO:teuthology.orchestra.run.smithi018.stdout:oload 1000 2024-09-22T01:36:58.903 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 1 2024-09-22T01:36:58.903 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-22T01:36:58.903 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0014 2024-09-22T01:36:58.903 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0142 2024-09-22T01:36:58.903 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-09-22T01:36:58.918 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:58.918 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:58.918 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:58.922 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-22T01:36:58.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-09-22T01:36:58.933 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:36:58.980 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:58.976+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:58.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:36:59.053 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:59.046+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:59.114 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:59.115 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:59.115 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:59.131 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:36:59.153 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:59.146+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout:moved 0 / 82 (0%) 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout:avg 11.7143 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 1.97949 -> 1.97949 (expected baseline 3.16872) 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 8 -> 8 pgs (0.682927 -> 0.682927 * mean) 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.7 with 15 -> 15 pgs (1.28049 -> 1.28049 * mean) 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout:oload 1000 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 1 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0014 2024-09-22T01:36:59.251 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0142 2024-09-22T01:36:59.252 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.834059412999999, 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.834029223999998, 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.257 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:36:59.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:36:59.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:36:59.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.83400013, 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:36:59.261 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:36:59.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.265 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833970505000003, 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833920612, 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833888901999998, 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.274 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:36:59.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833859463000003, 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.278 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:36:59.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:36:59.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833830007000003, 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.282 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833799984000002, 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.286 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:36:59.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:36:59.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833754571, 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:36:59.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:36:59.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.293 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833725002000001, 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:36:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:36:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:36:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:36:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833695192, 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:36:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:36:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:36:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833665906, 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:36:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:36:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833632600000001, 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:36:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833602694, 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833572910999997, 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:36:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833509094999997, 2024-09-22T01:36:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:36:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:36:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:36:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833474158999998, 2024-09-22T01:36:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:36:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:36:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:36:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833444419000003, 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:36:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:36:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:36:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 32.833414292999997, 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:36:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:36:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:36:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.338 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:59.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:36:59.341 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:36:59.334+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:36:59.441 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:59.434+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:59.505 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:59.505 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:36:59.505 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:59.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:36:59.523 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:36:59.557 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:36:59.548+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:36:59.642 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:59.638+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:59.679 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:36:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:36:59.680 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:36:59.680 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:59.705 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:36:59.743 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:36:59.738+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:36:59.794 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:36:59.844 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:36:59.838+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:36:59.851 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.724031467, 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.852 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:36:59.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:36:59.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.72400573100001, 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:36:59.856 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:36:59.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:36:59.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723979949, 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.860 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:36:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:36:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:36:59.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:36:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:36:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:36:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:36:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:36:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.72393503000001, 2024-09-22T01:36:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:36:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.866 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:36:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:36:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:36:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:36:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:36:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:36:59.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:36:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:36:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:36:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:36:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:36:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:36:59.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:36:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:36:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723902874, 2024-09-22T01:36:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:36:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.873 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:36:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.874 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:36:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:36:59.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:36:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:36:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:36:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:36:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:36:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:36:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:36:59.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:36:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:36:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:36:59.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:36:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723875142, 2024-09-22T01:36:59.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:36:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.881 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:36:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:36:59.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:36:59.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723839318, 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:36:59.885 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:36:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.889 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723803174, 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:36:59.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723766969, 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.894 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.897 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.72373961700001, 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.898 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:59.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:36:59.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:36:59.901 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723702539, 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.902 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:59.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:36:59.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:36:59.905 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723679002, 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.906 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.907 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:36:59.908 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.909 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723131802, 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.910 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.911 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:36:59.912 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:59.913 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723104045, 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.914 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.915 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.916 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:59.917 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.723081979, 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.918 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:36:59.919 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.920 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.72305181900001, 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:36:59.921 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:59.922 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:36:59.923 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.924 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.722631329, 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:36:59.925 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.927 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:36:59.928 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.722605548, 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:36:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:36:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:36:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:36:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 114.72258428000001, 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 11.311578884999999, 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:36:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:36:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:36:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:36:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:36:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:36:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:36:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:36:59.942 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:36:59.943 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:36:59.944 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #42, image image_client.0-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent43 2024-09-22T01:36:59.944 INFO:teuthology.orchestra.run.smithi018.stdout:5697 writesame 0xaf8c7cd thru 0xaf9a5d3 data_size 0x1(0xde07 bytes) 2024-09-22T01:36:59.944 INFO:teuthology.orchestra.run.smithi018.stdout:5698 trunc from 0xaf9a5d4 to 0x9789049 2024-09-22T01:36:59.944 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:36:59.944 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:36:59.945 INFO:teuthology.orchestra.run.smithi018.stdout:5699 read 0x33fcdbc thru 0x34074aa (0xa6ef bytes) 2024-09-22T01:36:59.946 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:36:59.942+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:36:59.947 INFO:teuthology.orchestra.run.smithi018.stdout:5701 trunc from 0x9789049 to 0xe7fedc8 2024-09-22T01:36:59.951 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:36:59.951 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:36:59.957 INFO:teuthology.orchestra.run.smithi018.stdout:5702 punch from 0x9758e29 to 0x9760956, (0x7b2d bytes) 2024-09-22T01:36:59.957 INFO:teuthology.orchestra.run.smithi018.stdout:5703 read 0x3dece70 thru 0x3deeb53 (0x1ce4 bytes) 2024-09-22T01:36:59.957 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:36:59.958 INFO:teuthology.orchestra.run.smithi018.stdout:5707 writesame 0x4416139 thru 0x441a400 data_size 0x4(0x42c8 bytes) 2024-09-22T01:36:59.965 INFO:teuthology.orchestra.run.smithi018.stdout:5708 read 0xd034cab thru 0xd03c2f2 (0x7648 bytes) 2024-09-22T01:36:59.965 INFO:teuthology.orchestra.run.smithi018.stdout:5709 read 0xb04c7f4 thru 0xb057451 (0xac5e bytes) 2024-09-22T01:36:59.965 INFO:teuthology.orchestra.run.smithi018.stdout:5710 punch from 0xab2533b to 0xab2d4a5, (0x816a bytes) 2024-09-22T01:36:59.965 INFO:teuthology.orchestra.run.smithi018.stdout:5711 write 0xb7b82fa thru 0xb7bf83f (0x7546 bytes) 2024-09-22T01:36:59.975 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:36:59.975 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:36:59.976 INFO:teuthology.orchestra.run.smithi018.stdout:5714 writesame 0xd89889 thru 0xd9032e data_size 0x22(0x6aa6 bytes) 2024-09-22T01:36:59.996 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:36:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:00.020 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:00.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:00.038 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:00.038 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:00.046 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:00.040+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:00.058 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:00.058 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:00.061 INFO:teuthology.orchestra.run.smithi018.stdout:5715 read 0x2a75539 thru 0x2a77bc3 (0x268b bytes) 2024-09-22T01:37:00.061 INFO:teuthology.orchestra.run.smithi018.stdout:5717 write 0x73e8f83 thru 0x73f4cc0 (0xbd3e bytes) 2024-09-22T01:37:00.075 INFO:teuthology.orchestra.run.smithi018.stdout:5718 read 0x157303e thru 0x157ce49 (0x9e0c bytes) 2024-09-22T01:37:00.076 INFO:teuthology.orchestra.run.smithi018.stdout:5722 read 0x6af2345 thru 0x6afff7a (0xdc36 bytes) 2024-09-22T01:37:00.076 INFO:teuthology.orchestra.run.smithi018.stdout:5724 punch from 0x9977f66 to 0x9986d0d, (0xeda7 bytes) 2024-09-22T01:37:00.076 INFO:teuthology.orchestra.run.smithi018.stdout:5726 read 0x3e1a37a thru 0x3e28849 (0xe4d0 bytes) 2024-09-22T01:37:00.076 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.076 INFO:teuthology.orchestra.run.smithi018.stdout:5730 write 0x6ad863a thru 0x6adb8da (0x32a1 bytes) 2024-09-22T01:37:00.083 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:00.083 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:00.083 INFO:teuthology.orchestra.run.smithi018.stdout:5732 writesame 0x907af5b thru 0x90850dd data_size 0x1(0xa183 bytes) 2024-09-22T01:37:00.101 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.101 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.101 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.101 INFO:teuthology.orchestra.run.smithi018.stdout:5736 writesame 0xcfda4e0 thru 0xcfe336d data_size 0x2(0x8e8e bytes) 2024-09-22T01:37:00.106 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:00.107 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:00.115 INFO:teuthology.orchestra.run.smithi018.stdout:5737 writesame 0xaf62ab4 thru 0xaf6b9b6 data_size 0x1(0x8f03 bytes) 2024-09-22T01:37:00.123 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:00.129 INFO:teuthology.orchestra.run.smithi018.stdout:5739 write 0x32e0163 thru 0x32f0111 (0xffaf bytes) 2024-09-22T01:37:00.144 INFO:teuthology.orchestra.run.smithi018.stdout:5741 write 0x1fd78c9 thru 0x1fe42f6 (0xca2e bytes) 2024-09-22T01:37:00.147 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:00.140+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:00.158 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.158 INFO:teuthology.orchestra.run.smithi018.stdout:5745 read 0xd980d40 thru 0xd98695f (0x5c20 bytes) 2024-09-22T01:37:00.158 INFO:teuthology.orchestra.run.smithi018.stdout:5746 writesame 0x3a3d92e thru 0x3a427bd data_size 0x4(0x4e90 bytes) 2024-09-22T01:37:00.166 INFO:teuthology.orchestra.run.smithi018.stdout:5747 punch from 0x74ec26a to 0x74ec7ce, (0x564 bytes) 2024-09-22T01:37:00.167 INFO:teuthology.orchestra.run.smithi018.stdout:5748 write 0x288ad57 thru 0x28989f6 (0xdca0 bytes) 2024-09-22T01:37:00.181 INFO:teuthology.orchestra.run.smithi018.stdout:5749 read 0x9526bc7 thru 0x9533485 (0xc8bf bytes) 2024-09-22T01:37:00.181 INFO:teuthology.orchestra.run.smithi018.stdout:5750 write 0xb5cecdf thru 0xb5d5478 (0x679a bytes) 2024-09-22T01:37:00.190 INFO:teuthology.orchestra.run.smithi018.stdout:5751 read 0x405955 thru 0x40f31e (0x99ca bytes) 2024-09-22T01:37:00.191 INFO:teuthology.orchestra.run.smithi018.stdout:5754 write 0xe79f29f thru 0xe7a5456 (0x61b8 bytes) 2024-09-22T01:37:00.199 INFO:teuthology.orchestra.run.smithi018.stdout:5756 write 0xb87ff33 thru 0xb88ede9 (0xeeb7 bytes) 2024-09-22T01:37:00.206 INFO:teuthology.orchestra.run.smithi018.stdout:5757 trunc from 0xe7fedc8 to 0xe02ca94 2024-09-22T01:37:00.216 INFO:teuthology.orchestra.run.smithi018.stdout:5758 read 0x42de1d3 thru 0x42e93fa (0xb228 bytes) 2024-09-22T01:37:00.217 INFO:teuthology.orchestra.run.smithi018.stdout:5759 write 0xaca3a90 thru 0xacae57d (0xaaee bytes) 2024-09-22T01:37:00.238 INFO:teuthology.orchestra.run.smithi018.stdout:5761 trunc from 0xe02ca94 to 0x7ead7fe 2024-09-22T01:37:00.248 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:00.244+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:00.256 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:00.257 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:00.264 INFO:teuthology.orchestra.run.smithi018.stdout:5764 read 0xb23dc3 thru 0xb29e9d (0x60db bytes) 2024-09-22T01:37:00.272 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:00.275 INFO:teuthology.orchestra.run.smithi018.stdout:5765 writesame 0xafc935c thru 0xafd7262 data_size 0x13(0xdf07 bytes) 2024-09-22T01:37:00.275 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.284 INFO:teuthology.orchestra.run.smithi018.stdout:5767 writesame 0xcf5cbfa thru 0xcf67564 data_size 0x3d(0xa96b bytes) 2024-09-22T01:37:00.284 INFO:teuthology.orchestra.run.smithi018.stdout:5769 writesame 0x50b3577 thru 0x50c11bb data_size 0x11(0xdc45 bytes) 2024-09-22T01:37:00.301 INFO:teuthology.orchestra.run.smithi018.stdout:5773 trunc from 0xcf67565 to 0xb6090bd 2024-09-22T01:37:00.308 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.308 INFO:teuthology.orchestra.run.smithi018.stdout:5775 write 0x6570126 thru 0x657e8f4 (0xe7cf bytes) 2024-09-22T01:37:00.324 INFO:teuthology.orchestra.run.smithi018.stdout:5777 punch from 0x76364d2 to 0x7646072, (0xfba0 bytes) 2024-09-22T01:37:00.334 INFO:teuthology.orchestra.run.smithi018.stdout:5780 write 0xe2dc47a thru 0xe2e9176 (0xccfd bytes) 2024-09-22T01:37:00.348 INFO:teuthology.orchestra.run.smithi018.stdout:5781 writesame 0x9ff5acb thru 0xa003c4c data_size 0x73(0xe182 bytes) 2024-09-22T01:37:00.349 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:00.342+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:00.363 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.363 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.363 INFO:teuthology.orchestra.run.smithi018.stdout:5786 punch from 0x7eb4616 to 0x7eba50b, (0x5ef5 bytes) 2024-09-22T01:37:00.363 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.363 INFO:teuthology.orchestra.run.smithi018.stdout:5788 write 0x1395dc3 thru 0x1398ba9 (0x2de7 bytes) 2024-09-22T01:37:00.378 INFO:teuthology.orchestra.run.smithi018.stdout:5789 read 0x42fd924 thru 0x43086d8 (0xadb5 bytes) 2024-09-22T01:37:00.380 INFO:teuthology.orchestra.run.smithi018.stdout:5790 trunc from 0xe2e9177 to 0xc95d24b 2024-09-22T01:37:00.394 INFO:teuthology.orchestra.run.smithi018.stdout:5791 write 0x5dfc12c thru 0x5dfc8a1 (0x776 bytes) 2024-09-22T01:37:00.397 INFO:teuthology.orchestra.run.smithi018.stdout:5793 punch from 0x1c7c002 to 0x1c81c76, (0x5c74 bytes) 2024-09-22T01:37:00.397 INFO:teuthology.orchestra.run.smithi018.stdout:5795 write 0xb23e80c thru 0xb24e0bd (0xf8b2 bytes) 2024-09-22T01:37:00.407 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:00.408 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:00.411 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.411 INFO:teuthology.orchestra.run.smithi018.stdout:5798 read 0x8070b5f thru 0x8072665 (0x1b07 bytes) 2024-09-22T01:37:00.411 INFO:teuthology.orchestra.run.smithi018.stdout:5799 write 0x1381935 thru 0x1382fdf (0x16ab bytes) 2024-09-22T01:37:00.419 INFO:teuthology.orchestra.run.smithi018.stdout:5800 write 0x5ad97e3 thru 0x5ae0675 (0x6e93 bytes) 2024-09-22T01:37:00.425 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:00.430 INFO:teuthology.orchestra.run.smithi018.stdout:5801 punch from 0xb00fdb to 0xb0f683, (0xe6a8 bytes) 2024-09-22T01:37:00.430 INFO:teuthology.orchestra.run.smithi018.stdout:5802 read 0x2850b2a thru 0x2857e98 (0x736f bytes) 2024-09-22T01:37:00.435 INFO:teuthology.orchestra.run.smithi018.stdout:5803 trunc from 0xc95d24b to 0x8d2792c 2024-09-22T01:37:00.449 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:00.444+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:00.451 INFO:teuthology.orchestra.run.smithi018.stdout:5804 read 0x61212e7 thru 0x612b558 (0xa272 bytes) 2024-09-22T01:37:00.451 INFO:teuthology.orchestra.run.smithi018.stdout:5805 read 0x13c0870 thru 0x13cd8f3 (0xd084 bytes) 2024-09-22T01:37:00.452 INFO:teuthology.orchestra.run.smithi018.stdout:5806 write 0x15a84ac thru 0x15af028 (0x6b7d bytes) 2024-09-22T01:37:00.463 INFO:teuthology.orchestra.run.smithi018.stdout:5807 writesame 0x4af4ddc thru 0x4afe242 data_size 0x1(0x9467 bytes) 2024-09-22T01:37:00.479 INFO:teuthology.orchestra.run.smithi018.stdout:5809 writesame 0x690b622 thru 0x690e760 data_size 0x1(0x313f bytes) 2024-09-22T01:37:00.487 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:00.487 INFO:teuthology.orchestra.run.smithi018.stdout:5811 punch from 0x14157d0 to 0x141f8f4, (0xa124 bytes) 2024-09-22T01:37:00.490 INFO:teuthology.orchestra.run.smithi018.stdout:5812 trunc from 0x8d2792c to 0xb482df1 2024-09-22T01:37:00.497 INFO:teuthology.orchestra.run.smithi018.stdout:5814 punch from 0xa7c226c to 0xa7c921e, (0x6fb2 bytes) 2024-09-22T01:37:00.497 INFO:teuthology.orchestra.run.smithi018.stdout:5815 punch from 0x93eff5 to 0x94769d, (0x86a8 bytes) 2024-09-22T01:37:00.497 INFO:teuthology.orchestra.run.smithi018.stdout:5816 write 0x6dd962b thru 0x6de89b8 (0xf38e bytes) 2024-09-22T01:37:00.514 INFO:teuthology.orchestra.run.smithi018.stdout:5817 read 0x9ccca9e thru 0x9cdb470 (0xe9d3 bytes) 2024-09-22T01:37:00.514 INFO:teuthology.orchestra.run.smithi018.stdout:5818 punch from 0x8300344 to 0x830c92e, (0xc5ea bytes) 2024-09-22T01:37:00.522 INFO:teuthology.orchestra.run.smithi018.stdout:5819 trunc from 0xb482df1 to 0x55be201 2024-09-22T01:37:00.550 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:00.544+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:00.592 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:00.592 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:00.606 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:00.651 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:00.644+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:00.727 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:00.727 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:00.741 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:00.786 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:00.782+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:00.854 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:00.848+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:00.865 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:00.866 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:00.879 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:00.966 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:00.962+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:01.039 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:01.039 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:01.053 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:01.094 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:01.090+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:01.156 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:01.152+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:01.217 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:01.217 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:01.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:01.257 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:01.252+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:01.353 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:01.353 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:01.357 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:01.352+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:01.368 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:01.458 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:01.456+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:01.492 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:01.492 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:01.506 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:01.554 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:37:01.558 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:01.554+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:01.585 INFO:teuthology.orchestra.run.smithi018.stdout:5821 read 0x1c3832 thru 0x1c9b7d (0x634c bytes) 2024-09-22T01:37:01.586 INFO:teuthology.orchestra.run.smithi018.stdout:5822 write 0x2738168 thru 0x273e21a (0x60b3 bytes) 2024-09-22T01:37:01.590 INFO:teuthology.orchestra.run.smithi018.stdout:5823 write 0x96a9ff thru 0x97407c (0x967e bytes) 2024-09-22T01:37:01.658 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:01.658 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:01.659 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:01.654+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:01.674 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:01.716 INFO:teuthology.orchestra.run.smithi018.stdout:5827 punch from 0x24d99e0 to 0x24e6266, (0xc886 bytes) 2024-09-22T01:37:01.716 INFO:teuthology.orchestra.run.smithi018.stdout:5828 punch from 0x4047370 to 0x404d85d, (0x64ed bytes) 2024-09-22T01:37:01.716 INFO:teuthology.orchestra.run.smithi018.stdout:5829 read 0x26449c7 thru 0x264d5e2 (0x8c1c bytes) 2024-09-22T01:37:01.726 INFO:teuthology.orchestra.run.smithi018.stdout:5831 trunc from 0x55be201 to 0xbaaa8d3 2024-09-22T01:37:01.738 INFO:teuthology.orchestra.run.smithi018.stdout:5832 trunc from 0xbaaa8d3 to 0x834e379 2024-09-22T01:37:01.747 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:01.758 INFO:teuthology.orchestra.run.smithi018.stdout:5834 trunc from 0x834e379 to 0x47f094 2024-09-22T01:37:01.759 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:01.752+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:01.860 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:01.854+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:01.869 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:01.869 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:01.872 INFO:teuthology.orchestra.run.smithi018.stdout:5835 read 0x16a2b4 thru 0x176be3 (0xc930 bytes) 2024-09-22T01:37:01.873 INFO:teuthology.orchestra.run.smithi018.stdout:5836 read 0x285493 thru 0x29046c (0xafda bytes) 2024-09-22T01:37:01.874 INFO:teuthology.orchestra.run.smithi018.stdout:5837 read 0x29fd thru 0x4299 (0x189d bytes) 2024-09-22T01:37:01.874 INFO:teuthology.orchestra.run.smithi018.stdout:5838 read 0x1ad6a8 thru 0x1bc320 (0xec79 bytes) 2024-09-22T01:37:01.876 INFO:teuthology.orchestra.run.smithi018.stdout:5840 read 0x376cfa thru 0x380949 (0x9c50 bytes) 2024-09-22T01:37:01.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:01.898 INFO:teuthology.orchestra.run.smithi018.stdout:5843 trunc from 0x47f094 to 0xecca1dd 2024-09-22T01:37:01.905 INFO:teuthology.orchestra.run.smithi018.stdout:5844 write 0x371de13 thru 0x372bda4 (0xdf92 bytes) 2024-09-22T01:37:01.924 INFO:teuthology.orchestra.run.smithi018.stdout:5846 read 0xb136670 thru 0xb13a276 (0x3c07 bytes) 2024-09-22T01:37:01.924 INFO:teuthology.orchestra.run.smithi018.stdout:5847 write 0x8032aae thru 0x8035540 (0x2a93 bytes) 2024-09-22T01:37:01.931 INFO:teuthology.orchestra.run.smithi018.stdout:5849 read 0x58fb59 thru 0x593a13 (0x3ebb bytes) 2024-09-22T01:37:01.931 INFO:teuthology.orchestra.run.smithi018.stdout:5850 write 0x36c680b thru 0x36cf636 (0x8e2c bytes) 2024-09-22T01:37:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:5851 read 0x3640f7d thru 0x3648987 (0x7a0b bytes) 2024-09-22T01:37:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:5852 read 0x71abdad thru 0x71b48df (0x8b33 bytes) 2024-09-22T01:37:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:5853 read 0xe4efcec thru 0xe4fafde (0xb2f3 bytes) 2024-09-22T01:37:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:5854 read 0xe6d103f thru 0xe6d2f70 (0x1f32 bytes) 2024-09-22T01:37:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:5856 read 0xc60eee0 thru 0xc61ad26 (0xbe47 bytes) 2024-09-22T01:37:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:5857 write 0x3852cb thru 0x38eec2 (0x9bf8 bytes) 2024-09-22T01:37:01.940 INFO:teuthology.orchestra.run.smithi018.stdout:5858 read 0x63d956d thru 0x63e2539 (0x8fcd bytes) 2024-09-22T01:37:01.941 INFO:teuthology.orchestra.run.smithi018.stdout:5859 write 0x6f0d8ea thru 0x6f147fd (0x6f14 bytes) 2024-09-22T01:37:01.954 INFO:teuthology.orchestra.run.smithi018.stdout:5860 write 0x595831 thru 0x598156 (0x2926 bytes) 2024-09-22T01:37:01.961 INFO:teuthology.orchestra.run.smithi018.stdout:5861 read 0x8ccd61a thru 0x8cd3d30 (0x6717 bytes) 2024-09-22T01:37:01.961 INFO:teuthology.orchestra.run.smithi018.stdout:5863 read 0xd1c959 thru 0xd1f6c2 (0x2d6a bytes) 2024-09-22T01:37:01.961 INFO:teuthology.orchestra.run.smithi018.stdout:5864 trunc from 0xecca1dd to 0xd257eb5 2024-09-22T01:37:01.961 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:01.956+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:01.967 INFO:teuthology.orchestra.run.smithi018.stdout:5865 read 0x9ec848 thru 0x9f1492 (0x4c4b bytes) 2024-09-22T01:37:01.967 INFO:teuthology.orchestra.run.smithi018.stdout:5866 writesame 0xcc9e968 thru 0xcca217b data_size 0x4(0x3814 bytes) 2024-09-22T01:37:01.977 INFO:teuthology.orchestra.run.smithi018.stdout:5867 write 0x2d268d1 thru 0x2d31b65 (0xb295 bytes) 2024-09-22T01:37:02.003 INFO:teuthology.orchestra.run.smithi018.stdout:5868 trunc from 0xd257eb5 to 0x5631022 2024-09-22T01:37:02.031 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:02.034 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:02.045 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:02.062 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:02.058+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:02.107 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:02.176 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:02.172+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:02.215 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:02.215 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:02.229 INFO:teuthology.orchestra.run.smithi018.stdout:5869 read 0x4f20758 thru 0x4f20bfb (0x4a4 bytes) 2024-09-22T01:37:02.232 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:02.253 INFO:teuthology.orchestra.run.smithi018.stdout:5870 writesame 0xabea642 thru 0xabeed2c data_size 0x1(0x46eb bytes) 2024-09-22T01:37:02.253 INFO:teuthology.orchestra.run.smithi018.stdout:5871 read 0x2f6c79d thru 0x2f758b6 (0x911a bytes) 2024-09-22T01:37:02.255 INFO:teuthology.orchestra.run.smithi018.stdout:5872 read 0x853867d thru 0x853f42b (0x6daf bytes) 2024-09-22T01:37:02.257 INFO:teuthology.orchestra.run.smithi018.stdout:5873 trunc from 0xabeed2d to 0xcbf86a2 2024-09-22T01:37:02.264 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:02.260+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:02.270 INFO:teuthology.orchestra.run.smithi018.stdout:5875 writesame 0x8801b6d thru 0x880b57d data_size 0x1(0x9a11 bytes) 2024-09-22T01:37:02.286 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:02.286 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:02.296 INFO:teuthology.orchestra.run.smithi018.stdout:5876 write 0x3dac569 thru 0x3db3946 (0x73de bytes) 2024-09-22T01:37:02.308 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:02.308 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:02.312 INFO:teuthology.orchestra.run.smithi018.stdout:5877 punch from 0x6a29c45 to 0x6a32a68, (0x8e23 bytes) 2024-09-22T01:37:02.326 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:02.326 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:02.326 INFO:teuthology.orchestra.run.smithi018.stdout:5878 trunc from 0xcbf86a2 to 0x3f70cc7 2024-09-22T01:37:02.347 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:02.348 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:02.348 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:02.348 INFO:teuthology.orchestra.run.smithi018.stdout:5881 read 0xb3249b thru 0xb3e118 (0xbc7e bytes) 2024-09-22T01:37:02.354 INFO:teuthology.orchestra.run.smithi018.stdout:5884 trunc from 0x3f70cc7 to 0x809d327 2024-09-22T01:37:02.365 INFO:teuthology.orchestra.run.smithi018.stdout:5886 read 0x283655f thru 0x28397f4 (0x3296 bytes) 2024-09-22T01:37:02.365 INFO:teuthology.orchestra.run.smithi018.stdout:5887 read 0x3be928c thru 0x3bf2306 (0x907b bytes) 2024-09-22T01:37:02.365 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:02.360+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:02.370 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:02.370 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:02.375 INFO:teuthology.orchestra.run.smithi018.stdout:5890 trunc from 0x809d327 to 0xebbdcc 2024-09-22T01:37:02.398 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:02.398 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:02.403 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:02.403 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138405 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 245760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2098784570000003, 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398091244, 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138405 2024-09-22T01:37:02.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0999999999999998e-07 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191651+0000", 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1529999999999997e-06 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191659+0000", 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7470000000000005e-06 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191665+0000", 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2439999999999998e-06 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191817+0000", 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151414 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191827+0000", 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0305e-05 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537811+0000", 2024-09-22T01:37:02.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34598379000000001 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537817+0000", 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7359999999999998e-06 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589536+0000", 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517191669999999 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589611+0000", 2024-09-22T01:37:02.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5436000000000001e-05 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589734+0000", 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012264200000000001 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138406 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 266240~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2097839199999996, 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3985561479999999, 2024-09-22T01:37:02.409 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138406 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191738+0000", 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191741+0000", 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4479999999999999e-06 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191749+0000", 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6029999999999999e-06 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191755+0000", 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.139e-06 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191922+0000", 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000166589 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191931+0000", 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.132e-06 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537867+0000", 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34593649399999998 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537879+0000", 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-05 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589835+0000", 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519563439999999 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590007+0000", 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171182 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590293+0000", 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00028668699999999999 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138407 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 286720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2096829089999996, 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3989841119999999, 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138407 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.415 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191839+0000", 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191843+0000", 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7189999999999999e-06 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191854+0000", 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1728e-05 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191861+0000", 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3589999999999996e-06 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192030+0000", 2024-09-22T01:37:02.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169789 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192040+0000", 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.251e-06 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537916+0000", 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34587605199999999 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537921+0000", 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0370000000000002e-06 2024-09-22T01:37:02.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590343+0000", 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0524222999999999 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590511+0000", 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001683 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590822+0000", 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00031091400000000003 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.419 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138408 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 307200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2095793639999997, 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399171419, 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138408 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.420 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2200000000000004e-07 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191946+0000", 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7309999999999999e-06 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191958+0000", 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1678000000000001e-05 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191974+0000", 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6158e-05 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192127+0000", 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000153614 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192136+0000", 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7290000000000006e-06 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537946+0000", 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345810267 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537954+0000", 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5320000000000001e-06 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590877+0000", 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529233330000001 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590965+0000", 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8134999999999996e-05 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591113+0000", 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014762 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138409 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 327680~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2094701749999999, 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399404775, 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.425 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138409 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2799999999999996e-07 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192055+0000", 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8510000000000001e-06 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192065+0000", 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2739999999999996e-06 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192071+0000", 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4679999999999997e-06 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192214+0000", 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000142948 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192223+0000", 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8130000000000002e-06 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538006+0000", 2024-09-22T01:37:02.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34578290299999997 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538028+0000", 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2002999999999999e-05 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591185+0000", 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053157688 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591278+0000", 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2434000000000003e-05 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591456+0000", 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000177765 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138410 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 348160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2093740420000003, 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399528573, 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.430 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138410 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192148+0000", 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9599999999999999e-07 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192151+0000", 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.63e-06 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192159+0000", 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6510000000000001e-06 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192165+0000", 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2349999999999996e-06 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192301+0000", 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136124 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192309+0000", 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2320000000000001e-06 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538066+0000", 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345756485 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538075+0000", 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309999999999992e-06 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591495+0000", 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053420759 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591559+0000", 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4108000000000004e-05 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591676+0000", 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116122 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138411 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 368640~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2092877240000002, 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3997209019999999, 2024-09-22T01:37:02.435 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138411 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:02.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192234+0000", 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192237+0000", 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4850000000000001e-06 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192245+0000", 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9079999999999995e-06 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192251+0000", 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8880000000000002e-06 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192388+0000", 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013639500000000001 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192413+0000", 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5411000000000001e-05 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538143+0000", 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573035800000002 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538165+0000", 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1929e-05 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591711+0000", 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0535457159999999 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591800+0000", 2024-09-22T01:37:02.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8556999999999999e-05 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591954+0000", 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154628 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138412 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 389120~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:02.440 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2092012649999999, 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399867717, 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138412 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:37:02.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192324+0000", 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5219999999999999e-06 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192332+0000", 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.96e-06 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192338+0000", 2024-09-22T01:37:02.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2140000000000001e-06 2024-09-22T01:37:02.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192490+0000", 2024-09-22T01:37:02.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015239 2024-09-22T01:37:02.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192499+0000", 2024-09-22T01:37:02.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8240000000000006e-06 2024-09-22T01:37:02.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538235+0000", 2024-09-22T01:37:02.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573599700000002 2024-09-22T01:37:02.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538244+0000", 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9490000000000002e-06 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592004+0000", 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0537599369999999 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592070+0000", 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5321999999999996e-05 2024-09-22T01:37:02.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592187+0000", 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117973 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138413 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 409600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2090977839999999, 2024-09-22T01:37:02.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4000562969999999, 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138413 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192424+0000", 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:02.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192427+0000", 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.506e-06 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192435+0000", 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8760000000000005e-06 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192441+0000", 2024-09-22T01:37:02.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5049999999999998e-06 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192578+0000", 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013744699999999999 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192587+0000", 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5380000000000002e-06 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.451 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538307+0000", 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345719954 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538320+0000", 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2976000000000001e-05 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592226+0000", 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053906327 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.452 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592318+0000", 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2199000000000003e-05 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592480+0000", 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016129800000000001 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138414 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 430080~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2090107000000003, 2024-09-22T01:37:02.453 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4002321010000001, 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138414 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.454 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192511+0000", 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7899999999999998e-07 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192515+0000", 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8659999999999999e-06 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.455 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192523+0000", 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9480000000000008e-06 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192529+0000", 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.088e-06 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192670+0000", 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014069199999999999 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192678+0000", 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6880000000000005e-06 2024-09-22T01:37:02.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538397+0000", 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34571886600000001 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538403+0000", 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592507+0000", 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0541037799999999 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.457 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592590+0000", 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3506999999999999e-05 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592742+0000", 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015220500000000001 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138415 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 450560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:02.458 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2089235880000002, 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4003886910000001, 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138415 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.459 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192598+0000", 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192602+0000", 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4079999999999998e-06 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.460 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192609+0000", 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9109999999999993e-06 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192616+0000", 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1879999999999999e-06 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192888+0000", 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000272475 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.461 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192898+0000", 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-06 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538424+0000", 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34552665100000002 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538433+0000", 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2979999999999992e-06 2024-09-22T01:37:02.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592785+0000", 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0543528529999999 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592863+0000", 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7534999999999995e-05 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592986+0000", 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123201 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.463 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138416 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 471040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.208831988, 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4005776480000001, 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.464 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138416 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.465 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192690+0000", 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192693+0000", 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6669999999999998e-06 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192701+0000", 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1089999999999998e-06 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.466 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192708+0000", 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0569999999999998e-06 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193001+0000", 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000293288 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193010+0000", 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.346e-06 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538482+0000", 2024-09-22T01:37:02.467 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34547171599999998 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538494+0000", 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1936999999999999e-05 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593021+0000", 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.054527456 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.468 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593108+0000", 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6743000000000006e-05 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593267+0000", 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015870599999999999 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138417 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 491520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.208611178, 2024-09-22T01:37:02.469 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4006197579999999, 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138417 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192911+0000", 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4899999999999995e-07 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192920+0000", 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1679999999999993e-06 2024-09-22T01:37:02.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192933+0000", 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3132000000000001e-05 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192940+0000", 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193107+0000", 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016665899999999999 2024-09-22T01:37:02.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193117+0000", 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0009e-05 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538566+0000", 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34544893700000001 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538581+0000", 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5438e-05 2024-09-22T01:37:02.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593293+0000", 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547119359999999 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593375+0000", 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.195e-05 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593530+0000", 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015473 2024-09-22T01:37:02.474 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138418 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 512000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2085001249999996, 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4007298539999999, 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.475 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138418 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.476 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193022+0000", 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5899999999999996e-07 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193026+0000", 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649999999999999e-06 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193038+0000", 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2099000000000001e-05 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193044+0000", 2024-09-22T01:37:02.477 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.567e-06 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193248+0000", 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203978 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193257+0000", 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0070000000000003e-06 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538642+0000", 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34538508099999998 2024-09-22T01:37:02.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538657+0000", 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.452e-05 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593568+0000", 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0549109299999999 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593636+0000", 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7702999999999999e-05 2024-09-22T01:37:02.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593751+0000", 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115145 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138429 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 458752~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2083527070000004, 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.400882792, 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.480 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138429 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193169+0000", 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193172+0000", 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1319999999999998e-06 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193190+0000", 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8184000000000001e-05 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193197+0000", 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3929999999999996e-06 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194935+0000", 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001738306 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194945+0000", 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8859999999999999e-06 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.483 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538696+0000", 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34375087300000001 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538702+0000", 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3339999999999998e-06 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593785+0000", 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.055083478 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.484 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593882+0000", 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6512e-05 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594051+0000", 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169185 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138457 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.20666326, 2024-09-22T01:37:02.485 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3994306999999999, 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138457 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6199999999999998e-07 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194867+0000", 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4980000000000006e-06 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194875+0000", 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3429999999999996e-06 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194881+0000", 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7690000000000002e-06 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195318+0000", 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043666400000000002 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195327+0000", 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538752+0000", 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34342517700000003 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538763+0000", 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1368e-05 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594096+0000", 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0553327100000001 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594164+0000", 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8319999999999996e-05 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594288+0000", 2024-09-22T01:37:02.490 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000124067 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138468 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 704512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2062856039999996, 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3993414930000001, 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.491 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138468 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.492 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195236+0000", 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5099999999999999e-07 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195240+0000", 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9720000000000003e-06 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195249+0000", 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1859999999999998e-06 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.493 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195256+0000", 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7989999999999996e-06 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195467+0000", 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021063599999999999 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195477+0000", 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0468e-05 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.494 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538799+0000", 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34332192700000003 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538805+0000", 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594324+0000", 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0555192959999999 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594414+0000", 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0303000000000006e-05 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594577+0000", 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016252500000000001 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138471 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 487424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2058847689999999, 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399163084, 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138471 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:02.497 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195637+0000", 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0500000000000004e-07 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195640+0000", 2024-09-22T01:37:02.498 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1300000000000001e-06 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195648+0000", 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8790000000000003e-06 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195654+0000", 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2949999999999999e-06 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195704+0000", 2024-09-22T01:37:02.499 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0281999999999997e-05 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195714+0000", 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5219999999999996e-06 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538855+0000", 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34314121400000003 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538868+0000", 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2814e-05 2024-09-22T01:37:02.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594614+0000", 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0557457189999999 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594680+0000", 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5955000000000001e-05 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594799+0000", 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119769 2024-09-22T01:37:02.501 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138482 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 499712~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.2055221950000004, 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399082626, 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.502 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138482 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000005e-07 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196004+0000", 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0609999999999997e-06 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196012+0000", 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9039999999999998e-06 2024-09-22T01:37:02.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196019+0000", 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8090000000000004e-06 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197752+0000", 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017325159999999999 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197770+0000", 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8615e-05 2024-09-22T01:37:02.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538901+0000", 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34113091499999998 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538907+0000", 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4140000000000002e-06 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594834+0000", 2024-09-22T01:37:02.506 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559273490000001 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594922+0000", 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8182000000000004e-05 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.595081+0000", 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015923599999999999 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.507 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138776 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 634880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 4.1986252469999998, 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398108922, 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138776 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:02.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8799999999999998e-07 2024-09-22T01:37:02.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202898+0000", 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1229999999999998e-06 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202905+0000", 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9120000000000001e-06 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202910+0000", 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.169e-06 2024-09-22T01:37:02.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202961+0000", 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0173000000000002e-05 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202969+0000", 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8980000000000002e-06 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539828+0000", 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.336858714 2024-09-22T01:37:02.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539834+0000", 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4840000000000003e-06 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600811+0000", 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0609770540000001 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600885+0000", 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4010000000000005e-05 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:02.512 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:02.513 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.601005+0000", 2024-09-22T01:37:02.513 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119997 2024-09-22T01:37:02.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.513 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:02.513 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:02.513 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:02.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:02.515 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:02.516 INFO:teuthology.orchestra.run.smithi018.stdout:5893 write 0x9952601 thru 0x995524c (0x2c4c bytes) 2024-09-22T01:37:02.516 INFO:teuthology.orchestra.run.smithi018.stdout:5894 trunc from 0x995524d to 0x56cc0fd 2024-09-22T01:37:02.516 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:02.517 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:02.517 INFO:teuthology.orchestra.run.smithi018.stdout:5895 write 0xde67ca2 thru 0xde6b161 (0x34c0 bytes) 2024-09-22T01:37:02.517 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:02.508+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:02.517 INFO:teuthology.orchestra.run.smithi018.stdout:5896 trunc from 0xde6b162 to 0xa25d6a 2024-09-22T01:37:02.530 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:37:02.555 INFO:teuthology.orchestra.run.smithi018.stdout:5897 trunc from 0xa25d6a to 0xa08ef32 2024-09-22T01:37:02.568 INFO:teuthology.orchestra.run.smithi018.stdout:5898 write 0x2259d8 thru 0x229893 (0x3ebc bytes) 2024-09-22T01:37:02.615 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:02.608+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:02.630 INFO:teuthology.orchestra.run.smithi018.stdout:5899 trunc from 0xa08ef32 to 0xe6e6cd9 2024-09-22T01:37:02.641 INFO:teuthology.orchestra.run.smithi018.stdout:5900 clone 45 order 20 su 65536 sc 7 2024-09-22T01:37:02.661 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:02.661 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:02.661 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:02.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:02.716 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:02.712+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:02.817 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:02.812+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:02.840 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:02.840 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:02.840 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:02.840 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:02.840 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:02.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:02.944 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:02.940+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:03.019 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:03.018+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:03.028 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:03.028 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:03.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:03.028 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:03.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.223961416999998, 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:37:03.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.033 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.223906240999995, 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:37:03.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:37:03.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:37:03.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.223841128000004, 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:37:03.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:37:03.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.223775380999996, 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:37:03.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:37:03.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:37:03.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:37:03.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:03.050 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.223737911000001, 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:03.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.223687295000005, 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:37:03.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:37:03.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.061 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.222501956000002, 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:03.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:37:03.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.222440129000006, 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.067 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:37:03.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:37:03.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:37:03.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.222391329999994, 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:03.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:37:03.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:37:03.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.222317777000001, 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:37:03.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:37:03.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:37:03.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:37:03.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.222247315000004, 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.083 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:37:03.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.222176812000001, 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:37:03.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:37:03.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:37:03.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.222129580000001, 2024-09-22T01:37:03.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:37:03.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:37:03.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:37:03.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:37:03.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.222066704, 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:37:03.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:37:03.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.222026037999996, 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:37:03.104 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.221931170999994, 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:37:03.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:37:03.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:37:03.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.221890134000006, 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:37:03.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:37:03.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.221852643000005, 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:37:03.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.221812494000005, 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:37:03.125 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 94.221769699000006, 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.131 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:03.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:37:03.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.137 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.137 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:03.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:03.138 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:03.132+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:03.239 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:03.234+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:03.310 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:03.310 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:03.310 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:03.310 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:03.324 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:03.340 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:03.338+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:03.441 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:03.436+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:03.443 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:03.443 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:03.443 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:03.444 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:03.444 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:03.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:03.541 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:03.534+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:03.628 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:03.628 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.210329379000001, 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:37:03.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:03.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.210299190000001, 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.633 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.210270096000002, 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:37:03.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.210240470999999, 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.641 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:37:03.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:37:03.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.210190578000002, 2024-09-22T01:37:03.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:03.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:37:03.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:37:03.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.210158868000001, 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.653 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.210129428999998, 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:03.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:37:03.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:37:03.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.210099972999998, 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:37:03.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:37:03.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.210069949999998, 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:37:03.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.210024537000002, 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:37:03.666 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:37:03.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.209994967999997, 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.670 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:03.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:37:03.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.209965158000003, 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:03.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:37:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.209935872000003, 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.678 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:03.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:37:03.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.209902565999997, 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.682 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:37:03.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:37:03.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.209872660000002, 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.686 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.209842877, 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.690 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:37:03.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.209779060999999, 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.694 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:03.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:37:03.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.209744125, 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.698 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:37:03.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.209714384999998, 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:37:03.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 37.209684258999999, 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:03.706 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:37:03.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:37:03.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:37:03.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:03.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:37:03.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:37:03.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:03.710 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:03.712 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:03.712 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:03.706+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:03.748 INFO:teuthology.orchestra.run.smithi018.stdout:truncating image image_client.0-clone44 from 0xe6e6cd9 (overlap 0x47f094) to 0x398d43 2024-09-22T01:37:03.812 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:03.806+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:03.853 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:03.854 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:03.854 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:03.869 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:03.912 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:03.906+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:03.980 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #43, image image_client.0-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent44 2024-09-22T01:37:03.990 INFO:teuthology.orchestra.run.smithi018.stdout:5901 punch from 0xc96dc78 to 0xc973934, (0x5cbc bytes) 2024-09-22T01:37:03.998 INFO:teuthology.orchestra.run.smithi018.stdout:5903 read 0x765af54 thru 0x765e7c9 (0x3876 bytes) 2024-09-22T01:37:03.999 INFO:teuthology.orchestra.run.smithi018.stdout:5904 write 0x9df0337 thru 0x9df373b (0x3405 bytes) 2024-09-22T01:37:04.006 INFO:teuthology.orchestra.run.smithi018.stdout:5905 write 0x5af7549 thru 0x5b03bd7 (0xc68f bytes) 2024-09-22T01:37:04.013 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:04.008+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:04.016 INFO:teuthology.orchestra.run.smithi018.stdout:5907 punch from 0x29ad4a8 to 0x29b1033, (0x3b8b bytes) 2024-09-22T01:37:04.017 INFO:teuthology.orchestra.run.smithi018.stdout:5908 read 0xd505437 thru 0xd509a1e (0x45e8 bytes) 2024-09-22T01:37:04.017 INFO:teuthology.orchestra.run.smithi018.stdout:5910 writesame 0x8940d08 thru 0x8941c27 data_size 0x10(0xf20 bytes) 2024-09-22T01:37:04.024 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:04.024 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:04.024 INFO:teuthology.orchestra.run.smithi018.stdout:5914 write 0x4d2ea78 thru 0x4d3d5f1 (0xeb7a bytes) 2024-09-22T01:37:04.032 INFO:teuthology.orchestra.run.smithi018.stdout:5915 read 0xbd20c35 thru 0xbd2f63a (0xea06 bytes) 2024-09-22T01:37:04.032 INFO:teuthology.orchestra.run.smithi018.stdout:5916 write 0xccb2598 thru 0xccb2891 (0x2fa bytes) 2024-09-22T01:37:04.040 INFO:teuthology.orchestra.run.smithi018.stdout:5917 read 0xd764943 thru 0xd772fd4 (0xe692 bytes) 2024-09-22T01:37:04.040 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:04.040 INFO:teuthology.orchestra.run.smithi018.stdout:5919 writesame 0x6d411e1 thru 0x6d4f48f data_size 0x1(0xe2af bytes) 2024-09-22T01:37:04.056 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:04.056 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:04.056 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:04.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:04.087 INFO:teuthology.orchestra.run.smithi018.stdout:5920 read 0xcd2a11 thru 0xcdbe73 (0x9463 bytes) 2024-09-22T01:37:04.087 INFO:teuthology.orchestra.run.smithi018.stdout:5921 write 0x13043dd thru 0x13113dc (0xd000 bytes) 2024-09-22T01:37:04.106 INFO:teuthology.orchestra.run.smithi018.stdout:5922 trunc from 0xe6e6cd9 to 0x7887a18 2024-09-22T01:37:04.114 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:04.110+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:04.150 INFO:teuthology.orchestra.run.smithi018.stdout:5923 trunc from 0x7887a18 to 0x3b4804d 2024-09-22T01:37:04.195 INFO:teuthology.orchestra.run.smithi018.stdout:5924 trunc from 0x3b4804d to 0x16b73f4 2024-09-22T01:37:04.214 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:04.208+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:04.221 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.093625824, 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.222 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:37:04.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:37:04.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.226 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.093600088, 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:37:04.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:37:04.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.09357430599999, 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.234 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.093529387, 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:37:04.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.093497231, 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.239 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:37:04.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:04.242 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.09346949899999, 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:37:04.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:37:04.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.093433675, 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.246 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:37:04.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.09339753099999, 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:37:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.252 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.09336132599999, 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.253 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.093333974, 2024-09-22T01:37:04.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:37:04.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:37:04.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.093296896, 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:37:04.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.09327335899999, 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.264 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.09272615899999, 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:37:04.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:37:04.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.092698402, 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:37:04.271 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:04.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.274 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.092676336, 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.275 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:37:04.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.278 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.092646176, 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:04.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:37:04.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.09222568600001, 2024-09-22T01:37:04.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.092199905, 2024-09-22T01:37:04.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:37:04.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:37:04.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 119.092178637, 2024-09-22T01:37:04.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:37:04.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:37:04.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 15.681173242, 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:04.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:37:04.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:37:04.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.300 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:04.301 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:04.302 INFO:teuthology.orchestra.run.smithi018.stdout:5925 writesame 0x57e15c2 thru 0x57ed799 data_size 0x4(0xc1d8 bytes) 2024-09-22T01:37:04.302 INFO:teuthology.orchestra.run.smithi018.stdout:5928 writesame 0x3c59a49 thru 0x3c5c482 data_size 0x2f(0x2a3a bytes) 2024-09-22T01:37:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:5933 read 0x5c0d5e thru 0x5c10a9 (0x34c bytes) 2024-09-22T01:37:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:5934 trunc from 0x57ed79a to 0xd455da2 2024-09-22T01:37:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:5935 read 0x19504f0 thru 0x1950dbd (0x8ce bytes) 2024-09-22T01:37:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:5936 write 0xa253b18 thru 0xa26016d (0xc656 bytes) 2024-09-22T01:37:04.303 INFO:teuthology.orchestra.run.smithi018.stdout:5937 write 0xcd75594 thru 0xcd7d53b (0x7fa8 bytes) 2024-09-22T01:37:04.311 INFO:teuthology.orchestra.run.smithi018.stdout:5938 trunc from 0xd455da2 to 0xe3d6ad8 2024-09-22T01:37:04.315 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:04.308+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:04.323 INFO:teuthology.orchestra.run.smithi018.stdout:5939 write 0x79ac453 thru 0x79b8a8f (0xc63d bytes) 2024-09-22T01:37:04.332 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:04.332 INFO:teuthology.orchestra.run.smithi018.stdout:5942 punch from 0xd75f67e to 0xd76394d, (0x42cf bytes) 2024-09-22T01:37:04.333 INFO:teuthology.orchestra.run.smithi018.stdout:5943 writesame 0x85e0c4d thru 0x85e92ea data_size 0x1(0x869e bytes) 2024-09-22T01:37:04.341 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 6, 7, 0, 2] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:37:04.341 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:37:04.341 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-22T01:37:04.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-22T01:37:04.360 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:04.360 INFO:teuthology.orchestra.run.smithi018.stdout:5945 read 0xb06e49d thru 0xb071d20 (0x3884 bytes) 2024-09-22T01:37:04.368 INFO:teuthology.orchestra.run.smithi018.stdout:5946 trunc from 0xe3d6ad8 to 0xa65fbb9 2024-09-22T01:37:04.391 INFO:teuthology.orchestra.run.smithi018.stdout:5947 writesame 0x3e5f1fc thru 0x3e6d8e9 data_size 0xa7(0xe6ee bytes) 2024-09-22T01:37:04.403 INFO:teuthology.orchestra.run.smithi018.stdout:5949 read 0x8c565e8 thru 0x8c57706 (0x111f bytes) 2024-09-22T01:37:04.416 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:04.412+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:04.417 INFO:teuthology.orchestra.run.smithi018.stdout:5952 write 0xbc4cd66 thru 0xbc570cc (0xa367 bytes) 2024-09-22T01:37:04.424 INFO:teuthology.orchestra.run.smithi018.stdout:5954 read 0x53e1e06 thru 0x53e3c06 (0x1e01 bytes) 2024-09-22T01:37:04.425 INFO:teuthology.orchestra.run.smithi018.stdout:5956 write 0x3106afb thru 0x3113692 (0xcb98 bytes) 2024-09-22T01:37:04.432 INFO:teuthology.orchestra.run.smithi018.stdout:5958 read 0x5459cc8 thru 0x545a5e1 (0x91a bytes) 2024-09-22T01:37:04.434 INFO:teuthology.orchestra.run.smithi018.stdout:5959 trunc from 0xbc570cd to 0xafd0d4f 2024-09-22T01:37:04.435 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:04.435 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:04.435 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:04.435 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:04.450 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:04.452 INFO:teuthology.orchestra.run.smithi018.stdout:5960 punch from 0xad8aa87 to 0xad8e6b1, (0x3c2a bytes) 2024-09-22T01:37:04.453 INFO:teuthology.orchestra.run.smithi018.stdout:5962 read 0x7c3c20a thru 0x7c48f06 (0xccfd bytes) 2024-09-22T01:37:04.453 INFO:teuthology.orchestra.run.smithi018.stdout:5966 read 0x57e88c7 thru 0x57f2cf1 (0xa42b bytes) 2024-09-22T01:37:04.453 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:04.453 INFO:teuthology.orchestra.run.smithi018.stdout:5968 read 0x500a17a thru 0x500e211 (0x4098 bytes) 2024-09-22T01:37:04.472 INFO:teuthology.orchestra.run.smithi018.stdout:5969 writesame 0xe6ccd1c thru 0xe6d1c77 data_size 0x6(0x4f5c bytes) 2024-09-22T01:37:04.472 INFO:teuthology.orchestra.run.smithi018.stdout:5971 read 0x3ca7ac4 thru 0x3ca84c8 (0xa05 bytes) 2024-09-22T01:37:04.472 INFO:teuthology.orchestra.run.smithi018.stdout:5973 write 0x6eec733 thru 0x6ef9403 (0xccd1 bytes) 2024-09-22T01:37:04.479 INFO:teuthology.orchestra.run.smithi018.stdout:5974 writesame 0x3369960 thru 0x337082e data_size 0x1(0x6ecf bytes) 2024-09-22T01:37:04.502 INFO:teuthology.orchestra.run.smithi018.stdout:compare and write disabled 2024-09-22T01:37:04.502 INFO:teuthology.orchestra.run.smithi018.stdout:5976 read 0x69a7b25 thru 0x69ad408 (0x58e4 bytes) 2024-09-22T01:37:04.503 INFO:teuthology.orchestra.run.smithi018.stdout:5977 read 0x754304b thru 0x75456fa (0x26b0 bytes) 2024-09-22T01:37:04.510 INFO:teuthology.orchestra.run.smithi018.stdout:5978 writesame 0xec4a967 thru 0xec4ffbd data_size 0x17(0x5657 bytes) 2024-09-22T01:37:04.511 INFO:teuthology.orchestra.run.smithi018.stdout:5979 write 0x8937c73 thru 0x893d88f (0x5c1d bytes) 2024-09-22T01:37:04.514 INFO:teuthology.orchestra.run.smithi018.stdout:5983 read 0xa4dc556 thru 0xa4dfceb (0x3796 bytes) 2024-09-22T01:37:04.514 INFO:teuthology.orchestra.run.smithi018.stdout:5984 read 0x1f4b683 thru 0x1f5b1fe (0xfb7c bytes) 2024-09-22T01:37:04.514 INFO:teuthology.orchestra.run.smithi018.stdout:5989 read 0xeb17999 thru 0xeb17d90 (0x3f8 bytes) 2024-09-22T01:37:04.514 INFO:teuthology.orchestra.run.smithi018.stdout:5990 read 0x45103a7 thru 0x451f890 (0xf4ea bytes) 2024-09-22T01:37:04.515 INFO:teuthology.orchestra.run.smithi018.stdout:5991 read 0xb21c1ac thru 0xb223216 (0x706b bytes) 2024-09-22T01:37:04.515 INFO:teuthology.orchestra.run.smithi018.stdout:5992 write 0x2bab20c thru 0x2bb2161 (0x6f56 bytes) 2024-09-22T01:37:04.517 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:04.510+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:04.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:04.518 INFO:teuthology.orchestra.run.smithi018.stdout:5993 read 0x3e63995 thru 0x3e68d2b (0x5397 bytes) 2024-09-22T01:37:04.520 INFO:teuthology.orchestra.run.smithi018.stdout:5995 read 0x71cc917 thru 0x71dc158 (0xf842 bytes) 2024-09-22T01:37:04.520 INFO:teuthology.orchestra.run.smithi018.stdout:5996 read 0xb254e0e thru 0xb25644e (0x1641 bytes) 2024-09-22T01:37:04.520 INFO:teuthology.orchestra.run.smithi018.stdout:5997 read 0xdbda081 thru 0xdbdb3e8 (0x1368 bytes) 2024-09-22T01:37:04.529 INFO:teuthology.orchestra.run.smithi018.stdout:5999 trunc from 0xec4ffbe to 0x9c4c022 2024-09-22T01:37:04.541 INFO:teuthology.orchestra.run.smithi018.stdout:6000 read 0x2277961 thru 0x228064a (0x8cea bytes) 2024-09-22T01:37:04.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:37:04.578 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:04.579 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:04.579 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:04.579 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:04.579 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:04.593 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:04.621 INFO:teuthology.orchestra.run.smithi018.stdout:checking clone #44, image image_client.0-clone44 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent45 2024-09-22T01:37:04.634 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:04.630+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:04.696 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:04.696 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:04.718 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:04.712+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:04.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:04.727 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:04.735 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:04.735 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 134, 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "2d4626ba-577e-46d9-ad53-8451e5733f43", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-22T01:34:18.722829+0000", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-22T01:37:03.537108+0000", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-22T01:34:31.284224+0000", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-22T01:36:51.917311+0000", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5806080, 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "noscrub", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-22T01:37:04.736 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 3, 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.737 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:31.452919+0000", 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:37:04.738 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "16", 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:37:04.739 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:37:04.740 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:37:04.741 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-22T01:37:04.742 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.90166282653808594, 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "rbd", 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:36.960578+0000", 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:37:04.743 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:37:04.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "20", 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 2, 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 20, 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:37:04.745 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:37:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:37:04.747 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 2, 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 2, 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.75, 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.90166282653808594, 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "pool_client.0", 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:46.686791+0000", 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:37:04.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:37:04.749 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "134", 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 47, 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 134, 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:37:04.750 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:37:04.751 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:37:04.752 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.9900000095367432, 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.9900000095367432, 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.87999999523162842, 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.90166282653808594, 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.89999997615814209, 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:37:04.753 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "8de621b1-0a3b-4b8b-b982-70e8db073085", 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 131, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.755 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:37:04.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/1213730345", 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/1213730345", 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/1213730345", 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/1213730345", 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "798cbd57-ebd4-461a-9bbf-68e683d1049e", 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.4805145263671875, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 122, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-22T01:37:04.760 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3361514324", 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3361514324", 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3361514324", 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3361514324", 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.763 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9294585f-3dc9-4b04-8cae-f8d78c92791e", 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.7327880859375, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 122, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.765 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-22T01:37:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/4002178714", 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/4002178714", 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/4002178714", 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/4002178714", 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "1ff1abf7-fdbb-4f8a-85e5-90f102abcec2", 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.9000244140625, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 126, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:37:04.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:37:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/2610959301", 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/2610959301", 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/2610959301", 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/2610959301", 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9aa2579a-ada1-45f3-9341-f46697c28212", 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:37:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0.9000244140625, 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 126, 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6824", 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6825", 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6826", 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6827", 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:37:04.775 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6830", 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6831", 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.776 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6828", 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6829", 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6825/482886379", 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6827/482886379", 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6831/482886379", 2024-09-22T01:37:04.777 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6829/482886379", 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4a6678eb-28ca-4b05-96ae-e9deeb60ca96", 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 0, 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 0, 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 86, 2024-09-22T01:37:04.778 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6816", 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6817", 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:37:04.779 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6818", 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6819", 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6822", 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6823", 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6820", 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:37:04.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6821", 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6817/2695689817", 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6819/2695689817", 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6823/2695689817", 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6821/2695689817", 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "775b01e8-5705-4b98-a3ab-f15a78271355", 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 84, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6808", 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6809", 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6810", 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6811", 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6814", 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6815", 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6812", 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.786 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6813", 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6809/1840779137", 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6811/1840779137", 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6815/1840779137", 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6813/1840779137", 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:37:04.787 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "15f6d6c1-8a16-42c6-9e43-f3a92e511735", 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 126, 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6800", 2024-09-22T01:37:04.788 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6801", 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6802", 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:37:04.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6803", 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6806", 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6807", 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6804", 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6805", 2024-09-22T01:37:04.791 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6801/4222842386", 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6803/4222842386", 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6807/4222842386", 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6805/4222842386", 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:37:04.792 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.339566+0000", 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.065958+0000", 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:37:04.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.261750+0000", 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:37:04.794 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.463117+0000", 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.557372+0000", 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.795 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 65536, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.195553+0000", 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.008891+0000", 2024-09-22T01:37:04.796 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:27.839466+0000", 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [ 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "3.b", 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:37:04.797 INFO:teuthology.orchestra.run.smithi018.stdout: 3, 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: 2 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "3.3", 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 4, 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 6 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.798 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:04.799 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:04.800 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:04.801 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:04.802 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:04.802 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 95.964551381000007, 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.803 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:37:04.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:37:04.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:04.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 67.252408662999997, 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:37:04.809 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:37:04.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:37:04.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105543 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 10911744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650890437000001, 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064938994, 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.815 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105543 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110043+0000", 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110048+0000", 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6470000000000003e-06 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110066+0000", 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8306999999999999e-05 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110081+0000", 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4362000000000001e-05 2024-09-22T01:37:04.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174758+0000", 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064676685999999997 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174867+0000", 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109701 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174980+0000", 2024-09-22T01:37:04.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000113238 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650804755999999, 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.819 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650739072999997, 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.823 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:37:04.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650673325, 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.827 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650630726000003, 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.831 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650483018999999, 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.835 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:37:04.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650323630000003, 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.839 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:37:04.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650259828000003, 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.843 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650199639, 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.847 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650136197000002, 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.851 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:37:04.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:37:04.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650080942000002, 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.855 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:04.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:37:04.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:37:04.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.650027143000003, 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.859 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.649966190999997, 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.863 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:37:04.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:37:04.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.649908492000002, 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:37:04.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:37:04.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.649820040999998, 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:37:04.871 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.649734146, 2024-09-22T01:37:04.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.879 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 37.649649298, 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:37:04.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:37:04.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.883 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 10.529574007000001, 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:04.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:37:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:37:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:04.888 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:04.888 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:04.888 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:04.889 INFO:tasks.thrashosds.thrasher:j is {'epoch': 134, 'fsid': '2d4626ba-577e-46d9-ad53-8451e5733f43', 'created': '2024-09-22T01:34:18.722829+0000', 'modified': '2024-09-22T01:37:03.537108+0000', 'last_up_change': '2024-09-22T01:34:31.284224+0000', 'last_in_change': '2024-09-22T01:36:51.917311+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-22T01:34:31.452919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9016628265380859, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-22T01:34:36.960578+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9016628265380859, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-22T01:34:46.686791+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 47, 'snap_epoch': 134, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9016628265380859, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': '8de621b1-0a3b-4b8b-b982-70e8db073085', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6824', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6825', 'nonce': 1213730345}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6826', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6827', 'nonce': 1213730345}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6830', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6831', 'nonce': 1213730345}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6828', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6829', 'nonce': 1213730345}]}, 'public_addr': '172.21.15.18:6825/1213730345', 'cluster_addr': '172.21.15.18:6827/1213730345', 'heartbeat_back_addr': '172.21.15.18:6831/1213730345', 'heartbeat_front_addr': '172.21.15.18:6829/1213730345', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '798cbd57-ebd4-461a-9bbf-68e683d1049e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.4805145263671875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6800', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6801', 'nonce': 3361514324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6803', 'nonce': 3361514324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6807', 'nonce': 3361514324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6805', 'nonce': 3361514324}]}, 'public_addr': '172.21.15.18:6801/3361514324', 'cluster_addr': '172.21.15.18:6803/3361514324', 'heartbeat_back_addr': '172.21.15.18:6807/3361514324', 'heartbeat_front_addr': '172.21.15.18:6805/3361514324', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '9294585f-3dc9-4b04-8cae-f8d78c92791e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7327880859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6817', 'nonce': 4002178714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6818', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6819', 'nonce': 4002178714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6822', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6823', 'nonce': 4002178714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6820', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6821', 'nonce': 4002178714}]}, 'public_addr': '172.21.15.18:6817/4002178714', 'cluster_addr': '172.21.15.18:6819/4002178714', 'heartbeat_back_addr': '172.21.15.18:6823/4002178714', 'heartbeat_front_addr': '172.21.15.18:6821/4002178714', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1ff1abf7-fdbb-4f8a-85e5-90f102abcec2', 'up': 1, 'in': 1, 'weight': 0.9000244140625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 126, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6809', 'nonce': 2610959301}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6811', 'nonce': 2610959301}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6815', 'nonce': 2610959301}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6813', 'nonce': 2610959301}]}, 'public_addr': '172.21.15.18:6809/2610959301', 'cluster_addr': '172.21.15.18:6811/2610959301', 'heartbeat_back_addr': '172.21.15.18:6815/2610959301', 'heartbeat_front_addr': '172.21.15.18:6813/2610959301', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '9aa2579a-ada1-45f3-9341-f46697c28212', 'up': 1, 'in': 1, 'weight': 0.9000244140625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 126, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6824', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6825', 'nonce': 482886379}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6826', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6827', 'nonce': 482886379}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6830', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6831', 'nonce': 482886379}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6828', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6829', 'nonce': 482886379}]}, 'public_addr': '172.21.15.179:6825/482886379', 'cluster_addr': '172.21.15.179:6827/482886379', 'heartbeat_back_addr': '172.21.15.179:6831/482886379', 'heartbeat_front_addr': '172.21.15.179:6829/482886379', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4a6678eb-28ca-4b05-96ae-e9deeb60ca96', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6816', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6817', 'nonce': 2695689817}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6818', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6819', 'nonce': 2695689817}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6822', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6823', 'nonce': 2695689817}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6820', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6821', 'nonce': 2695689817}]}, 'public_addr': '172.21.15.179:6817/2695689817', 'cluster_addr': '172.21.15.179:6819/2695689817', 'heartbeat_back_addr': '172.21.15.179:6823/2695689817', 'heartbeat_front_addr': '172.21.15.179:6821/2695689817', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '775b01e8-5705-4b98-a3ab-f15a78271355', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6808', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6809', 'nonce': 1840779137}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6810', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6811', 'nonce': 1840779137}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6814', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6815', 'nonce': 1840779137}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6812', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6813', 'nonce': 1840779137}]}, 'public_addr': '172.21.15.179:6809/1840779137', 'cluster_addr': '172.21.15.179:6811/1840779137', 'heartbeat_back_addr': '172.21.15.179:6815/1840779137', 'heartbeat_front_addr': '172.21.15.179:6813/1840779137', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '15f6d6c1-8a16-42c6-9e43-f3a92e511735', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 126, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6800', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6801', 'nonce': 4222842386}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6802', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6803', 'nonce': 4222842386}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6806', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6807', 'nonce': 4222842386}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6804', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6805', 'nonce': 4222842386}]}, 'public_addr': '172.21.15.179:6801/4222842386', 'cluster_addr': '172.21.15.179:6803/4222842386', 'heartbeat_back_addr': '172.21.15.179:6807/4222842386', 'heartbeat_front_addr': '172.21.15.179:6805/4222842386', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.339566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.065958+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.261750+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.463117+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.557372+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.195553+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.008891+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:27.839466+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.b', 'osds': [3, 2]}], 'pg_upmap_items': [{'pgid': '3.3', 'mappings': [{'from': 4, 'to': 6}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-22T01:37:04.890 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:37:04.890 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:04.890 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:04.890 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:04.891 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:04.891 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:04.892 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:04.892 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:04.892 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:04.893 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:04.893 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:04.888+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:04.993 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:04.986+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:05.017 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:05.017 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:05.031 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:05.118 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:05.114+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:05.194 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:05.190+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:05.198 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:05.199 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:05.213 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:37:05.267 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-22T01:37:03.546721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2073920853,"num_objects":1802,"num_object_clones":612,"num_object_copies":3604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1802,"num_whiteouts":573,"num_read":182750,"num_read_kb":1016534,"num_write":18644,"num_write_kb":540631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3224,"num_bytes_recovered":274733527,"num_keys_recovered":690,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15023,"ondisk_log_size":15023,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":1015688,"kb_used_data":677916,"kb_used_omap":10,"kb_used_meta":337525,"kb_avail":659587192,"statfs":{"total":676457349120,"available":675417284608,"internally_reserved":0,"allocated":694185984,"data_stored":878548315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11157,"internal_metadata":345625707},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23392383,"num_objects":108,"num_object_clones":34,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":50,"num_read":12475,"num_read_kb":59068,"num_write":1512,"num_write_kb":23907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":9254482,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028909"},"pg_stats":[{"pgid":"3.1f","version":"132'583","reported_seq":5144,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.782002+0000","last_change":"2024-09-22T01:36:55.965006+0000","last_active":"2024-09-22T01:37:01.782002+0000","last_peered":"2024-09-22T01:37:01.782002+0000","last_clean":"2024-09-22T01:37:01.782002+0000","last_became_active":"2024-09-22T01:36:55.958370+0000","last_became_peered":"2024-09-22T01:36:55.958370+0000","last_unstale":"2024-09-22T01:37:01.782002+0000","last_undegraded":"2024-09-22T01:37:01.782002+0000","last_fullsized":"2024-09-22T01:37:01.782002+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:47:17.870100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001437504,"stat_sum":{"num_bytes":63563094,"num_objects":56,"num_object_clones":21,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":17,"num_read":6174,"num_read_kb":34859,"num_write":816,"num_write_kb":14961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":14516200,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"132'438","reported_seq":4083,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.821520+0000","last_change":"2024-09-22T01:34:50.528432+0000","last_active":"2024-09-22T01:37:01.821520+0000","last_peered":"2024-09-22T01:37:01.821520+0000","last_clean":"2024-09-22T01:37:01.821520+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:37:01.821520+0000","last_undegraded":"2024-09-22T01:37:01.821520+0000","last_fullsized":"2024-09-22T01:37:01.821520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:38.367661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00178118,"stat_sum":{"num_bytes":65194072,"num_objects":51,"num_object_clones":16,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":5640,"num_read_kb":47289,"num_write":505,"num_write_kb":23696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"132'917","reported_seq":2847,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.828377+0000","last_change":"2024-09-22T01:36:56.966285+0000","last_active":"2024-09-22T01:37:01.828377+0000","last_peered":"2024-09-22T01:37:01.828377+0000","last_clean":"2024-09-22T01:37:01.828377+0000","last_became_active":"2024-09-22T01:36:56.961860+0000","last_became_peered":"2024-09-22T01:36:56.961860+0000","last_unstale":"2024-09-22T01:37:01.828377+0000","last_undegraded":"2024-09-22T01:37:01.828377+0000","last_fullsized":"2024-09-22T01:37:01.828377+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":917,"log_dups_size":0,"ondisk_log_size":917,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:43:22.024395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031538109999999999,"stat_sum":{"num_bytes":66581529,"num_objects":55,"num_object_clones":19,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":17,"num_read":5234,"num_read_kb":32792,"num_write":1460,"num_write_kb":16552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":10726733,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"132'214","reported_seq":2141,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.829398+0000","last_change":"2024-09-22T01:36:56.967319+0000","last_active":"2024-09-22T01:37:01.829398+0000","last_peered":"2024-09-22T01:37:01.829398+0000","last_clean":"2024-09-22T01:37:01.829398+0000","last_became_active":"2024-09-22T01:36:56.964366+0000","last_became_peered":"2024-09-22T01:36:56.964366+0000","last_unstale":"2024-09-22T01:37:01.829398+0000","last_undegraded":"2024-09-22T01:37:01.829398+0000","last_fullsized":"2024-09-22T01:37:01.829398+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:39:36.709453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025435940000000001,"stat_sum":{"num_bytes":39952565,"num_objects":33,"num_object_clones":11,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":9,"num_read":1684,"num_read_kb":33709,"num_write":214,"num_write_kb":15737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":14075228,"num_keys_recovered":86,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"132'987","reported_seq":4391,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.785273+0000","last_change":"2024-09-22T01:36:07.627276+0000","last_active":"2024-09-22T01:37:01.785273+0000","last_peered":"2024-09-22T01:37:01.785273+0000","last_clean":"2024-09-22T01:37:01.785273+0000","last_became_active":"2024-09-22T01:36:07.623588+0000","last_became_peered":"2024-09-22T01:36:07.623588+0000","last_unstale":"2024-09-22T01:37:01.785273+0000","last_undegraded":"2024-09-22T01:37:01.785273+0000","last_fullsized":"2024-09-22T01:37:01.785273+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:06.692765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015758949999999999,"stat_sum":{"num_bytes":56664764,"num_objects":54,"num_object_clones":17,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":19,"num_read":8689,"num_read_kb":23503,"num_write":1512,"num_write_kb":13675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":13691067,"num_keys_recovered":116,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"132'377","reported_seq":4343,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.846542+0000","last_change":"2024-09-22T01:34:50.527581+0000","last_active":"2024-09-22T01:37:01.846542+0000","last_peered":"2024-09-22T01:37:01.846542+0000","last_clean":"2024-09-22T01:37:01.846542+0000","last_became_active":"2024-09-22T01:34:48.539769+0000","last_became_peered":"2024-09-22T01:34:48.539769+0000","last_unstale":"2024-09-22T01:37:01.846542+0000","last_undegraded":"2024-09-22T01:37:01.846542+0000","last_fullsized":"2024-09-22T01:37:01.846542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:49:48.988609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088464700000000002,"stat_sum":{"num_bytes":58498311,"num_objects":75,"num_object_clones":25,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":21,"num_read":4382,"num_read_kb":39271,"num_write":433,"num_write_kb":25002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"132'756","reported_seq":9147,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.814625+0000","last_change":"2024-09-22T01:34:50.534647+0000","last_active":"2024-09-22T01:37:01.814625+0000","last_peered":"2024-09-22T01:37:01.814625+0000","last_clean":"2024-09-22T01:37:01.814625+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:37:01.814625+0000","last_undegraded":"2024-09-22T01:37:01.814625+0000","last_fullsized":"2024-09-22T01:37:01.814625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:08:27.793887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039451500000000001,"stat_sum":{"num_bytes":108197294,"num_objects":65,"num_object_clones":23,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":18,"num_read":10530,"num_read_kb":63544,"num_write":1077,"num_write_kb":22672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"132'756","reported_seq":2750,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.847463+0000","last_change":"2024-09-22T01:36:03.611788+0000","last_active":"2024-09-22T01:37:01.847463+0000","last_peered":"2024-09-22T01:37:01.847463+0000","last_clean":"2024-09-22T01:37:01.847463+0000","last_became_active":"2024-09-22T01:36:03.522736+0000","last_became_peered":"2024-09-22T01:36:03.522736+0000","last_unstale":"2024-09-22T01:37:01.847463+0000","last_undegraded":"2024-09-22T01:37:01.847463+0000","last_fullsized":"2024-09-22T01:37:01.847463+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:03.556944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001133074,"stat_sum":{"num_bytes":75738821,"num_objects":46,"num_object_clones":16,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":16,"num_read":4719,"num_read_kb":17564,"num_write":1223,"num_write_kb":6961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1215906,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"132'410","reported_seq":5421,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.785831+0000","last_change":"2024-09-22T01:36:55.965855+0000","last_active":"2024-09-22T01:37:01.785831+0000","last_peered":"2024-09-22T01:37:01.785831+0000","last_clean":"2024-09-22T01:37:01.785831+0000","last_became_active":"2024-09-22T01:36:55.961880+0000","last_became_peered":"2024-09-22T01:36:55.961880+0000","last_unstale":"2024-09-22T01:37:01.785831+0000","last_undegraded":"2024-09-22T01:37:01.785831+0000","last_fullsized":"2024-09-22T01:37:01.785831+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:09:34.614208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015742040000000001,"stat_sum":{"num_bytes":55120394,"num_objects":65,"num_object_clones":23,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":22,"num_read":5746,"num_read_kb":32100,"num_write":444,"num_write_kb":34019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19187765,"num_keys_recovered":69,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"132'570","reported_seq":14366,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.782572+0000","last_change":"2024-09-22T01:36:56.967616+0000","last_active":"2024-09-22T01:37:01.782572+0000","last_peered":"2024-09-22T01:37:01.782572+0000","last_clean":"2024-09-22T01:37:01.782572+0000","last_became_active":"2024-09-22T01:36:56.965186+0000","last_became_peered":"2024-09-22T01:36:56.965186+0000","last_unstale":"2024-09-22T01:37:01.782572+0000","last_undegraded":"2024-09-22T01:37:01.782572+0000","last_fullsized":"2024-09-22T01:37:01.782572+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:47.968297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000879137,"stat_sum":{"num_bytes":90005672,"num_objects":77,"num_object_clones":31,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":25,"num_read":14560,"num_read_kb":34216,"num_write":635,"num_write_kb":12396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":17383598,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"132'237","reported_seq":4711,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.790904+0000","last_change":"2024-09-22T01:36:00.575390+0000","last_active":"2024-09-22T01:37:01.790904+0000","last_peered":"2024-09-22T01:37:01.790904+0000","last_clean":"2024-09-22T01:37:01.790904+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:37:01.790904+0000","last_undegraded":"2024-09-22T01:37:01.790904+0000","last_fullsized":"2024-09-22T01:37:01.790904+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:45:49.920740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016832139999999999,"stat_sum":{"num_bytes":63174317,"num_objects":50,"num_object_clones":20,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":18,"num_read":4118,"num_read_kb":34245,"num_write":229,"num_write_kb":8324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"132'323","reported_seq":5852,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.766932+0000","last_change":"2024-09-22T01:36:00.566907+0000","last_active":"2024-09-22T01:37:01.766932+0000","last_peered":"2024-09-22T01:37:01.766932+0000","last_clean":"2024-09-22T01:37:01.766932+0000","last_became_active":"2024-09-22T01:36:00.564509+0000","last_became_peered":"2024-09-22T01:36:00.564509+0000","last_unstale":"2024-09-22T01:37:01.766932+0000","last_undegraded":"2024-09-22T01:37:01.766932+0000","last_fullsized":"2024-09-22T01:37:01.766932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:57:33.722978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092607900000000001,"stat_sum":{"num_bytes":53050236,"num_objects":55,"num_object_clones":19,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":13,"num_read":6081,"num_read_kb":53717,"num_write":309,"num_write_kb":20279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":5198452,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":254,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.558812+0000","last_change":"2024-09-22T01:35:57.529367+0000","last_active":"2024-09-22T01:37:01.558812+0000","last_peered":"2024-09-22T01:37:01.558812+0000","last_clean":"2024-09-22T01:37:01.558812+0000","last_became_active":"2024-09-22T01:35:57.528484+0000","last_became_peered":"2024-09-22T01:35:57.528484+0000","last_unstale":"2024-09-22T01:37:01.558812+0000","last_undegraded":"2024-09-22T01:37:01.558812+0000","last_fullsized":"2024-09-22T01:37:01.558812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:00.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"132'362","reported_seq":5328,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.778863+0000","last_change":"2024-09-22T01:36:06.619666+0000","last_active":"2024-09-22T01:37:01.778863+0000","last_peered":"2024-09-22T01:37:01.778863+0000","last_clean":"2024-09-22T01:37:01.778863+0000","last_became_active":"2024-09-22T01:36:06.618495+0000","last_became_peered":"2024-09-22T01:36:06.618495+0000","last_unstale":"2024-09-22T01:37:01.778863+0000","last_undegraded":"2024-09-22T01:37:01.778863+0000","last_fullsized":"2024-09-22T01:37:01.778863+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:05:39.736076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014179189999999999,"stat_sum":{"num_bytes":90880345,"num_objects":73,"num_object_clones":27,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":28,"num_read":4960,"num_read_kb":38306,"num_write":362,"num_write_kb":37879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":25063433,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.568381+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:37:01.568381+0000","last_peered":"2024-09-22T01:37:01.568381+0000","last_clean":"2024-09-22T01:37:01.568381+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:37:01.568381+0000","last_undegraded":"2024-09-22T01:37:01.568381+0000","last_fullsized":"2024-09-22T01:37:01.568381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"132'284","reported_seq":2999,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.793449+0000","last_change":"2024-09-22T01:36:00.568511+0000","last_active":"2024-09-22T01:37:01.793449+0000","last_peered":"2024-09-22T01:37:01.793449+0000","last_clean":"2024-09-22T01:37:01.793449+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:37:01.793449+0000","last_undegraded":"2024-09-22T01:37:01.793449+0000","last_fullsized":"2024-09-22T01:37:01.793449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:47:13.010484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001738353,"stat_sum":{"num_bytes":34411398,"num_objects":48,"num_object_clones":13,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":3117,"num_read_kb":20432,"num_write":299,"num_write_kb":6716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":129,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.560147+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:37:01.560147+0000","last_peered":"2024-09-22T01:37:01.560147+0000","last_clean":"2024-09-22T01:37:01.560147+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:37:01.560147+0000","last_undegraded":"2024-09-22T01:37:01.560147+0000","last_fullsized":"2024-09-22T01:37:01.560147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"132'476","reported_seq":3440,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.789048+0000","last_change":"2024-09-22T01:36:12.662809+0000","last_active":"2024-09-22T01:37:01.789048+0000","last_peered":"2024-09-22T01:37:01.789048+0000","last_clean":"2024-09-22T01:37:01.789048+0000","last_became_active":"2024-09-22T01:36:12.660207+0000","last_became_peered":"2024-09-22T01:36:12.660207+0000","last_unstale":"2024-09-22T01:37:01.789048+0000","last_undegraded":"2024-09-22T01:37:01.789048+0000","last_fullsized":"2024-09-22T01:37:01.789048+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:25.299660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078463999999999997,"stat_sum":{"num_bytes":81121429,"num_objects":56,"num_object_clones":16,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":16,"num_read":4763,"num_read_kb":37097,"num_write":526,"num_write_kb":11108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.522780+0000","last_change":"2024-09-22T01:36:03.520390+0000","last_active":"2024-09-22T01:37:01.522780+0000","last_peered":"2024-09-22T01:37:01.522780+0000","last_clean":"2024-09-22T01:37:01.522780+0000","last_became_active":"2024-09-22T01:36:03.519493+0000","last_became_peered":"2024-09-22T01:36:03.519493+0000","last_unstale":"2024-09-22T01:37:01.522780+0000","last_undegraded":"2024-09-22T01:37:01.522780+0000","last_fullsized":"2024-09-22T01:37:01.522780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:25:49.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"132'402","reported_seq":7595,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.791390+0000","last_change":"2024-09-22T01:36:55.966422+0000","last_active":"2024-09-22T01:37:01.791390+0000","last_peered":"2024-09-22T01:37:01.791390+0000","last_clean":"2024-09-22T01:37:01.791390+0000","last_became_active":"2024-09-22T01:36:55.964550+0000","last_became_peered":"2024-09-22T01:36:55.964550+0000","last_unstale":"2024-09-22T01:37:01.791390+0000","last_undegraded":"2024-09-22T01:37:01.791390+0000","last_fullsized":"2024-09-22T01:37:01.791390+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:58:16.143109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032535960000000001,"stat_sum":{"num_bytes":117742756,"num_objects":63,"num_object_clones":21,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":17,"num_read":8091,"num_read_kb":53896,"num_write":455,"num_write_kb":18730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":11500499,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"132'192","reported_seq":992,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.774625+0000","last_change":"2024-09-22T01:36:07.624756+0000","last_active":"2024-09-22T01:37:01.774625+0000","last_peered":"2024-09-22T01:37:01.774625+0000","last_clean":"2024-09-22T01:37:01.774625+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:37:01.774625+0000","last_undegraded":"2024-09-22T01:37:01.774625+0000","last_fullsized":"2024-09-22T01:37:01.774625+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:56:43.858732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010842180000000001,"stat_sum":{"num_bytes":12829388,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":15,"num_read":1200,"num_read_kb":6159,"num_write":185,"num_write_kb":3422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":50,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.567909+0000","last_change":"2024-09-22T01:36:52.942994+0000","last_active":"2024-09-22T01:37:01.567909+0000","last_peered":"2024-09-22T01:37:01.567909+0000","last_clean":"2024-09-22T01:37:01.567909+0000","last_became_active":"2024-09-22T01:36:52.938230+0000","last_became_peered":"2024-09-22T01:36:52.938230+0000","last_unstale":"2024-09-22T01:37:01.567909+0000","last_undegraded":"2024-09-22T01:37:01.567909+0000","last_fullsized":"2024-09-22T01:37:01.567909+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:15:45.070433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"132'415","reported_seq":3370,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.809592+0000","last_change":"2024-09-22T01:36:39.854817+0000","last_active":"2024-09-22T01:37:01.809592+0000","last_peered":"2024-09-22T01:37:01.809592+0000","last_clean":"2024-09-22T01:37:01.809592+0000","last_became_active":"2024-09-22T01:36:39.852969+0000","last_became_peered":"2024-09-22T01:36:39.852969+0000","last_unstale":"2024-09-22T01:37:01.809592+0000","last_undegraded":"2024-09-22T01:37:01.809592+0000","last_fullsized":"2024-09-22T01:37:01.809592+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:04:00.099354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050027299999999997,"stat_sum":{"num_bytes":50207827,"num_objects":59,"num_object_clones":22,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":23,"num_read":3801,"num_read_kb":14410,"num_write":466,"num_write_kb":23542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.522946+0000","last_change":"2024-09-22T01:36:09.627096+0000","last_active":"2024-09-22T01:37:01.522946+0000","last_peered":"2024-09-22T01:37:01.522946+0000","last_clean":"2024-09-22T01:37:01.522946+0000","last_became_active":"2024-09-22T01:36:09.626669+0000","last_became_peered":"2024-09-22T01:36:09.626669+0000","last_unstale":"2024-09-22T01:37:01.522946+0000","last_undegraded":"2024-09-22T01:37:01.522946+0000","last_fullsized":"2024-09-22T01:37:01.522946+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:35.787005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"132'440","reported_seq":3965,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.776784+0000","last_change":"2024-09-22T01:37:01.533702+0000","last_active":"2024-09-22T01:37:01.776784+0000","last_peered":"2024-09-22T01:37:01.776784+0000","last_clean":"2024-09-22T01:37:01.776784+0000","last_became_active":"2024-09-22T01:37:01.529118+0000","last_became_peered":"2024-09-22T01:37:01.529118+0000","last_unstale":"2024-09-22T01:37:01.776784+0000","last_undegraded":"2024-09-22T01:37:01.776784+0000","last_fullsized":"2024-09-22T01:37:01.776784+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:45.601656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00150643,"stat_sum":{"num_bytes":42932634,"num_objects":59,"num_object_clones":18,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":23,"num_read":4649,"num_read_kb":25631,"num_write":508,"num_write_kb":13003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":13991851,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.560380+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:37:01.560380+0000","last_peered":"2024-09-22T01:37:01.560380+0000","last_clean":"2024-09-22T01:37:01.560380+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:37:01.560380+0000","last_undegraded":"2024-09-22T01:37:01.560380+0000","last_fullsized":"2024-09-22T01:37:01.560380+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"132'277","reported_seq":1869,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.785473+0000","last_change":"2024-09-22T01:36:55.966594+0000","last_active":"2024-09-22T01:37:01.785473+0000","last_peered":"2024-09-22T01:37:01.785473+0000","last_clean":"2024-09-22T01:37:01.785473+0000","last_became_active":"2024-09-22T01:36:55.964748+0000","last_became_peered":"2024-09-22T01:36:55.964748+0000","last_unstale":"2024-09-22T01:37:01.785473+0000","last_undegraded":"2024-09-22T01:37:01.785473+0000","last_fullsized":"2024-09-22T01:37:01.785473+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:35:40.954742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075466699999999999,"stat_sum":{"num_bytes":31819742,"num_objects":58,"num_object_clones":19,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":19,"num_read":1924,"num_read_kb":15585,"num_write":278,"num_write_kb":8143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":5501689,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":211,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.523268+0000","last_change":"2024-09-22T01:36:52.941962+0000","last_active":"2024-09-22T01:37:01.523268+0000","last_peered":"2024-09-22T01:37:01.523268+0000","last_clean":"2024-09-22T01:37:01.523268+0000","last_became_active":"2024-09-22T01:36:52.938403+0000","last_became_peered":"2024-09-22T01:36:52.938403+0000","last_unstale":"2024-09-22T01:37:01.523268+0000","last_undegraded":"2024-09-22T01:37:01.523268+0000","last_fullsized":"2024-09-22T01:37:01.523268+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:37:37.200935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":372,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.560086+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:37:01.560086+0000","last_peered":"2024-09-22T01:37:01.560086+0000","last_clean":"2024-09-22T01:37:01.560086+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:37:01.560086+0000","last_undegraded":"2024-09-22T01:37:01.560086+0000","last_fullsized":"2024-09-22T01:37:01.560086+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"132'602","reported_seq":1963,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.817904+0000","last_change":"2024-09-22T01:36:36.824540+0000","last_active":"2024-09-22T01:37:01.817904+0000","last_peered":"2024-09-22T01:37:01.817904+0000","last_clean":"2024-09-22T01:37:01.817904+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:37:01.817904+0000","last_undegraded":"2024-09-22T01:37:01.817904+0000","last_fullsized":"2024-09-22T01:37:01.817904+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":602,"log_dups_size":0,"ondisk_log_size":602,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:43:46.160865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001463764,"stat_sum":{"num_bytes":72651340,"num_objects":54,"num_object_clones":19,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":18,"num_read":6764,"num_read_kb":51217,"num_write":821,"num_write_kb":26258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"132'387","reported_seq":4988,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.784261+0000","last_change":"2024-09-22T01:36:12.659736+0000","last_active":"2024-09-22T01:37:01.784261+0000","last_peered":"2024-09-22T01:37:01.784261+0000","last_clean":"2024-09-22T01:37:01.784261+0000","last_became_active":"2024-09-22T01:36:12.658535+0000","last_became_peered":"2024-09-22T01:36:12.658535+0000","last_unstale":"2024-09-22T01:37:01.784261+0000","last_undegraded":"2024-09-22T01:37:01.784261+0000","last_fullsized":"2024-09-22T01:37:01.784261+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:54.898877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093062799999999997,"stat_sum":{"num_bytes":88448511,"num_objects":51,"num_object_clones":18,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":16,"num_read":4335,"num_read_kb":53648,"num_write":422,"num_write_kb":17358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2982858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"132'444","reported_seq":13316,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.823903+0000","last_change":"2024-09-22T01:34:50.552879+0000","last_active":"2024-09-22T01:37:01.823903+0000","last_peered":"2024-09-22T01:37:01.823903+0000","last_clean":"2024-09-22T01:37:01.823903+0000","last_became_active":"2024-09-22T01:34:48.551682+0000","last_became_peered":"2024-09-22T01:34:48.551682+0000","last_unstale":"2024-09-22T01:37:01.823903+0000","last_undegraded":"2024-09-22T01:37:01.823903+0000","last_fullsized":"2024-09-22T01:37:01.823903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:35:11.622143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013073900000000001,"stat_sum":{"num_bytes":102135472,"num_objects":63,"num_object_clones":22,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":21,"num_read":14622,"num_read_kb":18929,"num_write":468,"num_write_kb":18679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"132'357","reported_seq":2748,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.791391+0000","last_change":"2024-09-22T01:36:49.520539+0000","last_active":"2024-09-22T01:37:01.791391+0000","last_peered":"2024-09-22T01:37:01.791391+0000","last_clean":"2024-09-22T01:37:01.791391+0000","last_became_active":"2024-09-22T01:36:49.518943+0000","last_became_peered":"2024-09-22T01:36:49.518943+0000","last_unstale":"2024-09-22T01:37:01.791391+0000","last_undegraded":"2024-09-22T01:37:01.791391+0000","last_fullsized":"2024-09-22T01:37:01.791391+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:07:55.657104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000665578,"stat_sum":{"num_bytes":27491714,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":16,"num_read":2570,"num_read_kb":14133,"num_write":442,"num_write_kb":8942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":11703594,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"132'427","reported_seq":5164,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.589311+0000","last_change":"2024-09-22T01:36:56.963467+0000","last_active":"2024-09-22T01:37:01.589311+0000","last_peered":"2024-09-22T01:37:01.589311+0000","last_clean":"2024-09-22T01:37:01.589311+0000","last_became_active":"2024-09-22T01:36:56.961460+0000","last_became_peered":"2024-09-22T01:36:56.961460+0000","last_unstale":"2024-09-22T01:37:01.589311+0000","last_undegraded":"2024-09-22T01:37:01.589311+0000","last_fullsized":"2024-09-22T01:37:01.589311+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:15:02.636383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002331039,"stat_sum":{"num_bytes":83828320,"num_objects":62,"num_object_clones":21,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":21,"num_read":6092,"num_read_kb":34034,"num_write":441,"num_write_kb":16230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":12385245,"num_keys_recovered":34,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"132'387","reported_seq":4105,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.769939+0000","last_change":"2024-09-22T01:36:55.966398+0000","last_active":"2024-09-22T01:37:01.769939+0000","last_peered":"2024-09-22T01:37:01.769939+0000","last_clean":"2024-09-22T01:37:01.769939+0000","last_became_active":"2024-09-22T01:36:55.965257+0000","last_became_peered":"2024-09-22T01:36:55.965257+0000","last_unstale":"2024-09-22T01:37:01.769939+0000","last_undegraded":"2024-09-22T01:37:01.769939+0000","last_fullsized":"2024-09-22T01:37:01.769939+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:29:18.260848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015841550000000001,"stat_sum":{"num_bytes":78841944,"num_objects":58,"num_object_clones":23,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":17,"num_read":5084,"num_read_kb":19477,"num_write":485,"num_write_kb":16467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":10705889,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"132'607","reported_seq":3659,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.833996+0000","last_change":"2024-09-22T01:36:00.569408+0000","last_active":"2024-09-22T01:37:01.833996+0000","last_peered":"2024-09-22T01:37:01.833996+0000","last_clean":"2024-09-22T01:37:01.833996+0000","last_became_active":"2024-09-22T01:36:00.566088+0000","last_became_peered":"2024-09-22T01:36:00.566088+0000","last_unstale":"2024-09-22T01:37:01.833996+0000","last_undegraded":"2024-09-22T01:37:01.833996+0000","last_fullsized":"2024-09-22T01:37:01.833996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:47:16.846579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016331309999999999,"stat_sum":{"num_bytes":40217278,"num_objects":62,"num_object_clones":20,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":23,"num_read":4436,"num_read_kb":18524,"num_write":814,"num_write_kb":13146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":4264442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"131'562","reported_seq":2780,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.560330+0000","last_change":"2024-09-22T01:36:01.570787+0000","last_active":"2024-09-22T01:37:01.560330+0000","last_peered":"2024-09-22T01:37:01.560330+0000","last_clean":"2024-09-22T01:37:01.560330+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:37:01.560330+0000","last_undegraded":"2024-09-22T01:37:01.560330+0000","last_fullsized":"2024-09-22T01:37:01.560330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:11:05.165650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010627220000000001,"stat_sum":{"num_bytes":107763169,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":12,"num_read":4650,"num_read_kb":23944,"num_write":774,"num_write_kb":20819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"132'538","reported_seq":2113,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.786870+0000","last_change":"2024-09-22T01:36:06.621453+0000","last_active":"2024-09-22T01:37:01.786870+0000","last_peered":"2024-09-22T01:37:01.786870+0000","last_clean":"2024-09-22T01:37:01.786870+0000","last_became_active":"2024-09-22T01:36:06.619734+0000","last_became_peered":"2024-09-22T01:36:06.619734+0000","last_unstale":"2024-09-22T01:37:01.786870+0000","last_undegraded":"2024-09-22T01:37:01.786870+0000","last_fullsized":"2024-09-22T01:37:01.786870+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:39:33.030093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000712264,"stat_sum":{"num_bytes":52635873,"num_objects":49,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":16,"num_read":3746,"num_read_kb":13851,"num_write":664,"num_write_kb":16116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":4400829,"num_keys_recovered":58,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"131'309","reported_seq":5216,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.846516+0000","last_change":"2024-09-22T01:36:01.564545+0000","last_active":"2024-09-22T01:37:01.846516+0000","last_peered":"2024-09-22T01:37:01.846516+0000","last_clean":"2024-09-22T01:37:01.846516+0000","last_became_active":"2024-09-22T01:36:01.562260+0000","last_became_peered":"2024-09-22T01:36:01.562260+0000","last_unstale":"2024-09-22T01:37:01.846516+0000","last_undegraded":"2024-09-22T01:37:01.846516+0000","last_fullsized":"2024-09-22T01:37:01.846516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:20:15.025135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002148418,"stat_sum":{"num_bytes":68378078,"num_objects":67,"num_object_clones":24,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":19,"num_read":4632,"num_read_kb":45881,"num_write":299,"num_write_kb":23726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"132'401","reported_seq":4355,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.785511+0000","last_change":"2024-09-22T01:36:07.627824+0000","last_active":"2024-09-22T01:37:01.785511+0000","last_peered":"2024-09-22T01:37:01.785511+0000","last_clean":"2024-09-22T01:37:01.785511+0000","last_became_active":"2024-09-22T01:36:07.626370+0000","last_became_peered":"2024-09-22T01:36:07.626370+0000","last_unstale":"2024-09-22T01:37:01.785511+0000","last_undegraded":"2024-09-22T01:37:01.785511+0000","last_fullsized":"2024-09-22T01:37:01.785511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:22.268178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086911499999999995,"stat_sum":{"num_bytes":24995441,"num_objects":37,"num_object_clones":14,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":15,"num_read":4715,"num_read_kb":18694,"num_write":476,"num_write_kb":10228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":5846025,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"132'466","reported_seq":9979,"reported_epoch":132,"state":"active+clean","last_fresh":"2024-09-22T01:37:01.864564+0000","last_change":"2024-09-22T01:36:01.568141+0000","last_active":"2024-09-22T01:37:01.864564+0000","last_peered":"2024-09-22T01:37:01.864564+0000","last_clean":"2024-09-22T01:37:01.864564+0000","last_became_active":"2024-09-22T01:36:01.565891+0000","last_became_peered":"2024-09-22T01:36:01.565891+0000","last_unstale":"2024-09-22T01:37:01.864564+0000","last_undegraded":"2024-09-22T01:37:01.864564+0000","last_fullsized":"2024-09-22T01:37:01.864564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:21:20.285806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095816200000000003,"stat_sum":{"num_bytes":68256738,"num_objects":67,"num_object_clones":22,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":18,"num_read":10926,"num_read_kb":45777,"num_write":441,"num_write_kb":13427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":5871820,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2073330466,"num_objects":1798,"num_object_clones":612,"num_object_copies":3596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1798,"num_whiteouts":573,"num_read":182634,"num_read_kb":1016434,"num_write":18483,"num_write_kb":538213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3215,"num_bytes_recovered":273552772,"num_keys_recovered":690,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":716771328,"data_stored":910232312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14903,"ondisk_log_size":14903,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142484,"kb_used_data":93212,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94229356,"statfs":{"total":96636764160,"available":96490860544,"internally_reserved":0,"allocated":95449088,"data_stored":122785765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111528,"kb_used_data":72020,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94260312,"statfs":{"total":96636764160,"available":96522559488,"internally_reserved":0,"allocated":73748480,"data_stored":94471583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":0,"seq":55834574881,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209212,"kb_used_data":137728,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94162628,"statfs":{"total":96636764160,"available":96422531072,"internally_reserved":0,"allocated":141033472,"data_stored":175414767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187792,"kb_used_data":134400,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94184048,"statfs":{"total":96636764160,"available":96444465152,"internally_reserved":0,"allocated":137625600,"data_stored":170431989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89496,"kb_used_data":49976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94282344,"statfs":{"total":96636764160,"available":96545120256,"internally_reserved":0,"allocated":51175424,"data_stored":66977132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145876,"kb_used_data":114680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94225964,"statfs":{"total":96636764160,"available":96487387136,"internally_reserved":0,"allocated":117432320,"data_stored":142463012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129300,"kb_used_data":75900,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94242540,"statfs":{"total":96636764160,"available":96504360960,"internally_reserved":0,"allocated":77721600,"data_stored":106004067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":75431936,"data_stored":104557199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":115703808,"data_stored":141579474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49471488,"data_stored":66118902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":135909376,"data_stored":169557613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":130019328,"data_stored":162206263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":44855296,"data_stored":51107338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":72105984,"data_stored":93660335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":93274112,"data_stored":121445188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:37:05.269 INFO:tasks.thrashosds.thrasher:Setting 3.e to [7, 4] 2024-09-22T01:37:05.269 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.e', '7', '4'] 2024-09-22T01:37:05.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.e 7 4 2024-09-22T01:37:05.298 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:05.294+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:05.371 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:05.371 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:05.385 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:05.396 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:05.392+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:05.497 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:05.492+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:05.555 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:05.555 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:05.564 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:37:05.576 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:05.622 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:05.618+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:05.698 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:05.692+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:05.710 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:05.710 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:05.725 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:05.810 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:05.806+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:05.889 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:05.889 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:05.900 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:05.896+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:05.903 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:06.001 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:05.996+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:06.070 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:06.070 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:06.084 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:06.130 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:06.126+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:06.201 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:06.201 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:06.203 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:06.198+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:06.215 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:06.306 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:06.302+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:06.383 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:06.383 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:06.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:06.444 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:06.440+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:06.504 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:06.500+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:06.535 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:06.535 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:06.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:06.558 INFO:teuthology.orchestra.run.smithi018.stderr:set 3.e pg_upmap mapping to [7,4] 2024-09-22T01:37:06.605 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:06.602+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:06.691 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:06.691 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:06.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:06.706 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:06.702+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:06.807 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:06.800+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:06.826 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:06.826 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:06.840 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:06.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:06.908 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:06.906+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:07.009 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:07.009 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:07.010 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:07.006+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:07.024 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:07.096 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:07.096 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:07.110 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:07.110+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:07.129 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:07.129 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:07.163 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:07.163 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:07.194 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:07.194 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:07.194 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:07.194 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:07.195 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:07.211 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:07.210+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:07.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:07.222 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:07.223 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:07.243 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:07.244 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:07.264 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:07.265 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:07.285 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:07.286 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:07.342 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:07.342 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:07.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:07.342 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:07.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.342 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.539729260000001, 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.539674083999998, 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.348 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:37:07.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:37:07.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:37:07.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.353 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.539608971000007, 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:07.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:37:07.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:37:07.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:37:07.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.539543223999999, 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.359 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:37:07.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:07.364 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.539505754000004, 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:37:07.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:37:07.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:37:07.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.539455137999994, 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.370 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:37:07.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.538269799000005, 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:37:07.375 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:37:07.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.380 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.538207971999995, 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:07.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:37:07.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.538159172999997, 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:37:07.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.390 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.538085620000004, 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.391 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:37:07.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:37:07.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:37:07.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.538015157999993, 2024-09-22T01:37:07.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.401 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.537944655000004, 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:37:07.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:37:07.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.537897423000004, 2024-09-22T01:37:07.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.537834547000003, 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:37:07.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:37:07.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.537793880999999, 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.418 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:07.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:37:07.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:37:07.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:37:07.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.423 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.537699013999998, 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.537657976999995, 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:37:07.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:37:07.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:37:07.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:37:07.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.537620485999994, 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:37:07.434 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.439 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.537580336999994, 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:37:07.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 98.537537541999995, 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:37:07.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:37:07.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:37:07.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:37:07.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.450 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:07.450 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:37:07.450 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:37:07.450 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.450 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.450 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.450 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.450 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.450 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:07.450 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:07.336+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:07.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:07.492 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:07.488+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:07.554 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:07.548+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:07.599 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:37:07.640 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:147434 3.4 3:249375b1:::rbd_header.110f99820dc6:head [call rbd.get_size in=19b out=9b,call rbd.get_object_prefix in=20b,call rbd.get_features in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:37:07.639537+0000", 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.00039049499999999998, 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00047161600000000001, 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 147434 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.641 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:07.639537+0000", 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:07.639537+0000", 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:07.639540+0000", 2024-09-22T01:37:07.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.627e-06 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:07.639554+0000", 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.378e-05 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:07.639588+0000", 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4415999999999997e-05 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:07.639612+0000", 2024-09-22T01:37:07.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4349e-05 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:07.639710+0000", 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7473999999999995e-05 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:07.639803+0000", 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3651000000000002e-05 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 1 2024-09-22T01:37:07.644 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:07.655 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:07.650+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:07.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:07.755 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:07.748+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:07.839 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:07.839 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:07.839 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:07.839 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:07.839 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:07.854 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:07.857 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:07.850+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:07.958 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:07.952+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:08.016 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596463452000002, 2024-09-22T01:37:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:37:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:37:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596433263000002, 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:37:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:37:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:37:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596404169000003, 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:37:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:37:08.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596374544, 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:37:08.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:37:08.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596324651000003, 2024-09-22T01:37:08.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:37:08.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:37:08.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596292941000002, 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.042 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596263501999999, 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:37:08.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:37:08.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.046 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596234045999999, 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:37:08.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.050 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596204022999999, 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:37:08.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:37:08.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:37:08.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:37:08.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:37:08.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:37:08.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.055 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596158610000003, 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:37:08.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.057 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:08.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:08.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596129040999998, 2024-09-22T01:37:08.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.064 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596099230999997, 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:08.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:08.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:37:08.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:37:08.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:37:08.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:37:08.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:08.069 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596069944999996, 2024-09-22T01:37:08.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:37:08.070 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.070 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.070 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.070 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.070 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.071 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.071 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:37:08.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.071 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596036638999998, 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.075 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:08.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:08.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:37:08.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:37:08.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:37:08.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:37:08.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.596006733000003, 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.595976950000001, 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.084 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:37:08.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:37:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.595913134, 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.595878198000001, 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.092 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:08.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:37:08.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:37:08.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.595848457999999, 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 41.595818332, 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:37:08.100 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:08.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:37:08.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.104 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:08.105 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:08.106 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:08.100+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:08.206 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:08.200+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:08.277 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:08.277 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:08.278 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:08.278 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:08.292 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:08.307 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:08.306+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:08.408 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:08.406+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:08.462 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:08.462 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:08.462 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:08.462 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:08.462 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:08.476 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:08.522 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:08.516+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:08.523 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:37:08.609 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:08.606+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:08.616 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:08.616 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:08.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:08.616 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:08.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.616 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.616 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:08.616 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.488439988, 2024-09-22T01:37:08.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:37:08.616 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:37:08.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.620 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.488414252, 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:08.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:08.624 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.48838847, 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:37:08.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:37:08.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.488343551, 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:08.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:37:08.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.631 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.488311395, 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.632 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:08.635 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.488283663, 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.488247839, 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.639 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.488211695, 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:37:08.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:37:08.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:37:08.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.646 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.48817549, 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:08.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:08.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.488148138, 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.650 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.48811105999999, 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.654 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.657 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.488087523, 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:37:08.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:37:08.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.487540323, 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.48751256600001, 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:08.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.48749050000001, 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:08.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:37:08.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:37:08.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.48746034, 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:37:08.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.48703985, 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:08.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:37:08.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:37:08.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.487014069, 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:37:08.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:37:08.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 123.486992801, 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:37:08.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.688 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 20.075987405999999, 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:08.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:37:08.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:08.694 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:08.695 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:08.710 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:08.704+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:08.810 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:08.810+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:08.828 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:08.828 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:08.828 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:08.828 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:08.842 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:08.934 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:08.934+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:09.010 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:09.010 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:09.010 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:09.010 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:09.010 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:09.013 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:09.008+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:09.024 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:09.113 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:09.108+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:09.189 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:09.189 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:09.189 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:09.189 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:09.189 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.189 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:09.189 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 100.391398143, 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.190 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.191 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.192 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:37:09.193 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.194 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.195 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 71.679255424999994, 2024-09-22T01:37:09.196 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.197 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.198 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.199 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:37:09.200 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:37:09.201 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105543 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 10911744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.077737198999998, 2024-09-22T01:37:09.202 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064938994, 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105543 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.203 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110043+0000", 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110048+0000", 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6470000000000003e-06 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110066+0000", 2024-09-22T01:37:09.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8306999999999999e-05 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110081+0000", 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4362000000000001e-05 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174758+0000", 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064676685999999997 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174867+0000", 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109701 2024-09-22T01:37:09.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174980+0000", 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000113238 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.077651518000003, 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.206 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:09.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:37:09.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.077585835000001, 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.210 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:37:09.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:37:09.213 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.077520087000003, 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.214 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:37:09.217 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.077477488, 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:37:09.218 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.219 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:37:09.220 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:37:09.221 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.222 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.077329781000003, 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.223 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.224 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.225 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:37:09.226 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.077170391999999, 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.227 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.228 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:37:09.229 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:37:09.230 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.07710659, 2024-09-22T01:37:09.231 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:37:09.233 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:37:09.234 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.235 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.077046400999997, 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:09.236 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:37:09.237 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:37:09.238 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.239 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.076982958999999, 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.240 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.241 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.076927703999999, 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:37:09.243 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:09.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:37:09.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:37:09.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.076873904999999, 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.247 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:37:09.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.076812953000001, 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.251 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.076755253999998, 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.255 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.076666803000002, 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.259 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:37:09.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:37:09.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.076580907999997, 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.263 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:37:09.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:37:09.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 42.076496059999997, 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.267 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:37:09.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:37:09.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 14.956420768999999, 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:37:09.271 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:09.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:09.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:09.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:37:09.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:37:09.276 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.276 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.276 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.276 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:09.276 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:09.276 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:09.277 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:09.278 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:09.274+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:09.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:09.378 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:09.372+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:09.448 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:09.448 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:09.462 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:09.464 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:09.481 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:09.481 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:09.499 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:09.499 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:09.510 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:09.510+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:09.516 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:09.516 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:09.533 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:09.534 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:09.552 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:09.552 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:09.571 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:09.571 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:09.578 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:09.578+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:09.584 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:09.584 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:09.605 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:09.679 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:09.672+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:09.772 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:09.772 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:09.781 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:09.778+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:09.786 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:09.799 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:09.799 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:09.882 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:09.876+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:09.953 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:09.953 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:09.968 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:10.014 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:10.014+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:10.083 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:10.080+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:10.090 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:10.090 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:10.104 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:10.184 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:10.180+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:10.268 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:10.268 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:10.282 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:10.284 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:10.280+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:10.386 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:10.386+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:10.414 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:10.487 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:10.480+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:10.558 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:37:10.582 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:10.582 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:10.599 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:10.604 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:10.600+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:10.688 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:10.684+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:10.728 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:10.728 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:10.744 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:10.789 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:10.784+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:10.864 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:10.864 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:10.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:10.920 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:10.916+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:10.991 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:10.990+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:11.045 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:11.045 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:11.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:11.104 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:11.100+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:11.188 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:11.188 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:11.192 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:11.190+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:11.202 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:11.292 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:11.290+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:11.371 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:11.371 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:11.385 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:11.394 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:11.394+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:11.495 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:11.494+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:11.515 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:11.516 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:11.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:11.597 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:11.594+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:11.598 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 6, 7, 0, 2] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:37:11.598 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:37:11.598 INFO:tasks.thrashosds.thrasher:Adding osd 5 2024-09-22T01:37:11.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 5 2024-09-22T01:37:11.605 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:37:11.662 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:11.662 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:11.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:11.720 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:11.716+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:11.799 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:11.798+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:11.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:11.858 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:11.858 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:11.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:11.916 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:11.912+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:11.935 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-22T01:37:11.928+0000 7fb667fae640 -1 mon.a@0(leader).osd e141 definitely_dead 0 2024-09-22T01:37:11.965 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:11.983 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:12.000 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:11.996+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:12.002 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:12.002 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:12.020 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:12.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:12.040 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:12.040 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:12.040 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:12.040 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:12.041 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:12.041 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:12.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:12.062 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:12.062 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:12.083 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:12.083 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:12.101 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:12.096+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:12.104 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:12.104 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:12.194 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776697650000003, 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.195 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:37:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:37:12.198 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776667461000002, 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:37:12.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776638366999997, 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.206 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776608742000001, 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:12.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:37:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:37:12.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:37:12.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776558848999997, 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:37:12.211 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:12.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776527139000002, 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:37:12.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:37:12.218 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.7764977, 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.219 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:12.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776468244, 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.223 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776438220999999, 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:37:12.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:12.231 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776392807999997, 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:37:12.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:37:12.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776363238999998, 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.239 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776333428999997, 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.240 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776304142999997, 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:37:12.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:12.247 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776270836999998, 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:37:12.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:37:12.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776240930999997, 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:12.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.254 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776211148000002, 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:37:12.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:37:12.258 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776147332000001, 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:37:12.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776112396000002, 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.263 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.266 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776082656, 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 45.776052530000001, 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.271 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:12.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:37:12.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:37:12.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.275 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:12.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:12.277 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:12.272+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:12.377 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:12.374+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:12.451 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:12.452 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:12.452 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:12.452 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:12.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:12.477 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:12.474+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:12.578 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:12.572+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:12.584 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:12.585 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:12.585 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:12.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:12.600 INFO:teuthology.orchestra.run.smithi018.stderr:marked in osd.5. 2024-09-22T01:37:12.636 INFO:tasks.thrashosds.thrasher:Added osd 5 2024-09-22T01:37:12.679 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:12.678+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:12.721 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:12.721 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:12.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:12.721 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:12.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.59243784500001, 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:37:12.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:37:12.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:37:12.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.59241210899999, 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:12.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:37:12.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.729 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.592386327, 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:37:12.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:37:12.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.592341408, 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:37:12.733 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:37:12.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.59230925200001, 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.737 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:37:12.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.740 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.59228152, 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:12.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:37:12.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.59224569600001, 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.744 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.592209552, 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.748 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:37:12.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:37:12.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.751 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.592173347, 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.592145995, 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.755 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.592108917, 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.762 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.59208538, 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:12.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:37:12.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.59153818, 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.766 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:12.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.591510423, 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:37:12.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.591488357, 2024-09-22T01:37:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.59145819699999, 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.777 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:12.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:37:12.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:37:12.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.591037707, 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.781 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.59101192599999, 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.785 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:37:12.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:37:12.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.788 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 127.590990658, 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:12.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 24.179985262999999, 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:37:12.792 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:12.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:37:12.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:37:12.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:12.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:12.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:12.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:37:12.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:37:12.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.798 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:12.798 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:12.798 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:12.799 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:12.800 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:12.792+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:12.901 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:12.900+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:12.928 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:12.929 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:12.942 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:13.002 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:13.002+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:13.060 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:13.060 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:13.061 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:13.061 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:13.061 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:13.075 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:13.103 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:13.100+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:13.204 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:13.200+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.44388315400001, 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:13.244 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.245 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:37:13.246 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.247 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.248 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:37:13.249 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.250 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 75.731740435999995, 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.251 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:37:13.252 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.253 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:37:13.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:37:13.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.256 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105543 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 10911744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.130222209999999, 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064938994, 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105543 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:13.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110043+0000", 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110048+0000", 2024-09-22T01:37:13.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6470000000000003e-06 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110066+0000", 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8306999999999999e-05 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110081+0000", 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4362000000000001e-05 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174758+0000", 2024-09-22T01:37:13.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064676685999999997 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174867+0000", 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109701 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174980+0000", 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000113238 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.260 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.130136528999998, 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:13.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:37:13.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:37:13.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.264 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.130070846000002, 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:13.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:37:13.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:37:13.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.130005097999998, 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.272 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129962499000001, 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:37:13.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.276 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129814791999998, 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129655403000001, 2024-09-22T01:37:13.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129591601000001, 2024-09-22T01:37:13.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:13.288 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129531411999999, 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.12946797, 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:37:13.292 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129412715000001, 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.296 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129358916000001, 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:37:13.300 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:37:13.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129297964000003, 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.304 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:37:13.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:37:13.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129240265, 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.308 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:37:13.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129151813999997, 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.312 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:37:13.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:37:13.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.315 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.129065918999999, 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.316 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.319 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 46.128981070999998, 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.320 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 19.008905779999999, 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.324 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:37:13.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.328 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:13.330 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:13.330 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:13.324+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:13.430 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:13.424+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:13.456 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:13.456 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148273 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.81340970599999995, 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.81345327499999998, 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "waiting for peered", 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148273 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.457 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643365+0000", 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8260000000000001e-06 2024-09-22T01:37:13.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643378+0000", 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2397e-05 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643411+0000", 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3704999999999997e-05 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643428+0000", 2024-09-22T01:37:13.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6793999999999999e-05 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643573+0000", 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014461199999999999 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643590+0000", 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7652999999999999e-05 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.460 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:37:13.461 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 1 2024-09-22T01:37:13.461 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:13.470 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:13.533 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:13.524+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:13.595 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:13.595 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:13.595 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:13.595 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:13.595 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:13.610 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:13.632 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:37:13.632 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:13.628+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:13.733 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:13.728+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:13.734 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:13.734 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:13.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:13.734 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:13.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.734 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:13.734 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:37:13.734 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.284566072999993, 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:37:13.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:37:13.736 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.737 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.738 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.280597846999996, 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:37:13.739 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:37:13.740 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.741 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.742 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.280578786999996, 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.743 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.744 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.745 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.746 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.280352923999999, 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.747 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.748 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.749 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.750 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.272822581, 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.751 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.752 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.753 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.754 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.268841285999997, 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.755 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.756 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.757 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.758 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.264623202999999, 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.759 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.760 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.761 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.762 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111086 3.c 3:35fd2b6c:::rbd_data.110fb46d971e.0000000000000006:24 [read 835584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.046788694, 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094586389000000007, 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111086 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.763 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8699999999999995e-07 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.764 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684828+0000", 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6847e-05 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684836+0000", 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6539999999999999e-06 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684841+0000", 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.896e-06 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.765 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776879+0000", 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.092037657999999994 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776960+0000", 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0653000000000002e-05 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779397+0000", 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024371940000000002 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.766 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111087 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.046735763000001, 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094592211999999995, 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111087 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.767 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684864+0000", 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0500000000000003e-07 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684867+0000", 2024-09-22T01:37:13.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2820000000000001e-06 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684887+0000", 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9834e-05 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684892+0000", 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3220000000000003e-06 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779442+0000", 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094550318999999994 2024-09-22T01:37:13.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779456+0000", 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.385e-05 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111088 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.04669904, 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094599416000000006, 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.770 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111088 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684901+0000", 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3300000000000003e-07 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684906+0000", 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684912+0000", 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8819999999999998e-06 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684919+0000", 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0330000000000003e-06 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779492+0000", 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094573333999999995 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779500+0000", 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7360000000000001e-06 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111089 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.046672135999998, 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094616622999999997, 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111089 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.774 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684928+0000", 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7399999999999998e-07 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684930+0000", 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.881e-06 2024-09-22T01:37:13.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684938+0000", 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5689999999999999e-06 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684944+0000", 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.665e-06 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779538+0000", 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094594370999999997 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779544+0000", 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6629999999999998e-06 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111090 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.046636085000003, 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094605844999999994, 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.777 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111090 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684964+0000", 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8999999999999997e-07 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684967+0000", 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4460000000000001e-06 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684975+0000", 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.943e-06 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684990+0000", 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4482e-05 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779561+0000", 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094571526000000003 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779569+0000", 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9580000000000007e-06 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.780 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111091 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.046591462999999, 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094588915999999995, 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111091 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:13.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685012+0000", 2024-09-22T01:37:13.782 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.602e-06 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685020+0000", 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2300000000000008e-06 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685030+0000", 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5719999999999992e-06 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779591+0000", 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094560898000000004 2024-09-22T01:37:13.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779597+0000", 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9569999999999999e-06 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111092 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.046559731999999, 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094585007999999998, 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.784 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111092 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685043+0000", 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7269999999999999e-06 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.786 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685051+0000", 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3140000000000004e-06 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685057+0000", 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9739999999999999e-06 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779618+0000", 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094561289000000007 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.787 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779625+0000", 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.195e-06 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111093 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.046534418, 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094587735000000006, 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.788 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111093 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.789 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685537+0000", 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00047185400000000001 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685543+0000", 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9410000000000004e-06 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685555+0000", 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2449999999999999e-05 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685563+0000", 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6279999999999996e-06 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779648+0000", 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094084962999999994 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779653+0000", 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.899e-06 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.791 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111094 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.046011403999998, 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091857000000001, 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111094 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685589+0000", 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5300000000000004e-07 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685595+0000", 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8229999999999997e-06 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685602+0000", 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8730000000000001e-06 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685607+0000", 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5279999999999997e-06 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779675+0000", 2024-09-22T01:37:13.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094068054999999998 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779680+0000", 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9250000000000003e-06 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111095 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.045985846000001, 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091049999999996, 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.795 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111095 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685614+0000", 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5600000000000001e-07 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685615+0000", 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.593e-06 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685619+0000", 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1150000000000004e-06 2024-09-22T01:37:13.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685623+0000", 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3529999999999999e-06 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779700+0000", 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094076749000000001 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779704+0000", 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8840000000000002e-06 2024-09-22T01:37:13.798 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111096 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.045972007000003, 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094106891999999998, 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.799 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111096 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685756+0000", 2024-09-22T01:37:13.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012857600000000001 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685761+0000", 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.118e-06 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685770+0000", 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0650000000000005e-06 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685794+0000", 2024-09-22T01:37:13.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4202999999999998e-05 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779729+0000", 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093934985999999998 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779734+0000", 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9439999999999996e-06 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111097 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685807+0000", 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 43.045791915000002, 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093953446999999995, 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111097 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685807+0000", 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685807+0000", 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685808+0000", 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685812+0000", 2024-09-22T01:37:13.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.6830000000000001e-06 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685821+0000", 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.1300000000000007e-06 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685827+0000", 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1460000000000001e-06 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779755+0000", 2024-09-22T01:37:13.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093928426999999995 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779761+0000", 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3990000000000003e-06 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148273 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.088236779, 2024-09-22T01:37:13.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.88034022700000003, 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148273 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643365+0000", 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8260000000000001e-06 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643378+0000", 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2397e-05 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643411+0000", 2024-09-22T01:37:13.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3704999999999997e-05 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643428+0000", 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6793999999999999e-05 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643573+0000", 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014461199999999999 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643590+0000", 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7652999999999999e-05 2024-09-22T01:37:13.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523688+0000", 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.880097766 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523703+0000", 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4474000000000001e-05 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:13.810 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:13.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:13.834 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:13.828+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:13.934 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:13.928+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:13.938 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:13.938 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:13.939 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:13.939 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:13.952 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:14.035 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:14.034+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:14.074 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:14.074 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:14.074 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:14.074 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:14.074 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:14.088 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:14.124 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:14.168 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:14.164+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:14.237 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:14.234+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:14.255 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:14.255 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.177348947, 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.256 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.177311919, 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:14.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:37:14.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:14.263 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.165761459, 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:37:14.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.165727452, 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.16186010200001, 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.271 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:37:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.161814554, 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:37:14.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.278 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.161769346, 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:37:14.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.16173475399999, 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.282 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:37:14.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:37:14.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.161701106, 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.286 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:14.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:37:14.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:37:14.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.157971616, 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:37:14.290 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.15793511299999, 2024-09-22T01:37:14.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.157890474, 2024-09-22T01:37:14.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:37:14.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.157840248, 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.302 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.15780180599999, 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.306 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:37:14.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.157757811, 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:37:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.157718661, 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:37:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:37:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.153875493, 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:37:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:37:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 106.153795167, 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:37:14.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:37:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 105.449241871, 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:14.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 104.45510030299999, 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:37:14.330 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:14.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:37:14.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:37:14.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:14.335 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:14.336 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:14.336 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:14.336 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:14.337 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:14.337 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:14.337 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:14.338 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:14.338 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:14.338 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:14.339 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:14.332+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:14.352 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:14.352 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:14.373 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:14.373 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:14.395 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:14.395 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:14.413 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:14.413 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:14.476 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:14.472+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:14.500 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:14.500 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:14.514 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:14.520 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:37:14.558 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:14.558+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:14.634 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:14.635 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:14.642 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:14.636+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:14.649 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:14.743 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:14.736+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:14.816 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:14.816 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:14.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:14.843 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:14.842+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:14.944 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:14.940+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:14.968 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:14.968 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:14.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:15.045 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:15.042+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:15.145 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:15.142+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:15.173 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:15.174 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:15.189 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:15.247 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:15.246+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:15.324 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:15.325 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:15.339 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:15.384 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:15.380+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:15.448 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:15.446+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:15.467 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:15.467 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:15.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:15.550 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:15.550+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:15.652 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:15.648+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:15.658 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:15.659 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:15.682 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:15.772 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:15.768+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:15.853 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:15.848+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:15.860 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:15.860 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:15.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:15.964 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:15.960+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:16.055 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:16.048+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:16.055 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:16.055 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:16.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:16.156 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:16.154+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:16.242 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:16.242 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:16.256 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:16.254+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:16.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:16.358 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:16.358+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:16.377 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:16.377 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:16.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:16.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:16.458 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:16.458+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:16.522 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:16.522 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:16.538 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:16.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:37:16.581 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:16.581 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:16.582 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:16.576+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:16.598 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:16.599 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:16.617 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:16.617 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:16.636 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:16.636 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:16.661 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:16.658+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:16.666 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:16.666 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:16.667 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:16.667 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:16.667 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:16.667 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:16.667 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:16.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:16.698 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:16.699 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:16.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:16.727 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:16.751 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:16.752 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:16.761 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:16.758+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:16.830 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.702737953, 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.702712217, 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.835 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.836 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.838 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.702686435, 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.839 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:37:16.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:37:16.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.702641516, 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.843 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.70260936, 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:16.850 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.70258162799999, 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.70254580400001, 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.854 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:37:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.70250966, 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:37:16.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.70247345499999, 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.702446103, 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:37:16.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.70240902500001, 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.868 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.869 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:37:16.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.871 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.702385488, 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.872 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.873 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.701838288, 2024-09-22T01:37:16.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:37:16.877 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.878 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.70181053100001, 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:37:16.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:37:16.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.70178846499999, 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:37:16.882 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:37:16.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.701758305, 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.70133781499999, 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:37:16.889 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:37:16.892 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.70131203400001, 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:37:16.893 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:37:16.894 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.895 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:16.896 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 131.701290766, 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.897 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:37:16.898 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:37:16.899 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 28.290285371, 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:16.900 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:16.901 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:16.902 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:16.903 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:37:16.904 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:37:16.905 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:16.906 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:16.907 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:16.908 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:16.900+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:17.008 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:17.006+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:17.041 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:17.041 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:17.041 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:17.041 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:17.055 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:17.109 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:17.104+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:17.210 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:17.204+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:17.228 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:17.228 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:17.228 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:17.228 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:17.228 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:17.243 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:17.311 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:17.310+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 108.57405567399999, 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.400 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:17.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:37:17.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:37:17.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:37:17.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.406 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 79.861912955999998, 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:17.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:17.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:37:17.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105543 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 10911744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.260394730000002, 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064938994, 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.412 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105543 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110043+0000", 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110048+0000", 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6470000000000003e-06 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110066+0000", 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8306999999999999e-05 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110081+0000", 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4362000000000001e-05 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174758+0000", 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064676685999999997 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174867+0000", 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109701 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174980+0000", 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000113238 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.260309049, 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.416 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:37:17.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.418 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.260243365999997, 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:17.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.260177618, 2024-09-22T01:37:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:37:17.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.260135019000003, 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.427 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:37:17.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.430 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259987312, 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259827923000003, 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.435 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:37:17.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259764121000003, 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:37:17.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259703932000001, 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.443 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259640490000002, 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.447 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:37:17.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.450 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259585235000003, 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.451 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:37:17.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:37:17.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:37:17.454 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259531436000003, 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:37:17.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:37:17.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.458 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259470483999998, 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.462 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259412785000002, 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:37:17.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259324333999999, 2024-09-22T01:37:17.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:37:17.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259238439000001, 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.470 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:37:17.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.473 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 50.259153591, 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.474 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:37:17.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.477 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 23.139078300000001, 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:37:17.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:37:17.481 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.482 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.482 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.482 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.482 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.482 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:17.482 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:17.483 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:17.482+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:17.584 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:17.582+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:17.623 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:17.623 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:17.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.623 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148611 3.5 3.11916ca5 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e146)", 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.77536935200000001, 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.775385451, 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "waiting for peered", 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148611 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:37:17.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848542+0000", 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6899999999999999e-06 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848551+0000", 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7499999999999992e-06 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848571+0000", 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0645999999999999e-05 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848582+0000", 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0773e-05 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848660+0000", 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7389000000000001e-05 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:17.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848673+0000", 2024-09-22T01:37:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3222e-05 2024-09-22T01:37:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:37:17.627 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 1 2024-09-22T01:37:17.627 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:17.636 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 6, 7, 0, 2, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:37:17.636 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:37:17.637 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:37:17.639 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:17.656 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:37:17.685 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:17.680+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:17.786 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:17.786+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:17.818 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:17.818 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:17.818 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:17.818 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:17.818 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:17.833 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:17.918 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:17.918+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:17.977 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:17.978 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:37:17.988 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:17.984+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:17.998 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2024-09-22T01:37:17.660235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1821613382,"num_objects":1440,"num_object_clones":471,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":211,"num_objects_misplaced":160,"num_objects_unfound":0,"num_objects_dirty":1440,"num_whiteouts":468,"num_read":189613,"num_read_kb":1028462,"num_write":19807,"num_write_kb":543482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3754,"num_bytes_recovered":321049000,"num_keys_recovered":810,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16376,"ondisk_log_size":16376,"up":82,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":960172,"kb_used_data":577340,"kb_used_omap":12,"kb_used_meta":382579,"kb_avail":754014548,"statfs":{"total":773094113280,"available":772110897152,"internally_reserved":0,"allocated":591196160,"data_stored":728879001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":391761456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-75387226,"num_objects":-29,"num_object_clones":-11,"num_object_copies":-58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":211,"num_objects_misplaced":160,"num_objects_unfound":0,"num_objects_dirty":-29,"num_whiteouts":-4,"num_read":551,"num_read_kb":473,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":46315473,"num_keys_recovered":120,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.141568"},"pg_stats":[{"pgid":"3.1f","version":"140'643","reported_seq":5408,"reported_epoch":146,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-22T01:37:16.653827+0000","last_change":"2024-09-22T01:37:14.992828+0000","last_active":"2024-09-22T01:37:16.653827+0000","last_peered":"2024-09-22T01:37:16.653827+0000","last_clean":"2024-09-22T01:37:11.622569+0000","last_became_active":"2024-09-22T01:37:14.990983+0000","last_became_peered":"2024-09-22T01:37:14.990983+0000","last_unstale":"2024-09-22T01:37:16.653827+0000","last_undegraded":"2024-09-22T01:37:14.526310+0000","last_fullsized":"2024-09-22T01:37:14.523769+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001359395,"stat_sum":{"num_bytes":51151166,"num_objects":35,"num_object_clones":12,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":106,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":6587,"num_read_kb":35208,"num_write":853,"num_write_kb":14977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":14516200,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0,2","objects":35}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"29","length":"5"}]},{"pgid":"3.1e","version":"144'500","reported_seq":4291,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.651762+0000","last_change":"2024-09-22T01:37:15.652113+0000","last_active":"2024-09-22T01:37:16.651762+0000","last_peered":"2024-09-22T01:37:16.651762+0000","last_clean":"2024-09-22T01:37:16.651762+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:37:16.651762+0000","last_undegraded":"2024-09-22T01:37:16.651762+0000","last_fullsized":"2024-09-22T01:37:16.651762+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:53:50.061262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001573884,"stat_sum":{"num_bytes":60510250,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":8,"num_read":5822,"num_read_kb":47547,"num_write":548,"num_write_kb":23734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.1d","version":"139'948","reported_seq":3323,"reported_epoch":146,"state":"active+undersized+remapped","last_fresh":"2024-09-22T01:37:16.783725+0000","last_change":"2024-09-22T01:37:16.784072+0000","last_active":"2024-09-22T01:37:16.783725+0000","last_peered":"2024-09-22T01:37:16.783725+0000","last_clean":"2024-09-22T01:37:11.604180+0000","last_became_active":"2024-09-22T01:37:15.001769+0000","last_became_peered":"2024-09-22T01:37:15.001769+0000","last_unstale":"2024-09-22T01:37:16.783725+0000","last_undegraded":"2024-09-22T01:37:16.783725+0000","last_fullsized":"2024-09-22T01:37:14.528118+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":948,"log_dups_size":0,"ondisk_log_size":948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016569690000000001,"stat_sum":{"num_bytes":63288244,"num_objects":45,"num_object_clones":16,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":15,"num_read":5457,"num_read_kb":33849,"num_write":1483,"num_write_kb":16564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[4],"avail_no_missing":["4","5","6"],"object_location_counts":[{"shards":"4","objects":45}],"blocked_by":[],"up_primary":5,"acting_primary":4,"purged_snaps":[{"start":"29","length":"5"}]},{"pgid":"3.1c","version":"146'240","reported_seq":2495,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.848098+0000","last_change":"2024-09-22T01:37:16.672614+0000","last_active":"2024-09-22T01:37:16.848098+0000","last_peered":"2024-09-22T01:37:16.848098+0000","last_clean":"2024-09-22T01:37:16.848098+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:37:16.848098+0000","last_undegraded":"2024-09-22T01:37:16.848098+0000","last_fullsized":"2024-09-22T01:37:16.848098+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:51:07.215973+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0068336509999999996,"stat_sum":{"num_bytes":30972312,"num_objects":26,"num_object_clones":8,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":8,"num_read":1961,"num_read_kb":34813,"num_write":244,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.1b","version":"141'1006","reported_seq":4484,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.653666+0000","last_change":"2024-09-22T01:37:15.669550+0000","last_active":"2024-09-22T01:37:16.653666+0000","last_peered":"2024-09-22T01:37:16.653666+0000","last_clean":"2024-09-22T01:37:16.653666+0000","last_became_active":"2024-09-22T01:36:07.623588+0000","last_became_peered":"2024-09-22T01:36:07.623588+0000","last_unstale":"2024-09-22T01:37:16.653666+0000","last_undegraded":"2024-09-22T01:37:16.653666+0000","last_fullsized":"2024-09-22T01:37:16.653666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1006,"log_dups_size":0,"ondisk_log_size":1006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:17:04.759259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083383199999999995,"stat_sum":{"num_bytes":53928636,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":18,"num_read":8691,"num_read_kb":23503,"num_write":1527,"num_write_kb":13710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":13691067,"num_keys_recovered":116,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.1a","version":"141'416","reported_seq":4608,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.834665+0000","last_change":"2024-09-22T01:37:15.664310+0000","last_active":"2024-09-22T01:37:16.834665+0000","last_peered":"2024-09-22T01:37:16.834665+0000","last_clean":"2024-09-22T01:37:16.834665+0000","last_became_active":"2024-09-22T01:34:48.539769+0000","last_became_peered":"2024-09-22T01:34:48.539769+0000","last_unstale":"2024-09-22T01:37:16.834665+0000","last_undegraded":"2024-09-22T01:37:16.834665+0000","last_fullsized":"2024-09-22T01:37:16.834665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:03.528201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012243410000000001,"stat_sum":{"num_bytes":53768378,"num_objects":61,"num_object_clones":20,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":17,"num_read":4549,"num_read_kb":39896,"num_write":455,"num_write_kb":25278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.19","version":"145'779","reported_seq":9249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.651974+0000","last_change":"2024-09-22T01:37:15.660417+0000","last_active":"2024-09-22T01:37:16.651974+0000","last_peered":"2024-09-22T01:37:16.651974+0000","last_clean":"2024-09-22T01:37:16.651974+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:37:16.651974+0000","last_undegraded":"2024-09-22T01:37:16.651974+0000","last_fullsized":"2024-09-22T01:37:16.651974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:50:13.936174+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0067776770000000002,"stat_sum":{"num_bytes":93712950,"num_objects":54,"num_object_clones":19,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":14,"num_read":10540,"num_read_kb":63628,"num_write":1089,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.18","version":"144'918","reported_seq":2996,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.649706+0000","last_change":"2024-09-22T01:37:15.654486+0000","last_active":"2024-09-22T01:37:16.649706+0000","last_peered":"2024-09-22T01:37:16.649706+0000","last_clean":"2024-09-22T01:37:16.649706+0000","last_became_active":"2024-09-22T01:36:03.522736+0000","last_became_peered":"2024-09-22T01:36:03.522736+0000","last_unstale":"2024-09-22T01:37:16.649706+0000","last_undegraded":"2024-09-22T01:37:16.649706+0000","last_fullsized":"2024-09-22T01:37:16.649706+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":918,"log_dups_size":0,"ondisk_log_size":918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:51:56.536492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003645241,"stat_sum":{"num_bytes":62483865,"num_objects":29,"num_object_clones":10,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":11,"num_read":5437,"num_read_kb":18149,"num_write":1477,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1215906,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.17","version":"140'426","reported_seq":5752,"reported_epoch":145,"state":"peering","last_fresh":"2024-09-22T01:37:16.046076+0000","last_change":"2024-09-22T01:37:16.653527+0000","last_active":"2024-09-22T01:37:16.653527+0000","last_peered":"2024-09-22T01:37:16.046076+0000","last_clean":"2024-09-22T01:37:11.622224+0000","last_became_active":"2024-09-22T01:37:14.987652+0000","last_became_peered":"2024-09-22T01:37:14.987652+0000","last_unstale":"2024-09-22T01:37:16.046076+0000","last_undegraded":"2024-09-22T01:37:16.046076+0000","last_fullsized":"2024-09-22T01:37:14.523286+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012594609999999999,"stat_sum":{"num_bytes":48497162,"num_objects":56,"num_object_clones":19,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":19,"num_read":5746,"num_read_kb":32100,"num_write":452,"num_write_kb":34044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,5],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"29","length":"5"}]},{"pgid":"3.16","version":"141'614","reported_seq":14546,"reported_epoch":146,"state":"active+recovery_wait+remapped","last_fresh":"2024-09-22T01:37:16.652556+0000","last_change":"2024-09-22T01:37:14.991088+0000","last_active":"2024-09-22T01:37:16.652556+0000","last_peered":"2024-09-22T01:37:16.652556+0000","last_clean":"2024-09-22T01:37:11.749648+0000","last_became_active":"2024-09-22T01:37:14.988292+0000","last_became_peered":"2024-09-22T01:37:14.988292+0000","last_unstale":"2024-09-22T01:37:16.652556+0000","last_undegraded":"2024-09-22T01:37:16.652556+0000","last_fullsized":"2024-09-22T01:37:16.652556+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":614,"log_dups_size":0,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003364457,"stat_sum":{"num_bytes":84508840,"num_objects":66,"num_object_clones":26,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":127,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":21,"num_read":14736,"num_read_kb":34367,"num_write":663,"num_write_kb":12432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":17383598,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[{"shards":"1,7","objects":66}],"blocked_by":[],"up_primary":5,"acting_primary":1,"purged_snaps":[{"start":"29","length":"5"}]},{"pgid":"3.15","version":"145'253","reported_seq":4806,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.693828+0000","last_change":"2024-09-22T01:37:15.680861+0000","last_active":"2024-09-22T01:37:16.693828+0000","last_peered":"2024-09-22T01:37:16.693828+0000","last_clean":"2024-09-22T01:37:16.693828+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:37:16.693828+0000","last_undegraded":"2024-09-22T01:37:16.693828+0000","last_fullsized":"2024-09-22T01:37:16.693828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:09:31.992846+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.007233639,"stat_sum":{"num_bytes":55156807,"num_objects":43,"num_object_clones":18,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":16,"num_read":4129,"num_read_kb":34295,"num_write":238,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.14","version":"141'344","reported_seq":5949,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.658587+0000","last_change":"2024-09-22T01:37:15.666723+0000","last_active":"2024-09-22T01:37:16.658587+0000","last_peered":"2024-09-22T01:37:16.658587+0000","last_clean":"2024-09-22T01:37:16.658587+0000","last_became_active":"2024-09-22T01:36:00.564509+0000","last_became_peered":"2024-09-22T01:36:00.564509+0000","last_unstale":"2024-09-22T01:37:16.658587+0000","last_undegraded":"2024-09-22T01:37:16.658587+0000","last_fullsized":"2024-09-22T01:37:16.658587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:29.160722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021301419999999998,"stat_sum":{"num_bytes":47135707,"num_objects":46,"num_object_clones":15,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":11,"num_read":6086,"num_read_kb":53973,"num_write":324,"num_write_kb":20591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":5198452,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"2.7","version":"0'0","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.734089+0000","last_change":"2024-09-22T01:35:57.529367+0000","last_active":"2024-09-22T01:37:16.734089+0000","last_peered":"2024-09-22T01:37:16.734089+0000","last_clean":"2024-09-22T01:37:16.734089+0000","last_became_active":"2024-09-22T01:35:57.528484+0000","last_became_peered":"2024-09-22T01:35:57.528484+0000","last_unstale":"2024-09-22T01:37:16.734089+0000","last_undegraded":"2024-09-22T01:37:16.734089+0000","last_fullsized":"2024-09-22T01:37:16.734089+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:00.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"146'398","reported_seq":5448,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.653761+0000","last_change":"2024-09-22T01:37:15.670979+0000","last_active":"2024-09-22T01:37:16.653761+0000","last_peered":"2024-09-22T01:37:16.653761+0000","last_clean":"2024-09-22T01:37:16.653761+0000","last_became_active":"2024-09-22T01:36:06.618495+0000","last_became_peered":"2024-09-22T01:36:06.618495+0000","last_unstale":"2024-09-22T01:37:16.653761+0000","last_undegraded":"2024-09-22T01:37:16.653761+0000","last_fullsized":"2024-09-22T01:37:16.653761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:51:02.489205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002018209,"stat_sum":{"num_bytes":81639714,"num_objects":60,"num_object_clones":22,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":25,"num_read":4983,"num_read_kb":38572,"num_write":380,"num_write_kb":38180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":25063433,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"2.6","version":"0'0","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.652247+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:37:16.652247+0000","last_peered":"2024-09-22T01:37:16.652247+0000","last_clean":"2024-09-22T01:37:16.652247+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:37:16.652247+0000","last_undegraded":"2024-09-22T01:37:16.652247+0000","last_fullsized":"2024-09-22T01:37:16.652247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"139'302","reported_seq":3123,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.844214+0000","last_change":"2024-09-22T01:37:15.653764+0000","last_active":"2024-09-22T01:37:16.844214+0000","last_peered":"2024-09-22T01:37:16.844214+0000","last_clean":"2024-09-22T01:37:16.844214+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:37:16.844214+0000","last_undegraded":"2024-09-22T01:37:16.844214+0000","last_fullsized":"2024-09-22T01:37:16.844214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:53.244953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027667019999999998,"stat_sum":{"num_bytes":31237183,"num_objects":39,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":11,"num_read":3223,"num_read_kb":20520,"num_write":309,"num_write_kb":6734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.693789+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:37:16.693789+0000","last_peered":"2024-09-22T01:37:16.693789+0000","last_clean":"2024-09-22T01:37:16.693789+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:37:16.693789+0000","last_undegraded":"2024-09-22T01:37:16.693789+0000","last_fullsized":"2024-09-22T01:37:16.693789+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"142'524","reported_seq":3710,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.649445+0000","last_change":"2024-09-22T01:37:15.649934+0000","last_active":"2024-09-22T01:37:16.649445+0000","last_peered":"2024-09-22T01:37:16.649445+0000","last_clean":"2024-09-22T01:37:16.649445+0000","last_became_active":"2024-09-22T01:36:12.660207+0000","last_became_peered":"2024-09-22T01:36:12.660207+0000","last_unstale":"2024-09-22T01:37:16.649445+0000","last_undegraded":"2024-09-22T01:37:16.649445+0000","last_fullsized":"2024-09-22T01:37:16.649445+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:12:28.386192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015240130000000001,"stat_sum":{"num_bytes":72917364,"num_objects":43,"num_object_clones":13,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":13,"num_read":5182,"num_read_kb":37454,"num_write":563,"num_write_kb":11216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"2.4","version":"0'0","reported_seq":140,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.653157+0000","last_change":"2024-09-22T01:36:03.520390+0000","last_active":"2024-09-22T01:37:16.653157+0000","last_peered":"2024-09-22T01:37:16.653157+0000","last_clean":"2024-09-22T01:37:16.653157+0000","last_became_active":"2024-09-22T01:36:03.519493+0000","last_became_peered":"2024-09-22T01:36:03.519493+0000","last_unstale":"2024-09-22T01:37:16.653157+0000","last_undegraded":"2024-09-22T01:37:16.653157+0000","last_fullsized":"2024-09-22T01:37:16.653157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:25:49.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"144'424","reported_seq":7670,"reported_epoch":146,"state":"creating+peering","last_fresh":"2024-09-22T01:37:16.407559+0000","last_change":"2024-09-22T01:37:16.856865+0000","last_active":"2024-09-22T01:37:16.856865+0000","last_peered":"2024-09-22T01:37:16.407559+0000","last_clean":"2024-09-22T01:37:10.719345+0000","last_became_active":"2024-09-22T01:37:15.001202+0000","last_became_peered":"2024-09-22T01:37:15.001202+0000","last_unstale":"2024-09-22T01:37:16.407559+0000","last_undegraded":"2024-09-22T01:37:16.407559+0000","last_fullsized":"2024-09-22T01:37:16.407559+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048042249999999996,"stat_sum":{"num_bytes":104956888,"num_objects":46,"num_object_clones":14,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":13,"num_read":8127,"num_read_kb":53926,"num_write":463,"num_write_kb":18730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"29","length":"5"}]},{"pgid":"3.3","version":"146'247","reported_seq":1164,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.811415+0000","last_change":"2024-09-22T01:37:15.660319+0000","last_active":"2024-09-22T01:37:16.811415+0000","last_peered":"2024-09-22T01:37:16.811415+0000","last_clean":"2024-09-22T01:37:16.811415+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:37:16.811415+0000","last_undegraded":"2024-09-22T01:37:16.811415+0000","last_fullsized":"2024-09-22T01:37:16.811415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:36:45.215852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023508380000000001,"stat_sum":{"num_bytes":4244156,"num_objects":34,"num_object_clones":10,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":14,"num_read":1265,"num_read_kb":6220,"num_write":236,"num_write_kb":3469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"2.2","version":"20'2","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.656499+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:37:16.656499+0000","last_peered":"2024-09-22T01:37:16.656499+0000","last_clean":"2024-09-22T01:37:16.656499+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:37:16.656499+0000","last_undegraded":"2024-09-22T01:37:16.656499+0000","last_fullsized":"2024-09-22T01:37:16.656499+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"141'458","reported_seq":3644,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.651635+0000","last_change":"2024-09-22T01:37:15.656523+0000","last_active":"2024-09-22T01:37:16.651635+0000","last_peered":"2024-09-22T01:37:16.651635+0000","last_clean":"2024-09-22T01:37:16.651635+0000","last_became_active":"2024-09-22T01:36:39.852969+0000","last_became_peered":"2024-09-22T01:36:39.852969+0000","last_unstale":"2024-09-22T01:37:16.651635+0000","last_undegraded":"2024-09-22T01:37:16.651635+0000","last_fullsized":"2024-09-22T01:37:16.651635+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:48:00.032972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029978610000000001,"stat_sum":{"num_bytes":43145106,"num_objects":39,"num_object_clones":13,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":14,"num_read":4276,"num_read_kb":14817,"num_write":486,"num_write_kb":23548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"2.1","version":"0'0","reported_seq":128,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.649162+0000","last_change":"2024-09-22T01:36:09.627096+0000","last_active":"2024-09-22T01:37:16.649162+0000","last_peered":"2024-09-22T01:37:16.649162+0000","last_clean":"2024-09-22T01:37:16.649162+0000","last_became_active":"2024-09-22T01:36:09.626669+0000","last_became_peered":"2024-09-22T01:36:09.626669+0000","last_unstale":"2024-09-22T01:37:16.649162+0000","last_undegraded":"2024-09-22T01:37:16.649162+0000","last_fullsized":"2024-09-22T01:37:16.649162+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:35.787005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"140'462","reported_seq":4062,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.653110+0000","last_change":"2024-09-22T01:37:15.668081+0000","last_active":"2024-09-22T01:37:16.653110+0000","last_peered":"2024-09-22T01:37:16.653110+0000","last_clean":"2024-09-22T01:37:16.653110+0000","last_became_active":"2024-09-22T01:37:01.529118+0000","last_became_peered":"2024-09-22T01:37:01.529118+0000","last_unstale":"2024-09-22T01:37:16.653110+0000","last_undegraded":"2024-09-22T01:37:16.653110+0000","last_fullsized":"2024-09-22T01:37:16.653110+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:51:11.806503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081892399999999995,"stat_sum":{"num_bytes":37138973,"num_objects":48,"num_object_clones":13,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":19,"num_read":4654,"num_read_kb":25632,"num_write":520,"num_write_kb":13020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":13991851,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"2.0","version":"0'0","reported_seq":152,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.693439+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:37:16.693439+0000","last_peered":"2024-09-22T01:37:16.693439+0000","last_clean":"2024-09-22T01:37:16.693439+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:37:16.693439+0000","last_undegraded":"2024-09-22T01:37:16.693439+0000","last_fullsized":"2024-09-22T01:37:16.693439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"146'389","reported_seq":2307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.821851+0000","last_change":"2024-09-22T01:37:16.663226+0000","last_active":"2024-09-22T01:37:16.821851+0000","last_peered":"2024-09-22T01:37:16.821851+0000","last_clean":"2024-09-22T01:37:16.821851+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:37:16.821851+0000","last_undegraded":"2024-09-22T01:37:16.821851+0000","last_fullsized":"2024-09-22T01:37:16.821851+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:09:27.230926+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0067936760000000002,"stat_sum":{"num_bytes":18843566,"num_objects":44,"num_object_clones":13,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":16,"num_read":2491,"num_read_kb":16042,"num_write":443,"num_write_kb":8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.656451+0000","last_change":"2024-09-22T01:37:13.533524+0000","last_active":"2024-09-22T01:37:16.656451+0000","last_peered":"2024-09-22T01:37:16.656451+0000","last_clean":"2024-09-22T01:37:16.656451+0000","last_became_active":"2024-09-22T01:37:13.529493+0000","last_became_peered":"2024-09-22T01:37:13.529493+0000","last_unstale":"2024-09-22T01:37:16.656451+0000","last_undegraded":"2024-09-22T01:37:16.656451+0000","last_fullsized":"2024-09-22T01:37:16.656451+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:07.459369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":400,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.693455+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:37:16.693455+0000","last_peered":"2024-09-22T01:37:16.693455+0000","last_clean":"2024-09-22T01:37:16.693455+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:37:16.693455+0000","last_undegraded":"2024-09-22T01:37:16.693455+0000","last_fullsized":"2024-09-22T01:37:16.693455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"138'629","reported_seq":2233,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.649535+0000","last_change":"2024-09-22T01:37:15.659252+0000","last_active":"2024-09-22T01:37:16.649535+0000","last_peered":"2024-09-22T01:37:16.649535+0000","last_clean":"2024-09-22T01:37:16.649535+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:37:16.649535+0000","last_undegraded":"2024-09-22T01:37:16.649535+0000","last_fullsized":"2024-09-22T01:37:16.649535+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:02:47.096068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085984949999999994,"stat_sum":{"num_bytes":71176780,"num_objects":49,"num_object_clones":17,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":17,"num_read":6942,"num_read_kb":52301,"num_write":838,"num_write_kb":26314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.9","version":"146'402","reported_seq":5086,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.658162+0000","last_change":"2024-09-22T01:37:15.671718+0000","last_active":"2024-09-22T01:37:16.658162+0000","last_peered":"2024-09-22T01:37:16.658162+0000","last_clean":"2024-09-22T01:37:16.658162+0000","last_became_active":"2024-09-22T01:36:12.658535+0000","last_became_peered":"2024-09-22T01:36:12.658535+0000","last_unstale":"2024-09-22T01:37:16.658162+0000","last_undegraded":"2024-09-22T01:37:16.658162+0000","last_fullsized":"2024-09-22T01:37:16.658162+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:00.995018+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0085615870000000007,"stat_sum":{"num_bytes":82921794,"num_objects":44,"num_object_clones":16,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":14,"num_read":4353,"num_read_kb":53911,"num_write":435,"num_write_kb":17684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2982858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.a","version":"146'479","reported_seq":13590,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.734425+0000","last_change":"2024-09-22T01:37:15.661799+0000","last_active":"2024-09-22T01:37:16.734425+0000","last_peered":"2024-09-22T01:37:16.734425+0000","last_clean":"2024-09-22T01:37:16.734425+0000","last_became_active":"2024-09-22T01:34:48.551682+0000","last_became_peered":"2024-09-22T01:34:48.551682+0000","last_unstale":"2024-09-22T01:37:16.734425+0000","last_undegraded":"2024-09-22T01:37:16.734425+0000","last_fullsized":"2024-09-22T01:37:16.734425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:39:37.339992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031880210000000001,"stat_sum":{"num_bytes":86930584,"num_objects":48,"num_object_clones":15,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":14802,"num_read_kb":19924,"num_write":489,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.b","version":"141'380","reported_seq":2850,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.650510+0000","last_change":"2024-09-22T01:37:15.655273+0000","last_active":"2024-09-22T01:37:16.650510+0000","last_peered":"2024-09-22T01:37:16.650510+0000","last_clean":"2024-09-22T01:37:16.650510+0000","last_became_active":"2024-09-22T01:36:49.518943+0000","last_became_peered":"2024-09-22T01:36:49.518943+0000","last_unstale":"2024-09-22T01:37:16.650510+0000","last_undegraded":"2024-09-22T01:37:16.650510+0000","last_fullsized":"2024-09-22T01:37:16.650510+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:54:10.959628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042376280000000002,"stat_sum":{"num_bytes":24668122,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":2591,"num_read_kb":14151,"num_write":460,"num_write_kb":9040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":11703594,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.c","version":"146'482","reported_seq":5529,"reported_epoch":146,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-22T01:37:16.802393+0000","last_change":"2024-09-22T01:37:14.984130+0000","last_active":"2024-09-22T01:37:16.802393+0000","last_peered":"2024-09-22T01:37:16.802393+0000","last_clean":"2024-09-22T01:37:11.778180+0000","last_became_active":"2024-09-22T01:37:14.983074+0000","last_became_peered":"2024-09-22T01:37:14.983074+0000","last_unstale":"2024-09-22T01:37:16.802393+0000","last_undegraded":"2024-09-22T01:37:14.531304+0000","last_fullsized":"2024-09-22T01:37:14.527058+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031800259999999999,"stat_sum":{"num_bytes":80756320,"num_objects":54,"num_object_clones":18,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":105,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":19,"num_read":6749,"num_read_kb":34601,"num_write":480,"num_write_kb":16246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":12385245,"num_keys_recovered":34,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[3],"avail_no_missing":["3","6"],"object_location_counts":[{"shards":"3,6","objects":54}],"blocked_by":[],"up_primary":5,"acting_primary":3,"purged_snaps":[{"start":"29","length":"5"}]},{"pgid":"3.d","version":"139'409","reported_seq":4252,"reported_epoch":146,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-22T01:37:16.866719+0000","last_change":"2024-09-22T01:37:16.787598+0000","last_active":"2024-09-22T01:37:16.866719+0000","last_peered":"2024-09-22T01:37:16.866719+0000","last_clean":"2024-09-22T01:37:11.616878+0000","last_became_active":"2024-09-22T01:37:15.003577+0000","last_became_peered":"2024-09-22T01:37:15.003577+0000","last_unstale":"2024-09-22T01:37:16.866719+0000","last_undegraded":"2024-09-22T01:37:16.866719+0000","last_fullsized":"2024-09-22T01:37:14.528879+0000","mapping_epoch":143,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034643780000000002,"stat_sum":{"num_bytes":72623219,"num_objects":48,"num_object_clones":18,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":33,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":14,"num_read":5088,"num_read_kb":19478,"num_write":497,"num_write_kb":16483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":12298368,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7],"avail_no_missing":["7","6"],"object_location_counts":[{"shards":"6,7","objects":33},{"shards":"7","objects":15}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"29","length":"5"}]},{"pgid":"3.e","version":"144'638","reported_seq":3773,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.694084+0000","last_change":"2024-09-22T01:37:15.681749+0000","last_active":"2024-09-22T01:37:16.694084+0000","last_peered":"2024-09-22T01:37:16.694084+0000","last_clean":"2024-09-22T01:37:16.694084+0000","last_became_active":"2024-09-22T01:36:00.566088+0000","last_became_peered":"2024-09-22T01:36:00.566088+0000","last_unstale":"2024-09-22T01:37:16.694084+0000","last_undegraded":"2024-09-22T01:37:16.694084+0000","last_fullsized":"2024-09-22T01:37:16.694084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:30:58.710271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0083456750000000003,"stat_sum":{"num_bytes":34953866,"num_objects":51,"num_object_clones":17,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":20,"num_read":4476,"num_read_kb":18555,"num_write":840,"num_write_kb":13168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":4264442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.f","version":"139'618","reported_seq":3094,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.835456+0000","last_change":"2024-09-22T01:37:15.676116+0000","last_active":"2024-09-22T01:37:16.835456+0000","last_peered":"2024-09-22T01:37:16.835456+0000","last_clean":"2024-09-22T01:37:16.835456+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:37:16.835456+0000","last_undegraded":"2024-09-22T01:37:16.835456+0000","last_fullsized":"2024-09-22T01:37:16.835456+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:59:10.092863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026669329999999998,"stat_sum":{"num_bytes":106976701,"num_objects":46,"num_object_clones":14,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":11,"num_read":5168,"num_read_kb":24390,"num_write":819,"num_write_kb":20848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.10","version":"144'581","reported_seq":2244,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.733926+0000","last_change":"2024-09-22T01:37:15.660167+0000","last_active":"2024-09-22T01:37:16.733926+0000","last_peered":"2024-09-22T01:37:16.733926+0000","last_clean":"2024-09-22T01:37:16.733926+0000","last_became_active":"2024-09-22T01:36:06.619734+0000","last_became_peered":"2024-09-22T01:36:06.619734+0000","last_unstale":"2024-09-22T01:37:16.733926+0000","last_undegraded":"2024-09-22T01:37:16.733926+0000","last_fullsized":"2024-09-22T01:37:16.733926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:02:03.324030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002849079,"stat_sum":{"num_bytes":42542198,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":15,"num_read":3796,"num_read_kb":13941,"num_write":702,"num_write_kb":16238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":4400829,"num_keys_recovered":58,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.11","version":"146'337","reported_seq":5479,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.693675+0000","last_change":"2024-09-22T01:37:15.686517+0000","last_active":"2024-09-22T01:37:16.693675+0000","last_peered":"2024-09-22T01:37:16.693675+0000","last_clean":"2024-09-22T01:37:16.693675+0000","last_became_active":"2024-09-22T01:36:01.562260+0000","last_became_peered":"2024-09-22T01:36:01.562260+0000","last_unstale":"2024-09-22T01:37:16.693675+0000","last_undegraded":"2024-09-22T01:37:16.693675+0000","last_fullsized":"2024-09-22T01:37:16.693675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:28:38.430391+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.013488102,"stat_sum":{"num_bytes":48820911,"num_objects":53,"num_object_clones":17,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":16,"num_read":4797,"num_read_kb":46848,"num_write":313,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.12","version":"146'432","reported_seq":4464,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.790896+0000","last_change":"2024-09-22T01:37:15.671395+0000","last_active":"2024-09-22T01:37:16.790896+0000","last_peered":"2024-09-22T01:37:16.790896+0000","last_clean":"2024-09-22T01:37:16.790896+0000","last_became_active":"2024-09-22T01:36:07.626370+0000","last_became_peered":"2024-09-22T01:36:07.626370+0000","last_unstale":"2024-09-22T01:37:16.790896+0000","last_undegraded":"2024-09-22T01:37:16.790896+0000","last_fullsized":"2024-09-22T01:37:16.790896+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:17:57.786645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038607369999999999,"stat_sum":{"num_bytes":15505039,"num_objects":26,"num_object_clones":9,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":11,"num_read":4748,"num_read_kb":18718,"num_write":498,"num_write_kb":10265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":5846025,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"27","length":"7"}]},{"pgid":"3.13","version":"141'578","reported_seq":10559,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-09-22T01:37:16.693538+0000","last_change":"2024-09-22T01:37:15.674985+0000","last_active":"2024-09-22T01:37:16.693538+0000","last_peered":"2024-09-22T01:37:16.693538+0000","last_clean":"2024-09-22T01:37:16.693538+0000","last_became_active":"2024-09-22T01:36:01.565891+0000","last_became_peered":"2024-09-22T01:36:01.565891+0000","last_unstale":"2024-09-22T01:37:16.693538+0000","last_undegraded":"2024-09-22T01:37:16.693538+0000","last_fullsized":"2024-09-22T01:37:16.693538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:19:12.886989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018530669999999999,"stat_sum":{"num_bytes":53910194,"num_objects":40,"num_object_clones":12,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":10,"num_read":12045,"num_read_kb":47033,"num_write":522,"num_write_kb":13745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":5871820,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"27","length":"7"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1821022995,"num_objects":1436,"num_object_clones":471,"num_object_copies":2872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":211,"num_objects_misplaced":160,"num_objects_unfound":0,"num_objects_dirty":1436,"num_whiteouts":468,"num_read":189497,"num_read_kb":1028362,"num_write":19646,"num_write_kb":541064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3743,"num_bytes_recovered":319868226,"num_keys_recovered":810,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":571752448,"data_stored":717167197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16256,"ondisk_log_size":16256,"up":64,"acting":60,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121852,"kb_used_data":68456,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94249988,"statfs":{"total":96636764160,"available":96511987712,"internally_reserved":0,"allocated":70098944,"data_stored":84762711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98276,"kb_used_data":58760,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94273564,"statfs":{"total":96636764160,"available":96536129536,"internally_reserved":0,"allocated":60170240,"data_stored":74273965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86024,"kb_used_data":36748,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94285816,"statfs":{"total":96636764160,"available":96548675584,"internally_reserved":0,"allocated":37629952,"data_stored":47167874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173504,"kb_used_data":102056,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94198336,"statfs":{"total":96636764160,"available":96459096064,"internally_reserved":0,"allocated":104505344,"data_stored":124151371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":168412,"kb_used_data":110852,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94203428,"statfs":{"total":96636764160,"available":96464310272,"internally_reserved":0,"allocated":113512448,"data_stored":138737263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68436,"kb_used_data":41400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94303404,"statfs":{"total":96636764160,"available":96566685696,"internally_reserved":0,"allocated":42393600,"data_stored":54618737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132700,"kb_used_data":101504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94239140,"statfs":{"total":96636764160,"available":96500879360,"internally_reserved":0,"allocated":103940096,"data_stored":125349245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110968,"kb_used_data":57564,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94260872,"statfs":{"total":96636764160,"available":96523132928,"internally_reserved":0,"allocated":58945536,"data_stored":79817835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":56606720,"data_stored":78395418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102195200,"data_stored":124517212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40648704,"data_stored":53786707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":111759360,"data_stored":137899155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":97771520,"data_stored":118332006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45608960,"data_stored":57634577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":54390784,"data_stored":68249163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":62771200,"data_stored":78352959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:37:18.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-recovery 3.1f 3.16 3.d 2024-09-22T01:37:18.009 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:18.009 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:18.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:18.009 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:18.009 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.009 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:18.009 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:37:18.009 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.559096592000003, 2024-09-22T01:37:18.009 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:37:18.009 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.010 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:37:18.011 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.012 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.555128366000005, 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.013 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:37:18.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:37:18.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.555109306000006, 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.017 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:37:18.020 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.554883442999994, 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.021 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.547353099999995, 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:37:18.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:37:18.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.543371805000007, 2024-09-22T01:37:18.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:37:18.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:37:18.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.539153721999995, 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.032 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:37:18.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111086 3.c 3:35fd2b6c:::rbd_data.110fb46d971e.0000000000000006:24 [read 835584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.321319213000002, 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094586389000000007, 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111086 2024-09-22T01:37:18.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:18.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8699999999999995e-07 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684828+0000", 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6847e-05 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684836+0000", 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6539999999999999e-06 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684841+0000", 2024-09-22T01:37:18.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.896e-06 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776879+0000", 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.092037657999999994 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776960+0000", 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0653000000000002e-05 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779397+0000", 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024371940000000002 2024-09-22T01:37:18.039 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111087 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.321266282000003, 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094592211999999995, 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111087 2024-09-22T01:37:18.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684864+0000", 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0500000000000003e-07 2024-09-22T01:37:18.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684867+0000", 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2820000000000001e-06 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684887+0000", 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9834e-05 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684892+0000", 2024-09-22T01:37:18.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3220000000000003e-06 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779442+0000", 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094550318999999994 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779456+0000", 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.385e-05 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111088 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.321229559000002, 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094599416000000006, 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111088 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:37:18.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684901+0000", 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3300000000000003e-07 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684906+0000", 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:37:18.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684912+0000", 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8819999999999998e-06 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684919+0000", 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0330000000000003e-06 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779492+0000", 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094573333999999995 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779500+0000", 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7360000000000001e-06 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111089 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.321202655, 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094616622999999997, 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.047 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111089 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:37:18.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684928+0000", 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7399999999999998e-07 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684930+0000", 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.881e-06 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684938+0000", 2024-09-22T01:37:18.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5689999999999999e-06 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684944+0000", 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.665e-06 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779538+0000", 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094594370999999997 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779544+0000", 2024-09-22T01:37:18.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6629999999999998e-06 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111090 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.321166603999998, 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094605844999999994, 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111090 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684964+0000", 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8999999999999997e-07 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684967+0000", 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4460000000000001e-06 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684975+0000", 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.943e-06 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684990+0000", 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4482e-05 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779561+0000", 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094571526000000003 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779569+0000", 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9580000000000007e-06 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.054 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111091 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.321121982000001, 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094588915999999995, 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111091 2024-09-22T01:37:18.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:18.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685012+0000", 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.602e-06 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685020+0000", 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2300000000000008e-06 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685030+0000", 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5719999999999992e-06 2024-09-22T01:37:18.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779591+0000", 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094560898000000004 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779597+0000", 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9569999999999999e-06 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.058 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111092 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.321090251000001, 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094585007999999998, 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111092 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.059 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685043+0000", 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7269999999999999e-06 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685051+0000", 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3140000000000004e-06 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685057+0000", 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9739999999999999e-06 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779618+0000", 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094561289000000007 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779625+0000", 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.195e-06 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111093 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:37:18.062 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.321064937000003, 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094587735000000006, 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111093 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685537+0000", 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00047185400000000001 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685543+0000", 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9410000000000004e-06 2024-09-22T01:37:18.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685555+0000", 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2449999999999999e-05 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685563+0000", 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6279999999999996e-06 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779648+0000", 2024-09-22T01:37:18.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094084962999999994 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779653+0000", 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.899e-06 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111094 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.320541923, 2024-09-22T01:37:18.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091857000000001, 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111094 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685589+0000", 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5300000000000004e-07 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685595+0000", 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8229999999999997e-06 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685602+0000", 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8730000000000001e-06 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685607+0000", 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5279999999999997e-06 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779675+0000", 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094068054999999998 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779680+0000", 2024-09-22T01:37:18.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9250000000000003e-06 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111095 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.320516365000003, 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091049999999996, 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.070 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111095 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685614+0000", 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5600000000000001e-07 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685615+0000", 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.593e-06 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685619+0000", 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1150000000000004e-06 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685623+0000", 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3529999999999999e-06 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779700+0000", 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094076749000000001 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779704+0000", 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8840000000000002e-06 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111096 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 47.320502525999999, 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094106891999999998, 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111096 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685756+0000", 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012857600000000001 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685761+0000", 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.118e-06 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685770+0000", 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0650000000000005e-06 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685794+0000", 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4202999999999998e-05 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779729+0000", 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093934985999999998 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779734+0000", 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9439999999999996e-06 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148273 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:18.077 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 5.3627672979999996, 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.88034022700000003, 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148273 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643365+0000", 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8260000000000001e-06 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643378+0000", 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2397e-05 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643411+0000", 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3704999999999997e-05 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643428+0000", 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6793999999999999e-05 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643573+0000", 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014461199999999999 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:18.080 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643590+0000", 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7652999999999999e-05 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523688+0000", 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.880097766 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523703+0000", 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4474000000000001e-05 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148611 3.5 3:a5368988:::rbd_header.110fa04a93b5:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e146)", 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 1.1575893640000001, 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.82734200400000002, 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148611 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848542+0000", 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6899999999999999e-06 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848551+0000", 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7499999999999992e-06 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848571+0000", 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0645999999999999e-05 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848582+0000", 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0773e-05 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848660+0000", 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7389000000000001e-05 2024-09-22T01:37:18.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848673+0000", 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3222e-05 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675069+0000", 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.82639581699999998 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675421+0000", 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035278499999999999 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675882+0000", 2024-09-22T01:37:18.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000460932 2024-09-22T01:37:18.086 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.086 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.086 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.086 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.086 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.086 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:18.087 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:18.130 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:18.130+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:18.189 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:18.184+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:18.259 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:18.259 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:18.259 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:18.259 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:18.272 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:18.290 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:18.284+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:18.391 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:18.384+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:18.395 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:18.395 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:18.395 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:18.395 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:18.395 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:instructing pg(s) [3.1f] on osd.0 to force-recovery; instructing pg(s) [3.16] on osd.1 to force-recovery; instructing pg(s) [3.d] on osd.7 to force-recovery; 2024-09-22T01:37:18.405 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:37:18.410 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:18.493 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:18.488+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:18.546 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:18.546 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:18.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:18.546 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:18.546 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.546 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.546 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:18.546 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.468037076, 2024-09-22T01:37:18.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:37:18.546 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:37:18.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.46800004799999, 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.551 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.456449588, 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:37:18.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:37:18.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.558 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.456415581, 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.559 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:37:18.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.45254823099999, 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.566 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.45250268300001, 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.567 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.452457475, 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:37:18.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.452422883, 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.575 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:37:18.578 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.452389235, 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.579 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:37:18.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:37:18.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:37:18.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:37:18.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.583 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.448659745, 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.584 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.587 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.448623242, 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:37:18.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:37:18.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:37:18.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.448578603, 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.592 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:37:18.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:37:18.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.448528377, 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.596 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.448489935, 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.600 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:18.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:37:18.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:37:18.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.44844594, 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.604 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.44840679000001, 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.608 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.611 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.444563622, 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:37:18.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:37:18.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 110.444483296, 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:37:18.616 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:37:18.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:18.620 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 109.73993, 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 108.745788432, 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.626 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:37:18.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:37:18.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:37:18.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:37:18.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:18.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:18.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:18.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:37:18.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:37:18.631 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.631 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.631 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.631 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:18.631 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:18.631 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:18.632 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:18.633 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:18.628+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:18.733 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:18.728+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:18.759 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:18.759 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:18.759 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:18.759 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:18.773 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:18.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:18.834 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:18.834+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:18.896 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:18.896 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:18.896 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:18.896 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:18.896 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:18.910 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:18.932 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:18.949 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:18.949 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:18.958 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:18.958+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:18.966 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:18.966 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:18.983 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:18.983 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:19.001 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:19.001 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:19.019 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:19.020 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:19.036 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:19.034+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:19.042 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:19.042 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:19.068 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:19.068 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:19.084 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:19.084 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:19.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:19.142 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:19.142+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:19.224 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:19.224 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:19.237 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:19.232+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:19.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:19.339 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:19.338+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:19.408 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:19.408 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:19.422 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:19.468 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:19.464+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:19.541 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:19.538+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:19.555 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:19.556 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:19.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:19.660 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:19.656+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:19.695 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:37:19.742 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:19.742+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:19.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:19.843 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:19.836+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:19.885 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:19.885 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:19.899 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:19.944 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:19.942+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:20.044 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:20.042+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:20.060 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:20.060 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:20.074 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:20.145 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:20.140+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:20.200 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:20.200 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:20.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:20.245 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:20.242+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:20.346 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:20.340+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:20.385 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:20.385 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:20.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:20.447 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:20.446+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:20.548 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:20.544+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:20.569 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:20.569 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:20.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:20.649 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:20.646+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:37:20.750 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:20.744+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:20.763 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:20.763 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:20.779 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:20.864 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:20.860+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:20.953 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:20.950+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:20.955 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:20.955 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:20.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:21.055 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:21.054+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:21.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:21.145 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:21.145 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:21.154 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:21.154+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:21.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:21.236 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:21.236 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:21.252 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:21.252 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:21.254 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:21.248+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:21.269 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:21.269 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:21.286 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:21.286 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:21.295 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:21.295 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:21.307 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:21.307 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:21.309 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:21.327 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:21.327 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:21.345 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:21.345 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:21.356 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:21.354+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:21.364 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:21.434 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:21.434 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:21.434 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:21.434 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:21.434 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:21.448 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:21.490 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:21.490+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:21.557 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:21.554+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:21.616 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:21.616 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:21.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:21.616 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:21.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.616 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 112.81831769199999, 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:37:21.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:37:21.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:37:21.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.106174973999998, 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.623 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:37:21.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:37:21.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105543 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 10911744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.504656748000002, 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064938994, 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.629 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105543 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.630 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110043+0000", 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110048+0000", 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6470000000000003e-06 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110066+0000", 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8306999999999999e-05 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110081+0000", 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4362000000000001e-05 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174758+0000", 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064676685999999997 2024-09-22T01:37:21.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174867+0000", 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109701 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174980+0000", 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000113238 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.504571067000001, 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.634 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:37:21.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.637 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.504505383999998, 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.639 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.640 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.641 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.504439636000001, 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.642 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:37:21.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:37:21.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.504397036999997, 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:37:21.646 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:21.650 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.50424933, 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:37:21.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:37:21.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.654 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.504089940999997, 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:21.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:37:21.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:37:21.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.658 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.504026138999997, 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:21.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:37:21.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:37:21.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.662 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.503965950000001, 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:21.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:37:21.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.666 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.503902508000003, 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:37:21.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:37:21.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.503847253000004, 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.503793453999997, 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:37:21.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:37:21.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.678 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.503732501999998, 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:37:21.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:37:21.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.682 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.503674803000003, 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:21.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:37:21.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:21.686 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.503586351999999, 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:21.690 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.503500457000001, 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:21.694 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 54.503415609000001, 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:37:21.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 27.383340317999998, 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:37:21.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.703 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:21.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:21.705 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:21.700+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:21.806 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:21.806+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:21.881 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:21.881 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:21.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:149094 3.c 3:35289b8a:::rbd_data.110fb46d971e.0000000000000005:head [delete] snapc 24=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:21.870639+0000", 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.01099291, 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011013894, 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "waiting for sub ops", 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 149094 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870639+0000", 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870639+0000", 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870641+0000", 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7230000000000001e-06 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870649+0000", 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.303e-06 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870671+0000", 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1999000000000001e-05 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870682+0000", 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0787e-05 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870822+0000", 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013943399999999999 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.871134+0000", 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00031254699999999999 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 3", 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.871424+0000", 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028974399999999998 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.879016+0000", 2024-09-22T01:37:21.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0075918019999999999 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:149095 3.c 3:35fd2b6c:::rbd_data.110fb46d971e.0000000000000006:head [delete] snapc 24=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:21.870709+0000", 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.010923608, 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.010996104, 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "waiting for sub ops", 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.886 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 149095 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870709+0000", 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870709+0000", 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870710+0000", 2024-09-22T01:37:21.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870716+0000", 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3500000000000002e-06 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870736+0000", 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9326000000000001e-05 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.870750+0000", 2024-09-22T01:37:21.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4377e-05 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.874858+0000", 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0041082979999999998 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.875188+0000", 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033003299999999998 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 3", 2024-09-22T01:37:21.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.875484+0000", 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029624700000000003 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:149099 3.c 3:339c49f3:::rbd_data.110fb46d971e.000000000000000a:head [delete] snapc 24=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:21.875525+0000", 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.0061073550000000001, 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0062242060000000004, 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "waiting for sub ops", 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:21.890 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 149099 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.875525+0000", 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.875525+0000", 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:21.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.875528+0000", 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.977e-06 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.875541+0000", 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3162999999999999e-05 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.875572+0000", 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1458999999999998e-05 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.875595+0000", 2024-09-22T01:37:21.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2616000000000002e-05 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.879086+0000", 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034908780000000002 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.879476+0000", 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00039029499999999998 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 3", 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:21.879810+0000", 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033341300000000001 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:21.893 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.894 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:21.894 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:37:21.894 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 3 2024-09-22T01:37:21.894 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:21.896 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:21.943 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:21.942+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:22.007 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:22.006+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:22.063 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:22.064 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:22.064 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:22.064 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:22.064 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:22.077 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:22.123 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:22.122+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:22.209 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:22.204+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:22.253 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:22.253 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:22.253 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:22.253 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.803298324, 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:37:22.254 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.255 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.256 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.257 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.799330098, 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:37:22.258 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.259 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:37:22.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.799311038, 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.266 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.799085175, 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.267 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.791554832, 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.271 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:37:22.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:37:22.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:22.275 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.787573537, 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.279 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.783355454, 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.280 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:37:22.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:37:22.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111086 3.c 3:35fd2b6c:::rbd_data.110fb46d971e.0000000000000006:24 [read 835584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.565520945000003, 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094586389000000007, 2024-09-22T01:37:22.284 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111086 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8699999999999995e-07 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684828+0000", 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6847e-05 2024-09-22T01:37:22.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684836+0000", 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6539999999999999e-06 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684841+0000", 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.896e-06 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776879+0000", 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.092037657999999994 2024-09-22T01:37:22.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776960+0000", 2024-09-22T01:37:22.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0653000000000002e-05 2024-09-22T01:37:22.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.289 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779397+0000", 2024-09-22T01:37:22.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024371940000000002 2024-09-22T01:37:22.289 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.289 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111087 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.565468013999997, 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094592211999999995, 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111087 2024-09-22T01:37:22.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684864+0000", 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0500000000000003e-07 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684867+0000", 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2820000000000001e-06 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684887+0000", 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9834e-05 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684892+0000", 2024-09-22T01:37:22.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3220000000000003e-06 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779442+0000", 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094550318999999994 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779456+0000", 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.385e-05 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.293 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111088 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.565431291000003, 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094599416000000006, 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111088 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:37:22.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684901+0000", 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3300000000000003e-07 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684906+0000", 2024-09-22T01:37:22.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684912+0000", 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8819999999999998e-06 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684919+0000", 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0330000000000003e-06 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779492+0000", 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094573333999999995 2024-09-22T01:37:22.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779500+0000", 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7360000000000001e-06 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111089 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.565404387000001, 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094616622999999997, 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.297 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111089 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684928+0000", 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7399999999999998e-07 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684930+0000", 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.881e-06 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684938+0000", 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5689999999999999e-06 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684944+0000", 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.665e-06 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779538+0000", 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094594370999999997 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779544+0000", 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6629999999999998e-06 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111090 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.565368335999999, 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094605844999999994, 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111090 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684964+0000", 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8999999999999997e-07 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684967+0000", 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4460000000000001e-06 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684975+0000", 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.943e-06 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684990+0000", 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4482e-05 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779561+0000", 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094571526000000003 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779569+0000", 2024-09-22T01:37:22.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9580000000000007e-06 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111091 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.565323714000002, 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094588915999999995, 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.305 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111091 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685012+0000", 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.602e-06 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685020+0000", 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2300000000000008e-06 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685030+0000", 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5719999999999992e-06 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779591+0000", 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094560898000000004 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779597+0000", 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9569999999999999e-06 2024-09-22T01:37:22.308 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111092 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.565291983000002, 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094585007999999998, 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111092 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:22.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685043+0000", 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7269999999999999e-06 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685051+0000", 2024-09-22T01:37:22.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3140000000000004e-06 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685057+0000", 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9739999999999999e-06 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779618+0000", 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094561289000000007 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779625+0000", 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.195e-06 2024-09-22T01:37:22.312 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111093 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.565266669000003, 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094587735000000006, 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.313 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111093 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685537+0000", 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00047185400000000001 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685543+0000", 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9410000000000004e-06 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685555+0000", 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2449999999999999e-05 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685563+0000", 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6279999999999996e-06 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779648+0000", 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094084962999999994 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779653+0000", 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.899e-06 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111094 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.564743655000001, 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091857000000001, 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111094 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.317 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685589+0000", 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5300000000000004e-07 2024-09-22T01:37:22.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685595+0000", 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8229999999999997e-06 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685602+0000", 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8730000000000001e-06 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685607+0000", 2024-09-22T01:37:22.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5279999999999997e-06 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779675+0000", 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094068054999999998 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779680+0000", 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9250000000000003e-06 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111095 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.564718096999997, 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091049999999996, 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111095 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685614+0000", 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5600000000000001e-07 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685615+0000", 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.593e-06 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685619+0000", 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1150000000000004e-06 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685623+0000", 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3529999999999999e-06 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779700+0000", 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094076749000000001 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779704+0000", 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8840000000000002e-06 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.324 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111096 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 51.564704257999999, 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094106891999999998, 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111096 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:37:22.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685756+0000", 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012857600000000001 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685761+0000", 2024-09-22T01:37:22.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.118e-06 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685770+0000", 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0650000000000005e-06 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685794+0000", 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4202999999999998e-05 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779729+0000", 2024-09-22T01:37:22.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093934985999999998 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779734+0000", 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9439999999999996e-06 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148273 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 9.6069690300000001, 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.88034022700000003, 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.328 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148273 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643365+0000", 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8260000000000001e-06 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643378+0000", 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2397e-05 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643411+0000", 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3704999999999997e-05 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643428+0000", 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6793999999999999e-05 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643573+0000", 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014461199999999999 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643590+0000", 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7652999999999999e-05 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523688+0000", 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.880097766 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523703+0000", 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4474000000000001e-05 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.332 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148611 3.5 3:a5368988:::rbd_header.110fa04a93b5:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e146)", 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 5.4017910960000002, 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.82734200400000002, 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148611 2024-09-22T01:37:22.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848542+0000", 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6899999999999999e-06 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848551+0000", 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7499999999999992e-06 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848571+0000", 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0645999999999999e-05 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848582+0000", 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0773e-05 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848660+0000", 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7389000000000001e-05 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848673+0000", 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3222e-05 2024-09-22T01:37:22.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675069+0000", 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.82639581699999998 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675421+0000", 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035278499999999999 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675882+0000", 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000460932 2024-09-22T01:37:22.337 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.338 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:22.339 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:22.340 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:22.336+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:22.440 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:22.436+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:22.462 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:22.462 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:22.462 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:22.462 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:22.476 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:22.541 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:22.538+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:22.597 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:22.597 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:22.597 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:22.597 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:22.598 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:22.611 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:22.658 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:22.658+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:22.713 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:37:22.742 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:22.742+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:22.795 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.717429043, 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.796 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.717392015, 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.800 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:37:22.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.70584155500001, 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:37:22.804 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:37:22.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.705807548, 2024-09-22T01:37:22.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:22.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:37:22.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:37:22.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.701940198, 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.816 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.70189465, 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.817 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:22.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:37:22.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.701849442, 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.821 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:37:22.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:22.825 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.70181485000001, 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.829 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.70178120200001, 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.830 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:37:22.833 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.69805171199999, 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:37:22.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.698015209, 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.841 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.69797057, 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:22.845 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.697920344, 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:37:22.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.69788190200001, 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.853 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.69783790699999, 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.854 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:37:22.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.697798757, 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.858 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.693955589, 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:37:22.862 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:37:22.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.693875263, 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.867 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:37:22.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:37:22.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:37:22.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 113.989321967, 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.871 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:37:22.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:37:22.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 112.99518039900001, 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:22.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:22.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:37:22.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:37:22.882 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.882 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.882 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.882 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:22.882 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:22.882 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:22.883 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:22.884 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:22.882+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:22.983 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:22.976+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:23.060 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:23.060 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:23.060 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:23.074 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:23.118 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:23.118+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:23.185 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:23.180+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:23.196 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:23.197 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:23.197 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:23.197 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:23.197 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:23.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:23.286 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:23.280+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 170.06973664899999, 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.382 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:37:23.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:37:23.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:37:23.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:37:23.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53896395300001, 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.389 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:37:23.390 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:37:23.391 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.392 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53873667299999, 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.393 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:23.394 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:37:23.395 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.396 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:23.397 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53556838899999, 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:23.398 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:37:23.399 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:37:23.400 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.401 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53548412500001, 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.402 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:37:23.403 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:37:23.404 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:37:23.405 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53543262900001, 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.406 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.407 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.408 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.409 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53538730899999, 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.410 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.411 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:37:23.412 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.413 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53190705200001, 2024-09-22T01:37:23.414 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.415 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:37:23.416 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:37:23.417 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53160224000001, 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.418 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.419 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:37:23.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.531552796, 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.422 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:23.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:37:23.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.531508242, 2024-09-22T01:37:23.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:37:23.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:37:23.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.430 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53146459199999, 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.431 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.531417371, 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.435 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.438 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53122236499999, 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.439 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.53117287800001, 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:37:23.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.528021819, 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:37:23.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.52767619100001, 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:23.454 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.52758076800001, 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:37:23.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:37:23.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:23.458 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.52752818900001, 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:37:23.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:23.462 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.52748642200001, 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:23.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:23.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:23.466 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:23.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:23.467 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 6, 7, 0, 2, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:37:23.467 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:37:23.467 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-22T01:37:23.467 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-22T01:37:23.468 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-22T01:37:23.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-22T01:37:23.469 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:23.466+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:23.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:23.569 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:23.566+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:23.600 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:23.600 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "" 2024-09-22T01:37:23.600 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:23.635 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:23.636 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:23.638 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:23.639 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:23.653 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:23.653 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:23.654 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:23.670 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:23.670 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:23.671 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:23.670+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:23.686 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:23.686 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:23.707 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:23.714 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:37:23.747 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:23.771 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:23.770+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:23.773 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:23.773 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:23.798 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:23.799 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:23.802 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:23.803 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:23.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:23.912 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:23.908+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:23.972 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:23.968+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:23.984 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:23.984 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:23.998 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:24.084 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:24.080+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:24.167 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:24.167 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:24.174 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:24.174+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:24.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:24.275 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:24.274+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:24.354 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:24.354 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:24.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:24.412 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:24.408+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:24.476 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:24.474+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:24.482 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:24.482 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:24.494 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:24.577 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:24.574+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:24.647 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:24.648 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:24.660 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:24.677 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:24.674+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:24.778 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:24.778+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:24.781 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:24.781 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:24.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:24.879 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:24.878+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:24.930 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:24.930 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:24.945 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:24.992 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:24.988+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:25.071 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:25.071 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:25.082 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:25.082+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:25.086 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:25.183 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:25.176+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:25.252 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:25.252 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:25.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:25.284 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:25.282+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:25.385 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:25.380+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:25.437 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:25.437 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:25.452 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:25.496 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:25.492+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:25.584 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:25.584 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:25.586 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:25.580+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:25.597 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:25.687 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:25.684+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:25.714 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:25.714 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:25.730 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:25.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:37:25.792 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:25.788+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:25.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:25.864 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:25.864 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:25.880 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:25.888 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:25.884+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:25.989 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:25.986+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:26.002 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:26.002 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:26.016 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:26.090 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:26.084+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:26.181 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:26.181 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:26.185 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:26.190 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:26.184+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:26.197 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:26.214 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:26.243 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:26.243 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:26.273 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:26.274 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:26.292 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:26.289+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:26.301 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:26.301 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:26.316 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:26.316 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:26.328 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:26.330 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:26.354 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:26.354 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:26.378 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:26.392 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:26.388+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:26.493 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:26.489+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:26.499 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:26.499 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:26.499 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:26.499 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:26.513 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:26.594 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:26.588+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:26.676 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:26.676 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:26.676 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:26.676 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:26.676 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:26.690 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:26.695 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:26.688+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:26.738 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:37:26.795 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:26.793+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:26.819 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:26.819 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.742863138, 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.820 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:37:26.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:37:26.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.74282611, 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.824 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:26.828 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.73127565, 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:26.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:37:26.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:37:26.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:37:26.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:37:26.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.731241643, 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.833 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:37:26.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.837 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.727374293, 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.838 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:37:26.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.842 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.72732874499999, 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.72728353700001, 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.847 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:26.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:37:26.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.852 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.727248945, 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.857 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.727215297, 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:37:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:37:26.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.862 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.723485807, 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:37:26.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:26.867 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.723449304, 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:26.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:37:26.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.723404665, 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.872 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:37:26.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.723354439, 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:37:26.877 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:37:26.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:26.882 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.723315997, 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:37:26.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.723272002, 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.888 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.890 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:37:26.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.723232852, 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.893 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.894 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:37:26.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.896 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.897 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.71938968400001, 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.898 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.899 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:37:26.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:26.902 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.719309358, 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.903 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:37:26.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.014756062, 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.907 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:26.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:37:26.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:37:26.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 117.020614494, 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:37:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:26.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:37:26.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:26.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:26.919 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:26.921 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:26.921 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:26.916+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:27.021 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:27.017+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:27.091 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:27.091 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:27.091 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:27.091 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:27.105 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:27.146 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:27.145+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:27.223 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:27.221+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:27.268 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:27.268 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:27.268 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:27.268 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:27.269 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:27.283 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:27.324 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:27.320+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:27.425 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:27.421+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:27.448 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:27.448 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:27.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:27.448 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 174.13662227200001, 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:37:27.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:37:27.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:37:27.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.605849576, 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.455 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.60562229600001, 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.459 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.60245401200001, 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:37:27.463 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:37:27.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.602369748, 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.467 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.471 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.602318252, 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:37:27.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:37:27.475 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.60227293200001, 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.476 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:37:27.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.478 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.598792675, 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.480 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:37:27.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.598487863, 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:37:27.484 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:37:27.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:37:27.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.59843841899999, 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.488 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:37:27.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:37:27.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.59839386499999, 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:37:27.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.59835021500001, 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.497 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.498 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:37:27.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.59830299399999, 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.502 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:37:27.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.59810798800001, 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.506 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:27.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:37:27.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:37:27.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.598058501, 2024-09-22T01:37:27.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:37:27.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.59490744199999, 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.514 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.594561814, 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.518 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.519 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.521 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.594466391, 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.522 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:37:27.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:37:27.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.525 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.594413812, 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:37:27.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:37:27.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 142.594372045, 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:27.529 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:27.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:37:27.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:37:27.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:37:27.533 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.533 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.533 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.533 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:27.533 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:27.533 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:27.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:27.535 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:27.528+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:27.635 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:27.633+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:27.669 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:27.669 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:27.669 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:27.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:27.736 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:27.733+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:27.814 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:27.814 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:27.814 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:27.814 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:27.814 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:27.833 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:27.880 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:27.876+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:27.937 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:27.932+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:27.971 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138405 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 245760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.777572419999998, 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398091244, 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:27.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138405 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0999999999999998e-07 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191651+0000", 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1529999999999997e-06 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191659+0000", 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7470000000000005e-06 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191665+0000", 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2439999999999998e-06 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191817+0000", 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151414 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191827+0000", 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0305e-05 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537811+0000", 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34598379000000001 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537817+0000", 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7359999999999998e-06 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589536+0000", 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517191669999999 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589611+0000", 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5436000000000001e-05 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589734+0000", 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012264200000000001 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138406 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 266240~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:27.977 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.777477883, 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3985561479999999, 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138406 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191738+0000", 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191741+0000", 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4479999999999999e-06 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191749+0000", 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6029999999999999e-06 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191755+0000", 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.139e-06 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191922+0000", 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000166589 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191931+0000", 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.132e-06 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537867+0000", 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34593649399999998 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537879+0000", 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-05 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589835+0000", 2024-09-22T01:37:27.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519563439999999 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590007+0000", 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171182 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590293+0000", 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00028668699999999999 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:27.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138407 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 286720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.777376872000001, 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3989841119999999, 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138407 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.983 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191839+0000", 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:27.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191843+0000", 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7189999999999999e-06 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191854+0000", 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1728e-05 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191861+0000", 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3589999999999996e-06 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192030+0000", 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169789 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192040+0000", 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.251e-06 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537916+0000", 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34587605199999999 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537921+0000", 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0370000000000002e-06 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590343+0000", 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0524222999999999 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590511+0000", 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001683 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590822+0000", 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00031091400000000003 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138408 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 307200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:27.988 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.777273327, 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399171419, 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138408 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:27.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2200000000000004e-07 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191946+0000", 2024-09-22T01:37:27.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7309999999999999e-06 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191958+0000", 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1678000000000001e-05 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191974+0000", 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6158e-05 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192127+0000", 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000153614 2024-09-22T01:37:27.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192136+0000", 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7290000000000006e-06 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537946+0000", 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345810267 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537954+0000", 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5320000000000001e-06 2024-09-22T01:37:27.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590877+0000", 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529233330000001 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590965+0000", 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8134999999999996e-05 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591113+0000", 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014762 2024-09-22T01:37:27.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138409 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 327680~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.777164138, 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399404775, 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:27.994 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138409 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:27.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2799999999999996e-07 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192055+0000", 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8510000000000001e-06 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192065+0000", 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2739999999999996e-06 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192071+0000", 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4679999999999997e-06 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192214+0000", 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000142948 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192223+0000", 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8130000000000002e-06 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538006+0000", 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34578290299999997 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538028+0000", 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2002999999999999e-05 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591185+0000", 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053157688 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591278+0000", 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2434000000000003e-05 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:27.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591456+0000", 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000177765 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138410 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 348160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.777068005, 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399528573, 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:27.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138410 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192148+0000", 2024-09-22T01:37:28.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9599999999999999e-07 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192151+0000", 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.63e-06 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192159+0000", 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6510000000000001e-06 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192165+0000", 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2349999999999996e-06 2024-09-22T01:37:28.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192301+0000", 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136124 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192309+0000", 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2320000000000001e-06 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538066+0000", 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345756485 2024-09-22T01:37:28.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538075+0000", 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309999999999992e-06 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591495+0000", 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053420759 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591559+0000", 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4108000000000004e-05 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591676+0000", 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116122 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138411 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 368640~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.776981686999999, 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3997209019999999, 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138411 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192234+0000", 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192237+0000", 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4850000000000001e-06 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192245+0000", 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9079999999999995e-06 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192251+0000", 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8880000000000002e-06 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192388+0000", 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013639500000000001 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192413+0000", 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5411000000000001e-05 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538143+0000", 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573035800000002 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538165+0000", 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1929e-05 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591711+0000", 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0535457159999999 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591800+0000", 2024-09-22T01:37:28.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8556999999999999e-05 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591954+0000", 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154628 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138412 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 389120~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.776895228000001, 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399867717, 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.009 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138412 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:28.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192324+0000", 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5219999999999999e-06 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192332+0000", 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.96e-06 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192338+0000", 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2140000000000001e-06 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192490+0000", 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015239 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192499+0000", 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8240000000000006e-06 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538235+0000", 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573599700000002 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538244+0000", 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9490000000000002e-06 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592004+0000", 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0537599369999999 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592070+0000", 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5321999999999996e-05 2024-09-22T01:37:28.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592187+0000", 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117973 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138413 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 409600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.776791747000001, 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4000562969999999, 2024-09-22T01:37:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138413 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192424+0000", 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192427+0000", 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.506e-06 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192435+0000", 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8760000000000005e-06 2024-09-22T01:37:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192441+0000", 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5049999999999998e-06 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192578+0000", 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013744699999999999 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192587+0000", 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5380000000000002e-06 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538307+0000", 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345719954 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538320+0000", 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2976000000000001e-05 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592226+0000", 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053906327 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592318+0000", 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2199000000000003e-05 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592480+0000", 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016129800000000001 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138414 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 430080~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.776704663, 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4002321010000001, 2024-09-22T01:37:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138414 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192511+0000", 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7899999999999998e-07 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192515+0000", 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8659999999999999e-06 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192523+0000", 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9480000000000008e-06 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192529+0000", 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.088e-06 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192670+0000", 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014069199999999999 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192678+0000", 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6880000000000005e-06 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538397+0000", 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34571886600000001 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538403+0000", 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592507+0000", 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0541037799999999 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592590+0000", 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3506999999999999e-05 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592742+0000", 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015220500000000001 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138415 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 450560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.776617551000001, 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4003886910000001, 2024-09-22T01:37:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138415 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192598+0000", 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192602+0000", 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4079999999999998e-06 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192609+0000", 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9109999999999993e-06 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192616+0000", 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1879999999999999e-06 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192888+0000", 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000272475 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192898+0000", 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-06 2024-09-22T01:37:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538424+0000", 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34552665100000002 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538433+0000", 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2979999999999992e-06 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592785+0000", 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0543528529999999 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592863+0000", 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7534999999999995e-05 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592986+0000", 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123201 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138416 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 471040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:28.029 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.776525951, 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4005776480000001, 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138416 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192690+0000", 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192693+0000", 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6669999999999998e-06 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192701+0000", 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1089999999999998e-06 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192708+0000", 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0569999999999998e-06 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193001+0000", 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000293288 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193010+0000", 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.346e-06 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538482+0000", 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34547171599999998 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538494+0000", 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1936999999999999e-05 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593021+0000", 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.054527456 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593108+0000", 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6743000000000006e-05 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593267+0000", 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015870599999999999 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138417 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 491520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.776305141000002, 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4006197579999999, 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138417 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192911+0000", 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4899999999999995e-07 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192920+0000", 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1679999999999993e-06 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192933+0000", 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3132000000000001e-05 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192940+0000", 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193107+0000", 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016665899999999999 2024-09-22T01:37:28.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193117+0000", 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0009e-05 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538566+0000", 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34544893700000001 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538581+0000", 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5438e-05 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593293+0000", 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547119359999999 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593375+0000", 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.195e-05 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593530+0000", 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015473 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138418 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 512000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.776194088, 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4007298539999999, 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138418 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193022+0000", 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5899999999999996e-07 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193026+0000", 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649999999999999e-06 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193038+0000", 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2099000000000001e-05 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193044+0000", 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.567e-06 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193248+0000", 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203978 2024-09-22T01:37:28.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193257+0000", 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0070000000000003e-06 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538642+0000", 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34538508099999998 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538657+0000", 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.452e-05 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593568+0000", 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0549109299999999 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593636+0000", 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7702999999999999e-05 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593751+0000", 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115145 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138429 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 458752~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.776046669999999, 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.400882792, 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138429 2024-09-22T01:37:28.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193169+0000", 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193172+0000", 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1319999999999998e-06 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193190+0000", 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8184000000000001e-05 2024-09-22T01:37:28.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193197+0000", 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3929999999999996e-06 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194935+0000", 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001738306 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194945+0000", 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8859999999999999e-06 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538696+0000", 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34375087300000001 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538702+0000", 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3339999999999998e-06 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593785+0000", 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.055083478 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593882+0000", 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6512e-05 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594051+0000", 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169185 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138457 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.774357222999999, 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3994306999999999, 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138457 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.052 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6199999999999998e-07 2024-09-22T01:37:28.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194867+0000", 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4980000000000006e-06 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194875+0000", 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3429999999999996e-06 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194881+0000", 2024-09-22T01:37:28.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7690000000000002e-06 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195318+0000", 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043666400000000002 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195327+0000", 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538752+0000", 2024-09-22T01:37:28.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34342517700000003 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538763+0000", 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1368e-05 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594096+0000", 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0553327100000001 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594164+0000", 2024-09-22T01:37:28.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8319999999999996e-05 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594288+0000", 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000124067 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138468 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 704512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.773979567000001, 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3993414930000001, 2024-09-22T01:37:28.057 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138468 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:28.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195236+0000", 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5099999999999999e-07 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195240+0000", 2024-09-22T01:37:28.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9720000000000003e-06 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195249+0000", 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1859999999999998e-06 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195256+0000", 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7989999999999996e-06 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195467+0000", 2024-09-22T01:37:28.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021063599999999999 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195477+0000", 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0468e-05 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538799+0000", 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34332192700000003 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538805+0000", 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594324+0000", 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0555192959999999 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594414+0000", 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0303000000000006e-05 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594577+0000", 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016252500000000001 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138471 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 487424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.773578732000001, 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399163084, 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.063 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138471 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:28.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195637+0000", 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0500000000000004e-07 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195640+0000", 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1300000000000001e-06 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195648+0000", 2024-09-22T01:37:28.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8790000000000003e-06 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195654+0000", 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2949999999999999e-06 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195704+0000", 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0281999999999997e-05 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195714+0000", 2024-09-22T01:37:28.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5219999999999996e-06 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538855+0000", 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34314121400000003 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538868+0000", 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2814e-05 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594614+0000", 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0557457189999999 2024-09-22T01:37:28.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594680+0000", 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5955000000000001e-05 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594799+0000", 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119769 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138482 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 499712~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.068 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.773216158, 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399082626, 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138482 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000005e-07 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196004+0000", 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0609999999999997e-06 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196012+0000", 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9039999999999998e-06 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196019+0000", 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8090000000000004e-06 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197752+0000", 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017325159999999999 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197770+0000", 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8615e-05 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538901+0000", 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34113091499999998 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538907+0000", 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4140000000000002e-06 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594834+0000", 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559273490000001 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594922+0000", 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8182000000000004e-05 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.595081+0000", 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015923599999999999 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138776 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 634880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 29.766319209999999, 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398108922, 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:28.074 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138776 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:28.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8799999999999998e-07 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202898+0000", 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1229999999999998e-06 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202905+0000", 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9120000000000001e-06 2024-09-22T01:37:28.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202910+0000", 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.169e-06 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202961+0000", 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0173000000000002e-05 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202969+0000", 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8980000000000002e-06 2024-09-22T01:37:28.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539828+0000", 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.336858714 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539834+0000", 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4840000000000003e-06 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600811+0000", 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0609770540000001 2024-09-22T01:37:28.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600885+0000", 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4010000000000005e-05 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.601005+0000", 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119997 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:28.079 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:28.080 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:28.081 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:28.081 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:28.077+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:28.182 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:28.181+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:28.253 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:28.253 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:28.253 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:28.268 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:28.312 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:28.308+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:28.384 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:28.381+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:28.395 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:28.395 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:28.396 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:28.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:28.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:28.496 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:28.492+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:28.561 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:28.562 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:28.582 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:28.582 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:28.585 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:28.580+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:28.592 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:28.592 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:28.603 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:28.608 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:28.617 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 6, 7, 0, 2, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:37:28.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T01:37:28.623 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:28.648 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:28.648 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:28.673 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:28.673 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:28.686 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:28.680+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:28.697 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:28.697 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:28.719 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:28.720 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:28.752 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:28.752 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:28.770 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:28.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:37:28.816 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:28.812+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:28.887 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:28.880+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:28.932 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:28.932 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:28.949 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:28.989 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:28.985+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:29.089 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:29.084+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:29.108 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:29.108 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:29.121 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:29.212 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:29.208+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:29.283 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:29.283 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:29.291 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:29.289+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:29.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:29.392 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:29.388+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:29.459 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:29.459 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:29.472 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:29.493 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:29.489+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T01:37:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:37:29.554 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T01:37:29.594 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:29.593+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:29.644 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:29.645 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:29.660 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:29.695 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:29.688+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:29.795 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:29.796 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:29.796 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:29.793+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:29.810 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:29.897 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:29.892+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:29.978 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:29.978 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:29.992 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:30.038 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:30.037+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:30.098 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:30.097+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:30.117 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:30.118 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:30.132 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:30.218 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:30.217+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:30.299 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:30.299 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:30.300 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:30.296+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:30.313 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:30.401 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:30.400+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:30.477 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:30.477 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:30.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:30.527 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T01:37:30.538 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:30.537+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:30.560 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-22T01:37:30.603 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:30.601+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:30.619 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:30.619 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:30.634 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:30.726 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:30.725+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:30.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:30.804 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:30.801+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:30.806 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:30.806 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:30.821 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:30.877 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:30.877 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:30.893 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:30.904 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:30.900+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:30.911 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:30.911 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:30.928 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:30.928 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:30.947 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:30.947 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:30.966 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:30.987 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:30.991 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:30.991 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:30.992 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:30.992 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:30.992 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:31.006 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:31.007 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:31.000+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:31.007 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:31.008 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:31.107 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:31.105+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:31.133 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:31.133 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:31.133 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:31.133 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:31.133 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.05491665700001, 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.134 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.135 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.136 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.137 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.054879629, 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.138 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.139 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:37:31.140 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:37:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.043329169, 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.142 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.145 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.04329516200001, 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.146 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.147 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.148 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.149 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71910 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4971520~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.039427812, 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089703557000000003, 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.150 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71910 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090909+0000", 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.151 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090910+0000", 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0100000000000004e-07 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090914+0000", 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.7050000000000001e-06 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090933+0000", 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8873999999999999e-05 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.152 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090943+0000", 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9019999999999994e-06 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180335+0000", 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089392661999999998 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180478+0000", 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014236399999999999 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.153 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180613+0000", 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013524899999999999 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.039382264, 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.154 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:37:31.155 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:37:31.156 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:37:31.157 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.03933705599999, 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.158 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.159 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.160 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:37:31.161 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.039302464, 2024-09-22T01:37:31.162 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.163 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.164 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.165 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:31.166 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.039268816, 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.167 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.168 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.169 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.170 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.03553932600001, 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.171 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:31.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:37:31.173 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.174 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.035502823, 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:31.175 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:37:31.176 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:37:31.177 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.178 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.03545818400001, 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.179 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.180 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.181 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.182 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.03540795799999, 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.183 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:37:31.184 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:37:31.185 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:37:31.186 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.035369516, 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.187 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.188 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.189 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.190 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.035325521, 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.191 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.193 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.194 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.035286371, 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.195 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.196 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:37:31.197 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:37:31.198 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.03144320299999, 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:37:31.200 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:37:31.201 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:37:31.202 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 123.03136287700001, 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.203 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.204 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.205 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.206 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 122.32680958100001, 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.207 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.208 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.209 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.210 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.211 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 121.332668013, 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:37:31.212 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.213 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.214 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:31.215 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.216 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.217 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.218 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:31.219 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:31.219 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:31.212+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:31.320 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:31.317+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:31.389 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:31.389 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:31.389 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:31.389 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:31.404 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:31.421 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:31.420+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:31.522 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:31.521+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:31.539 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 1 (10000) 2024-09-22T01:37:31.554 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:37:31.571 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-22T01:37:31.583 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:31.583 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:31.583 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:31.584 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:31.584 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:31.598 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:31.642 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:31.641+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:31.723 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:31.716+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:31.767 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:31.767 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:31.767 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:31.767 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:31.767 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 178.45466976399999, 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.768 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.769 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.770 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.771 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.772 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.923897068, 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.774 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:31.775 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:37:31.776 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:37:31.777 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.92366978800001, 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.778 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:31.779 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.780 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:37:31.781 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.92050150399999, 2024-09-22T01:37:31.782 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.783 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.784 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.785 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.786 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.92041724000001, 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.787 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.788 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:37:31.789 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:37:31.790 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.92036574400001, 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.791 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.792 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.793 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.794 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.92032042400001, 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.795 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:31.796 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:37:31.797 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:37:31.798 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.799 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.916840167, 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:31.800 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:37:31.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.91653535500001, 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.807 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.916485911, 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.808 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:37:31.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.811 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.916441357, 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.812 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.815 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.91639770699999, 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.816 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:37:31.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:37:31.819 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.916350486, 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.820 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.822 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.91615547999999, 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.824 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.826 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.916105993, 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.828 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:37:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:37:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.832 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.912954934, 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.91260930600001, 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:37:31.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.912513883, 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:37:31.840 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.912461304, 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:31.844 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:37:31.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:37:31.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 146.91241953700001, 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.848 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:37:31.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:37:31.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:31.851 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:31.853 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:31.853 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:31.849+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:31.954 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:31.948+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:31.972 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:31.972 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:31.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.972 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:150772 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e161)", 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:37:31.538378+0000", 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.43362992700000003, 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.433659089, 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for peered", 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 150772 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.538378+0000", 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.538378+0000", 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.538382+0000", 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7859999999999998e-06 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:31.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.538396+0000", 2024-09-22T01:37:31.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.42e-05 2024-09-22T01:37:31.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:31.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.538444+0000", 2024-09-22T01:37:31.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7716000000000002e-05 2024-09-22T01:37:31.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.538468+0000", 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.4162999999999999e-05 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.541292+0000", 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0028241849999999999 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.541308+0000", 2024-09-22T01:37:31.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6424000000000001e-05 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:150773 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e161)", 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:37:31.542453+0000", 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.42955516199999999, 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.42965145599999999, 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for peered", 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:31.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 150773 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.542453+0000", 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.542453+0000", 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.542455+0000", 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.6469999999999998e-06 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.542465+0000", 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4809999999999995e-06 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.542480+0000", 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5143999999999999e-05 2024-09-22T01:37:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.542490+0000", 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0481e-05 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.544157+0000", 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0016663489999999999 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.544190+0000", 2024-09-22T01:37:31.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.349e-05 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:150774 3.1 3.258fc4c1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e161)", 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:37:31.776128+0000", 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 0.195879734, 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.19603242800000001, 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "waiting for peered", 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:31.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 150774 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.776128+0000", 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.776128+0000", 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.776130+0000", 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1670000000000002e-06 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.776141+0000", 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1029000000000001e-05 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.776170+0000", 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8704000000000002e-05 2024-09-22T01:37:31.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.776184+0000", 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4344e-05 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.776278+0000", 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4084000000000002e-05 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:37:31.776294+0000", 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5492999999999999e-05 2024-09-22T01:37:31.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:31.985 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:31.985 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:31.985 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:31.985 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:37:31.985 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 3 2024-09-22T01:37:31.985 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:31.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:32.055 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:32.053+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:32.156 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:32.156 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:32.156 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:32.157 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:32.152+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:32.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:32.258 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:32.252+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:32.338 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:32.338 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:32.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:32.338 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138405 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 245760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.142744010999998, 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398091244, 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138405 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0999999999999998e-07 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191651+0000", 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1529999999999997e-06 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191659+0000", 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7470000000000005e-06 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191665+0000", 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2439999999999998e-06 2024-09-22T01:37:32.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191817+0000", 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151414 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191827+0000", 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0305e-05 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537811+0000", 2024-09-22T01:37:32.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34598379000000001 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537817+0000", 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7359999999999998e-06 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589536+0000", 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517191669999999 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589611+0000", 2024-09-22T01:37:32.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5436000000000001e-05 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589734+0000", 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012264200000000001 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138406 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 266240~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.142649474000002, 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3985561479999999, 2024-09-22T01:37:32.344 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138406 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191738+0000", 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191741+0000", 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4479999999999999e-06 2024-09-22T01:37:32.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191749+0000", 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6029999999999999e-06 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191755+0000", 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.139e-06 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191922+0000", 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000166589 2024-09-22T01:37:32.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191931+0000", 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.132e-06 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537867+0000", 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34593649399999998 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537879+0000", 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-05 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589835+0000", 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519563439999999 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590007+0000", 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171182 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590293+0000", 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00028668699999999999 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.349 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138407 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 286720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.142548462999997, 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3989841119999999, 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138407 2024-09-22T01:37:32.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191839+0000", 2024-09-22T01:37:32.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191843+0000", 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7189999999999999e-06 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191854+0000", 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1728e-05 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191861+0000", 2024-09-22T01:37:32.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3589999999999996e-06 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192030+0000", 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169789 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192040+0000", 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.251e-06 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537916+0000", 2024-09-22T01:37:32.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34587605199999999 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537921+0000", 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0370000000000002e-06 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590343+0000", 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0524222999999999 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590511+0000", 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001683 2024-09-22T01:37:32.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590822+0000", 2024-09-22T01:37:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00031091400000000003 2024-09-22T01:37:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.355 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138408 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 307200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.142444918000002, 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399171419, 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138408 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:32.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2200000000000004e-07 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191946+0000", 2024-09-22T01:37:32.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7309999999999999e-06 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191958+0000", 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1678000000000001e-05 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191974+0000", 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6158e-05 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192127+0000", 2024-09-22T01:37:32.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000153614 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192136+0000", 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7290000000000006e-06 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537946+0000", 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345810267 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537954+0000", 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5320000000000001e-06 2024-09-22T01:37:32.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590877+0000", 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529233330000001 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590965+0000", 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8134999999999996e-05 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591113+0000", 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014762 2024-09-22T01:37:32.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138409 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 327680~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.142335729000003, 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399404775, 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138409 2024-09-22T01:37:32.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2799999999999996e-07 2024-09-22T01:37:32.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192055+0000", 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8510000000000001e-06 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192065+0000", 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2739999999999996e-06 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192071+0000", 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4679999999999997e-06 2024-09-22T01:37:32.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192214+0000", 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000142948 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192223+0000", 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8130000000000002e-06 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538006+0000", 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34578290299999997 2024-09-22T01:37:32.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538028+0000", 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2002999999999999e-05 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591185+0000", 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053157688 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591278+0000", 2024-09-22T01:37:32.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2434000000000003e-05 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591456+0000", 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000177765 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138410 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 348160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.142239596000003, 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399528573, 2024-09-22T01:37:32.366 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.367 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138410 2024-09-22T01:37:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:32.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192148+0000", 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9599999999999999e-07 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192151+0000", 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.63e-06 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192159+0000", 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6510000000000001e-06 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192165+0000", 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2349999999999996e-06 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192301+0000", 2024-09-22T01:37:32.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136124 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192309+0000", 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2320000000000001e-06 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538066+0000", 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345756485 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538075+0000", 2024-09-22T01:37:32.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309999999999992e-06 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591495+0000", 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053420759 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591559+0000", 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4108000000000004e-05 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591676+0000", 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116122 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138411 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 368640~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.142153278000002, 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3997209019999999, 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138411 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192234+0000", 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192237+0000", 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4850000000000001e-06 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192245+0000", 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9079999999999995e-06 2024-09-22T01:37:32.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192251+0000", 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8880000000000002e-06 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192388+0000", 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013639500000000001 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192413+0000", 2024-09-22T01:37:32.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5411000000000001e-05 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538143+0000", 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573035800000002 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538165+0000", 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1929e-05 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591711+0000", 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0535457159999999 2024-09-22T01:37:32.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591800+0000", 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8556999999999999e-05 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591954+0000", 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154628 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138412 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 389120~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.142066819, 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399867717, 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138412 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192324+0000", 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5219999999999999e-06 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192332+0000", 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.96e-06 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192338+0000", 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2140000000000001e-06 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192490+0000", 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015239 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192499+0000", 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8240000000000006e-06 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538235+0000", 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573599700000002 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538244+0000", 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9490000000000002e-06 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592004+0000", 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0537599369999999 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592070+0000", 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5321999999999996e-05 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592187+0000", 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117973 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138413 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 409600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.141963337999996, 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4000562969999999, 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.385 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138413 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:32.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192424+0000", 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192427+0000", 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.506e-06 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192435+0000", 2024-09-22T01:37:32.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8760000000000005e-06 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192441+0000", 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5049999999999998e-06 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192578+0000", 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013744699999999999 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192587+0000", 2024-09-22T01:37:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5380000000000002e-06 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538307+0000", 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345719954 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538320+0000", 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2976000000000001e-05 2024-09-22T01:37:32.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592226+0000", 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053906327 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592318+0000", 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2199000000000003e-05 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592480+0000", 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016129800000000001 2024-09-22T01:37:32.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138414 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 430080~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.141876254000003, 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4002321010000001, 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.391 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138414 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192511+0000", 2024-09-22T01:37:32.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7899999999999998e-07 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192515+0000", 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8659999999999999e-06 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192523+0000", 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9480000000000008e-06 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192529+0000", 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.088e-06 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192670+0000", 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014069199999999999 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192678+0000", 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6880000000000005e-06 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538397+0000", 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34571886600000001 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538403+0000", 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592507+0000", 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0541037799999999 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592590+0000", 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3506999999999999e-05 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592742+0000", 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015220500000000001 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138415 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 450560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.141789142, 2024-09-22T01:37:32.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4003886910000001, 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138415 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192598+0000", 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192602+0000", 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4079999999999998e-06 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192609+0000", 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9109999999999993e-06 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192616+0000", 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1879999999999999e-06 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192888+0000", 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000272475 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192898+0000", 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-06 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538424+0000", 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34552665100000002 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538433+0000", 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2979999999999992e-06 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592785+0000", 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0543528529999999 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592863+0000", 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7534999999999995e-05 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592986+0000", 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123201 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138416 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 471040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.141697542000003, 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4005776480000001, 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138416 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192690+0000", 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192693+0000", 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6669999999999998e-06 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192701+0000", 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1089999999999998e-06 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192708+0000", 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0569999999999998e-06 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193001+0000", 2024-09-22T01:37:32.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000293288 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193010+0000", 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.346e-06 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538482+0000", 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34547171599999998 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538494+0000", 2024-09-22T01:37:32.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1936999999999999e-05 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593021+0000", 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.054527456 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593108+0000", 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6743000000000006e-05 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593267+0000", 2024-09-22T01:37:32.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015870599999999999 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138417 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 491520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.141476732000001, 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4006197579999999, 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.407 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138417 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192911+0000", 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4899999999999995e-07 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192920+0000", 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1679999999999993e-06 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192933+0000", 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3132000000000001e-05 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192940+0000", 2024-09-22T01:37:32.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193107+0000", 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016665899999999999 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193117+0000", 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0009e-05 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.410 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538566+0000", 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34544893700000001 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538581+0000", 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5438e-05 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593293+0000", 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547119359999999 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.411 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593375+0000", 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.195e-05 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593530+0000", 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015473 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138418 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 512000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.141365679000003, 2024-09-22T01:37:32.412 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4007298539999999, 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138418 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193022+0000", 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5899999999999996e-07 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193026+0000", 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649999999999999e-06 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193038+0000", 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2099000000000001e-05 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193044+0000", 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.567e-06 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193248+0000", 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203978 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.415 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193257+0000", 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0070000000000003e-06 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538642+0000", 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34538508099999998 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538657+0000", 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.452e-05 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.416 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593568+0000", 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0549109299999999 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593636+0000", 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7702999999999999e-05 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593751+0000", 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115145 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138429 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 458752~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.141218260999999, 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.400882792, 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138429 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.418 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193169+0000", 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.419 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193172+0000", 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1319999999999998e-06 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193190+0000", 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8184000000000001e-05 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193197+0000", 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3929999999999996e-06 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194935+0000", 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001738306 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194945+0000", 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8859999999999999e-06 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538696+0000", 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34375087300000001 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.421 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538702+0000", 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3339999999999998e-06 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593785+0000", 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.055083478 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593882+0000", 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6512e-05 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.422 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594051+0000", 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169185 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138457 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.139528814000002, 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3994306999999999, 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.423 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138457 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6199999999999998e-07 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194867+0000", 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4980000000000006e-06 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194875+0000", 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3429999999999996e-06 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194881+0000", 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7690000000000002e-06 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195318+0000", 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043666400000000002 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195327+0000", 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538752+0000", 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34342517700000003 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538763+0000", 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1368e-05 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594096+0000", 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0553327100000001 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.427 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594164+0000", 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8319999999999996e-05 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594288+0000", 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000124067 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138468 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 704512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:32.428 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.139151157999997, 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3993414930000001, 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138468 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195236+0000", 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5099999999999999e-07 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195240+0000", 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9720000000000003e-06 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195249+0000", 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1859999999999998e-06 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195256+0000", 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7989999999999996e-06 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195467+0000", 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021063599999999999 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195477+0000", 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0468e-05 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538799+0000", 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34332192700000003 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538805+0000", 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.432 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594324+0000", 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0555192959999999 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594414+0000", 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0303000000000006e-05 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594577+0000", 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016252500000000001 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138471 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 487424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.138750322999996, 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399163084, 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138471 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.434 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195637+0000", 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0500000000000004e-07 2024-09-22T01:37:32.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195640+0000", 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1300000000000001e-06 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195648+0000", 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8790000000000003e-06 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195654+0000", 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2949999999999999e-06 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195704+0000", 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0281999999999997e-05 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195714+0000", 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5219999999999996e-06 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538855+0000", 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34314121400000003 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.437 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538868+0000", 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2814e-05 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594614+0000", 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0557457189999999 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594680+0000", 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5955000000000001e-05 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.438 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594799+0000", 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119769 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138482 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 499712~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.138387749000003, 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399082626, 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.439 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138482 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000005e-07 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196004+0000", 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0609999999999997e-06 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196012+0000", 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9039999999999998e-06 2024-09-22T01:37:32.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196019+0000", 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8090000000000004e-06 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197752+0000", 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017325159999999999 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197770+0000", 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8615e-05 2024-09-22T01:37:32.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538901+0000", 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34113091499999998 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538907+0000", 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4140000000000002e-06 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594834+0000", 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559273490000001 2024-09-22T01:37:32.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594922+0000", 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8182000000000004e-05 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.595081+0000", 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015923599999999999 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.444 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138776 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 634880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 34.131490800999998, 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398108922, 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138776 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8799999999999998e-07 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202898+0000", 2024-09-22T01:37:32.446 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1229999999999998e-06 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202905+0000", 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9120000000000001e-06 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202910+0000", 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.169e-06 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202961+0000", 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0173000000000002e-05 2024-09-22T01:37:32.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202969+0000", 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8980000000000002e-06 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539828+0000", 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.336858714 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539834+0000", 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4840000000000003e-06 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600811+0000", 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0609770540000001 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600885+0000", 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4010000000000005e-05 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.601005+0000", 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119997 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.449 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.450 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.450 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.450 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.450 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:32.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:32.452 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:32.449+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:32.531 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:37:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.6 to 1 (10000) 2024-09-22T01:37:32.552 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:32.549+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:32.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-22T01:37:32.632 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:32.632 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:32.632 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:32.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:32.696 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:32.692+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:32.754 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:32.753+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:32.822 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:32.822 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:32.822 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:32.822 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:32.822 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:32.837 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:32.884 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:32.880+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:32.956 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:32.952+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:32.962 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:32.962 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:32.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:32.962 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:32.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.962 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:32.962 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:32.962 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.15838129300001, 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:32.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.158326117, 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:37:32.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.158261004, 2024-09-22T01:37:32.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.158195257, 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.15815778699999, 2024-09-22T01:37:32.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:37:32.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:37:32.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.989 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.158107171, 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.15692183199999, 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:32.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:32.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:37:32.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:37:32.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.000 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.156860005, 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:33.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.156811206, 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:37:33.006 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:37:33.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:37:33.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.15673765299999, 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.012 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:37:33.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:33.017 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.156667191, 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.022 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.15659668799999, 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.023 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:37:33.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:37:33.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:37:33.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:37:33.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.15654945599999, 2024-09-22T01:37:33.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.030 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.033 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.15648658000001, 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:37:33.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:33.039 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.156445914, 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:37:33.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.156351047, 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.045 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:37:33.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:37:33.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.15631001, 2024-09-22T01:37:33.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:37:33.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:37:33.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.156272519, 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:37:33.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:37:33.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:37:33.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:37:33.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.15623237, 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:33.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:37:33.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:33.066 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 124.156189575, 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:33.072 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:33.072 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:33.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:33.074 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:33.074 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:33.068+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:33.174 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:33.173+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:33.243 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:33.244 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:33.244 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:33.244 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:33.259 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:33.277 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:33.277 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:33.278 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:33.272+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:33.294 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:33.294 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:33.311 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:33.311 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:33.328 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:33.328 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:33.348 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:33.349 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:33.369 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:33.369 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:33.376 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:33.376 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:33.376 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:33.373+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:33.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:33.392 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:33.392 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:33.415 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:33.415 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:33.484 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:33.480+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:33.512 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:33.512 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:33.527 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:33.536 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.7 to 1 (10000) 2024-09-22T01:37:33.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T01:37:33.577 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:33.573+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:33.659 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:33.660 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:33.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:33.677 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:33.673+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:33.778 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:33.772+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:33.855 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:33.855 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:33.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:33.924 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:33.924+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:33.979 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:33.977+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:34.063 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:34.063 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:34.077 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:34.080 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:34.076+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:34.181 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:34.177+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:34.212 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:34.212 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:34.228 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:34.282 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:34.276+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:34.383 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:34.381+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:34.395 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:34.395 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:34.409 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:34.498 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:34.497+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:34.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:37:34.577 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:34.577 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:34.592 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:34.604 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:34.600+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:34.685 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:34.680+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:34.758 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:34.758 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:34.774 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:34.783 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T01:37:34.786 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:34.780+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:34.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T01:37:34.904 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:34.900+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:34.910 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:34.910 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:34.926 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:34.987 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:34.985+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:35.052 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:35.052 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:35.066 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:35.110 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:35.109+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:35.189 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:35.184+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:35.231 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:35.231 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:35.245 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:35.290 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:35.284+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:35.372 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:35.372 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:35.385 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:35.430 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:35.429+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:35.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:35.491 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:35.484+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:35.503 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:35.503 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:35.517 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:35.592 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:35.588+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:35.596 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:35.596 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:35.613 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:35.631 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:35.631 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:35.648 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:35.648 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:35.669 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:35.669 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:35.681 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:35.681 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:35.688 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:35.688 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:35.693 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:35.689+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:35.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:35.707 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:35.727 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:35.794 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:35.788+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:35.796 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:37:35.796 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T01:37:35.832 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-22T01:37:35.874 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:35.874 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:35.874 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:35.874 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:35.874 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:35.891 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:35.924 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:35.920+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:35.996 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:35.993+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:36.016 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 182.70460181600001, 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.017 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:37:36.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.17382911999999, 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.023 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:37:36.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.17360184, 2024-09-22T01:37:36.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:37:36.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:37:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:37:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:37:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:37:36.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.17043355600001, 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.032 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:37:36.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:36.036 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.170349292, 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:37:36.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.040 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.170297796, 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.041 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.044 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.170252476, 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.16677221899999, 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:37:36.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:37:36.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:36.052 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.166467407, 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.055 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.16641796299999, 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:37:36.056 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:37:36.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:37:36.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.16637340899999, 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.060 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:37:36.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:37:36.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.16632975900001, 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:37:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:37:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.16628253799999, 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.068 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.16608753200001, 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.16603804499999, 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:37:36.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.16288698599999, 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:37:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:37:36.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.162541358, 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.084 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.087 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.16244593499999, 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.162393356, 2024-09-22T01:37:36.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.162351589, 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:36.095 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:37:36.098 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.099 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.099 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.099 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:36.099 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:36.099 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:36.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:36.101 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:36.097+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:36.201 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:36.197+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:36.226 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:36.226 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:36.226 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:36.226 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:36.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:36.302 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:36.296+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:36.365 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:36.366 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:36.366 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:36.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:36.402 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:36.401+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:36.503 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:36.501+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:36.551 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:36.551 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:36.551 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:36.551 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138405 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 245760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.355476277000001, 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398091244, 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138405 2024-09-22T01:37:36.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:36.553 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0999999999999998e-07 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191651+0000", 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1529999999999997e-06 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191659+0000", 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7470000000000005e-06 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.554 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191665+0000", 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2439999999999998e-06 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191817+0000", 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151414 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191827+0000", 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0305e-05 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.555 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537811+0000", 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34598379000000001 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537817+0000", 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7359999999999998e-06 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589536+0000", 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517191669999999 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.556 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589611+0000", 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5436000000000001e-05 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589734+0000", 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012264200000000001 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138406 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 266240~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.355381739999999, 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3985561479999999, 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.558 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138406 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.559 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191738+0000", 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191741+0000", 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4479999999999999e-06 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191749+0000", 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6029999999999999e-06 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.560 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191755+0000", 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.139e-06 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191922+0000", 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000166589 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191931+0000", 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.132e-06 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537867+0000", 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34593649399999998 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537879+0000", 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-05 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589835+0000", 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519563439999999 2024-09-22T01:37:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590007+0000", 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171182 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590293+0000", 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00028668699999999999 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138407 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 286720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.355280729, 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3989841119999999, 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138407 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191839+0000", 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191843+0000", 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7189999999999999e-06 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191854+0000", 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1728e-05 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191861+0000", 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3589999999999996e-06 2024-09-22T01:37:36.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192030+0000", 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169789 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192040+0000", 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.251e-06 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537916+0000", 2024-09-22T01:37:36.567 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34587605199999999 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537921+0000", 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0370000000000002e-06 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590343+0000", 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0524222999999999 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590511+0000", 2024-09-22T01:37:36.568 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001683 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590822+0000", 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00031091400000000003 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138408 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 307200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.355177183999999, 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399171419, 2024-09-22T01:37:36.569 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138408 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2200000000000004e-07 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191946+0000", 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7309999999999999e-06 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191958+0000", 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1678000000000001e-05 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191974+0000", 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6158e-05 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192127+0000", 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000153614 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192136+0000", 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7290000000000006e-06 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537946+0000", 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345810267 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537954+0000", 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5320000000000001e-06 2024-09-22T01:37:36.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590877+0000", 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529233330000001 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590965+0000", 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8134999999999996e-05 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591113+0000", 2024-09-22T01:37:36.574 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014762 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138409 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 327680~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.355067994999999, 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399404775, 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.575 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138409 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.576 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2799999999999996e-07 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192055+0000", 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8510000000000001e-06 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192065+0000", 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2739999999999996e-06 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192071+0000", 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4679999999999997e-06 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192214+0000", 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000142948 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192223+0000", 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8130000000000002e-06 2024-09-22T01:37:36.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538006+0000", 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34578290299999997 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538028+0000", 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2002999999999999e-05 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591185+0000", 2024-09-22T01:37:36.579 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053157688 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591278+0000", 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2434000000000003e-05 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591456+0000", 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000177765 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.580 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138410 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 348160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.354971861999999, 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399528573, 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138410 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.581 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192148+0000", 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9599999999999999e-07 2024-09-22T01:37:36.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192151+0000", 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.63e-06 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192159+0000", 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6510000000000001e-06 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192165+0000", 2024-09-22T01:37:36.583 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2349999999999996e-06 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192301+0000", 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136124 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192309+0000", 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2320000000000001e-06 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538066+0000", 2024-09-22T01:37:36.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345756485 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538075+0000", 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309999999999992e-06 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591495+0000", 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053420759 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591559+0000", 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4108000000000004e-05 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591676+0000", 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116122 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138411 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 368640~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.354885543999998, 2024-09-22T01:37:36.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3997209019999999, 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138411 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192234+0000", 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192237+0000", 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4850000000000001e-06 2024-09-22T01:37:36.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192245+0000", 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9079999999999995e-06 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192251+0000", 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8880000000000002e-06 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192388+0000", 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013639500000000001 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192413+0000", 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5411000000000001e-05 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538143+0000", 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573035800000002 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538165+0000", 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1929e-05 2024-09-22T01:37:36.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591711+0000", 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0535457159999999 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591800+0000", 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8556999999999999e-05 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591954+0000", 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154628 2024-09-22T01:37:36.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138412 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 389120~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.354799085000003, 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399867717, 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.592 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138412 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192324+0000", 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5219999999999999e-06 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192332+0000", 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.96e-06 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192338+0000", 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2140000000000001e-06 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192490+0000", 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015239 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192499+0000", 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8240000000000006e-06 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538235+0000", 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573599700000002 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538244+0000", 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9490000000000002e-06 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592004+0000", 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0537599369999999 2024-09-22T01:37:36.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592070+0000", 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5321999999999996e-05 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592187+0000", 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117973 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.597 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138413 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 409600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.354695604, 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4000562969999999, 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138413 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192424+0000", 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192427+0000", 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.506e-06 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192435+0000", 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8760000000000005e-06 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192441+0000", 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5049999999999998e-06 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192578+0000", 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013744699999999999 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192587+0000", 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5380000000000002e-06 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538307+0000", 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345719954 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538320+0000", 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2976000000000001e-05 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592226+0000", 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053906327 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592318+0000", 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2199000000000003e-05 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592480+0000", 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016129800000000001 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138414 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 430080~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.354608519999999, 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4002321010000001, 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.603 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138414 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192511+0000", 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7899999999999998e-07 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192515+0000", 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8659999999999999e-06 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192523+0000", 2024-09-22T01:37:36.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9480000000000008e-06 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192529+0000", 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.088e-06 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192670+0000", 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014069199999999999 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192678+0000", 2024-09-22T01:37:36.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6880000000000005e-06 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538397+0000", 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34571886600000001 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538403+0000", 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592507+0000", 2024-09-22T01:37:36.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0541037799999999 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592590+0000", 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3506999999999999e-05 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592742+0000", 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015220500000000001 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138415 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 450560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.354521407999997, 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4003886910000001, 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138415 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192598+0000", 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:36.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192602+0000", 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4079999999999998e-06 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192609+0000", 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9109999999999993e-06 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192616+0000", 2024-09-22T01:37:36.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1879999999999999e-06 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192888+0000", 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000272475 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192898+0000", 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-06 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538424+0000", 2024-09-22T01:37:36.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34552665100000002 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538433+0000", 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2979999999999992e-06 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592785+0000", 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0543528529999999 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592863+0000", 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7534999999999995e-05 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592986+0000", 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123201 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138416 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 471040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.354429807999999, 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4005776480000001, 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138416 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192690+0000", 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192693+0000", 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6669999999999998e-06 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192701+0000", 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1089999999999998e-06 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192708+0000", 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0569999999999998e-06 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193001+0000", 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000293288 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193010+0000", 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.346e-06 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538482+0000", 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34547171599999998 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538494+0000", 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1936999999999999e-05 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593021+0000", 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.054527456 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593108+0000", 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6743000000000006e-05 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593267+0000", 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015870599999999999 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138417 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 491520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.354208997999997, 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4006197579999999, 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138417 2024-09-22T01:37:36.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192911+0000", 2024-09-22T01:37:36.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4899999999999995e-07 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192920+0000", 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1679999999999993e-06 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192933+0000", 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3132000000000001e-05 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192940+0000", 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193107+0000", 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016665899999999999 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193117+0000", 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0009e-05 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538566+0000", 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34544893700000001 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538581+0000", 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5438e-05 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593293+0000", 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547119359999999 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593375+0000", 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.195e-05 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593530+0000", 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015473 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138418 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 512000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.354097944999999, 2024-09-22T01:37:36.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4007298539999999, 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138418 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193022+0000", 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5899999999999996e-07 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193026+0000", 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649999999999999e-06 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193038+0000", 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2099000000000001e-05 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193044+0000", 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.567e-06 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193248+0000", 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203978 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193257+0000", 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0070000000000003e-06 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538642+0000", 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34538508099999998 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538657+0000", 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.452e-05 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593568+0000", 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0549109299999999 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593636+0000", 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7702999999999999e-05 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593751+0000", 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115145 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138429 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 458752~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.353950527000002, 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.400882792, 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138429 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.631 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193169+0000", 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193172+0000", 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1319999999999998e-06 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193190+0000", 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8184000000000001e-05 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193197+0000", 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3929999999999996e-06 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194935+0000", 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001738306 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194945+0000", 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8859999999999999e-06 2024-09-22T01:37:36.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538696+0000", 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34375087300000001 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538702+0000", 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3339999999999998e-06 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593785+0000", 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.055083478 2024-09-22T01:37:36.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593882+0000", 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6512e-05 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594051+0000", 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169185 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.636 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138457 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.352261079999998, 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3994306999999999, 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138457 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6199999999999998e-07 2024-09-22T01:37:36.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194867+0000", 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4980000000000006e-06 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194875+0000", 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3429999999999996e-06 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194881+0000", 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7690000000000002e-06 2024-09-22T01:37:36.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195318+0000", 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043666400000000002 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195327+0000", 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538752+0000", 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34342517700000003 2024-09-22T01:37:36.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538763+0000", 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1368e-05 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594096+0000", 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0553327100000001 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594164+0000", 2024-09-22T01:37:36.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8319999999999996e-05 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594288+0000", 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000124067 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138468 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 704512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.351883424, 2024-09-22T01:37:36.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3993414930000001, 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138468 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195236+0000", 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5099999999999999e-07 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195240+0000", 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9720000000000003e-06 2024-09-22T01:37:36.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195249+0000", 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1859999999999998e-06 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195256+0000", 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7989999999999996e-06 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195467+0000", 2024-09-22T01:37:36.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021063599999999999 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195477+0000", 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0468e-05 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538799+0000", 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34332192700000003 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538805+0000", 2024-09-22T01:37:36.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594324+0000", 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0555192959999999 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594414+0000", 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0303000000000006e-05 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594577+0000", 2024-09-22T01:37:36.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016252500000000001 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138471 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 487424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.351482589, 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399163084, 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.648 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138471 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195637+0000", 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0500000000000004e-07 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195640+0000", 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1300000000000001e-06 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195648+0000", 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8790000000000003e-06 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195654+0000", 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2949999999999999e-06 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195704+0000", 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0281999999999997e-05 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195714+0000", 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5219999999999996e-06 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538855+0000", 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34314121400000003 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538868+0000", 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2814e-05 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594614+0000", 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0557457189999999 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594680+0000", 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5955000000000001e-05 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594799+0000", 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119769 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138482 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 499712~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.653 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.351120014999999, 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399082626, 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138482 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000005e-07 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196004+0000", 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0609999999999997e-06 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196012+0000", 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9039999999999998e-06 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196019+0000", 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8090000000000004e-06 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197752+0000", 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017325159999999999 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197770+0000", 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8615e-05 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538901+0000", 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34113091499999998 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538907+0000", 2024-09-22T01:37:36.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4140000000000002e-06 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594834+0000", 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559273490000001 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594922+0000", 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8182000000000004e-05 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.595081+0000", 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015923599999999999 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138776 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 634880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 38.344223067000001, 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398108922, 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:36.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138776 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:36.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8799999999999998e-07 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202898+0000", 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1229999999999998e-06 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202905+0000", 2024-09-22T01:37:36.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9120000000000001e-06 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202910+0000", 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.169e-06 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202961+0000", 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0173000000000002e-05 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202969+0000", 2024-09-22T01:37:36.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8980000000000002e-06 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539828+0000", 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.336858714 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539834+0000", 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4840000000000003e-06 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600811+0000", 2024-09-22T01:37:36.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0609770540000001 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600885+0000", 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4010000000000005e-05 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.601005+0000", 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119997 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:36.664 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:36.665 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:36.666 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:36.666 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:36.665+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:36.767 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:36.765+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:36.798 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:36.798 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:36.798 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:36.813 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:36.813 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.5 to 1 (10000) 2024-09-22T01:37:36.843 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T01:37:36.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:37:36.868 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:36.865+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:36.944 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:36.945 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:36.945 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:36.945 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:36.945 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:36.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:37.008 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:37.004+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:37.069 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:37.064+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:37.092 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:37.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.288272299, 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:37:37.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:37:37.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:37:37.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:37.098 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28821712300001, 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:37.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:37:37.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:37:37.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:37:37.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28815201, 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.104 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:37:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.288086263, 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:37:37.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:37:37.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.115 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.288048793, 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:37:37.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28799817699999, 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:37:37.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:37:37.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.286812838, 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.127 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:37:37.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:37:37.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:37:37.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28675101100001, 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28670221199999, 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:37:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:37:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.286628659, 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:37:37.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:37:37.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.149 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28655819700001, 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28648769399999, 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.155 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:37.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.160 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.286440462, 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:37:37.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.166 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28637758599999, 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:37.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:37:37.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28633692, 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.177 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.286242053, 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:37:37.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:37:37.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:37.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:37:37.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:37:37.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:37:37.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:37:37.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:37:37.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:37:37.185 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.185 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.185 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28620101600001, 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.186 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:37:37.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:37:37.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28616352500001, 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:37:37.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:37:37.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28612337600001, 2024-09-22T01:37:37.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:37:37.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:37:37.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:37:37.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 128.28608058099999, 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:37:37.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:37:37.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:37:37.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.208 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:37.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:37.211 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:37.212 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:37:37.212 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-09-22T01:37:36.817375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":989854178,"num_objects":1091,"num_object_clones":344,"num_object_copies":2182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1091,"num_whiteouts":384,"num_read":193256,"num_read_kb":1031566,"num_write":20376,"num_write_kb":543650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4162,"num_bytes_recovered":350855936,"num_keys_recovered":856,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17243,"ondisk_log_size":17243,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":647732,"kb_used_data":243440,"kb_used_omap":12,"kb_used_meta":403379,"kb_avail":754326988,"statfs":{"total":773094113280,"available":772430835712,"internally_reserved":0,"allocated":249282560,"data_stored":336035970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":413060656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.281712"},"pg_stats":[{"pgid":"3.1f","version":"160'691","reported_seq":5871,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.545086+0000","last_change":"2024-09-22T01:37:31.545852+0000","last_active":"2024-09-22T01:37:31.545086+0000","last_peered":"2024-09-22T01:37:31.545086+0000","last_clean":"2024-09-22T01:37:31.545086+0000","last_became_active":"2024-09-22T01:37:19.529628+0000","last_became_peered":"2024-09-22T01:37:19.529628+0000","last_unstale":"2024-09-22T01:37:31.545086+0000","last_undegraded":"2024-09-22T01:37:31.545086+0000","last_fullsized":"2024-09-22T01:37:31.545086+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:21:01.031742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011614731999999999,"stat_sum":{"num_bytes":6929514,"num_objects":24,"num_object_clones":9,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":8,"num_read":6844,"num_read_kb":35423,"num_write":890,"num_write_kb":14988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":259,"num_bytes_recovered":23514092,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.1e","version":"161'511","reported_seq":4399,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.546585+0000","last_change":"2024-09-22T01:37:31.547819+0000","last_active":"2024-09-22T01:37:31.546585+0000","last_peered":"2024-09-22T01:37:31.546585+0000","last_clean":"2024-09-22T01:37:31.546585+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:37:31.546585+0000","last_undegraded":"2024-09-22T01:37:31.546585+0000","last_fullsized":"2024-09-22T01:37:31.546585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:24:17.005650+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0078169639999999992,"stat_sum":{"num_bytes":43143134,"num_objects":30,"num_object_clones":9,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":8,"num_read":5827,"num_read_kb":47549,"num_write":553,"num_write_kb":23734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.1d","version":"161'972","reported_seq":3252,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.561734+0000","last_change":"2024-09-22T01:37:31.563233+0000","last_active":"2024-09-22T01:37:31.561734+0000","last_peered":"2024-09-22T01:37:31.561734+0000","last_clean":"2024-09-22T01:37:31.561734+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:37:31.561734+0000","last_undegraded":"2024-09-22T01:37:31.561734+0000","last_fullsized":"2024-09-22T01:37:31.561734+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:41:11.102906+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.013962550000000001,"stat_sum":{"num_bytes":43721285,"num_objects":33,"num_object_clones":11,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":11,"num_read":5490,"num_read_kb":33874,"num_write":1499,"num_write_kb":16569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.1c","version":"161'262","reported_seq":2673,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.551714+0000","last_change":"2024-09-22T01:37:31.552680+0000","last_active":"2024-09-22T01:37:31.551714+0000","last_peered":"2024-09-22T01:37:31.551714+0000","last_clean":"2024-09-22T01:37:31.551714+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:37:31.551714+0000","last_undegraded":"2024-09-22T01:37:31.551714+0000","last_fullsized":"2024-09-22T01:37:31.551714+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:46:36.661397+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0053859930000000004,"stat_sum":{"num_bytes":12294506,"num_objects":16,"num_object_clones":5,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":2048,"num_read_kb":34898,"num_write":272,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.1b","version":"161'1061","reported_seq":4870,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.548449+0000","last_change":"2024-09-22T01:37:31.548740+0000","last_active":"2024-09-22T01:37:31.548449+0000","last_peered":"2024-09-22T01:37:31.548449+0000","last_clean":"2024-09-22T01:37:31.548449+0000","last_became_active":"2024-09-22T01:36:07.623588+0000","last_became_peered":"2024-09-22T01:36:07.623588+0000","last_unstale":"2024-09-22T01:37:31.548449+0000","last_undegraded":"2024-09-22T01:37:31.548449+0000","last_fullsized":"2024-09-22T01:37:31.548449+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:01:56.797104+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.014674866999999999,"stat_sum":{"num_bytes":47451447,"num_objects":39,"num_object_clones":11,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":16,"num_read":9348,"num_read_kb":24068,"num_write":1563,"num_write_kb":13722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":13691067,"num_keys_recovered":116,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.1a","version":"159'424","reported_seq":4812,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.534608+0000","last_change":"2024-09-22T01:37:31.535177+0000","last_active":"2024-09-22T01:37:31.534608+0000","last_peered":"2024-09-22T01:37:31.534608+0000","last_clean":"2024-09-22T01:37:31.534608+0000","last_became_active":"2024-09-22T01:34:48.539769+0000","last_became_peered":"2024-09-22T01:34:48.539769+0000","last_unstale":"2024-09-22T01:37:31.534608+0000","last_undegraded":"2024-09-22T01:37:31.534608+0000","last_fullsized":"2024-09-22T01:37:31.534608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:15.883459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002034681,"stat_sum":{"num_bytes":36353800,"num_objects":53,"num_object_clones":17,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":14,"num_read":4654,"num_read_kb":39997,"num_write":457,"num_write_kb":25278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.19","version":"160'786","reported_seq":9353,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.542648+0000","last_change":"2024-09-22T01:37:31.543017+0000","last_active":"2024-09-22T01:37:31.542648+0000","last_peered":"2024-09-22T01:37:31.542648+0000","last_clean":"2024-09-22T01:37:31.542648+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:37:31.542648+0000","last_undegraded":"2024-09-22T01:37:31.542648+0000","last_fullsized":"2024-09-22T01:37:31.542648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:21:31.965009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087837400000000002,"stat_sum":{"num_bytes":70397037,"num_objects":48,"num_object_clones":17,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":13,"num_read":10543,"num_read_kb":63629,"num_write":1092,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.18","version":"158'926","reported_seq":3099,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.554195+0000","last_change":"2024-09-22T01:37:31.554671+0000","last_active":"2024-09-22T01:37:31.554195+0000","last_peered":"2024-09-22T01:37:31.554195+0000","last_clean":"2024-09-22T01:37:31.554195+0000","last_became_active":"2024-09-22T01:36:03.522736+0000","last_became_peered":"2024-09-22T01:36:03.522736+0000","last_unstale":"2024-09-22T01:37:31.554195+0000","last_undegraded":"2024-09-22T01:37:31.554195+0000","last_fullsized":"2024-09-22T01:37:31.554195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":926,"log_dups_size":0,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:18:45.662292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013717192,"stat_sum":{"num_bytes":22649057,"num_objects":21,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":5437,"num_read_kb":18149,"num_write":1479,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1215906,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.17","version":"158'451","reported_seq":5890,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.536369+0000","last_change":"2024-09-22T01:37:31.544037+0000","last_active":"2024-09-22T01:37:31.536369+0000","last_peered":"2024-09-22T01:37:31.536369+0000","last_clean":"2024-09-22T01:37:31.536369+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:37:31.536369+0000","last_undegraded":"2024-09-22T01:37:31.536369+0000","last_fullsized":"2024-09-22T01:37:31.536369+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:38.231044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099684630000000003,"stat_sum":{"num_bytes":12989949,"num_objects":44,"num_object_clones":14,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":16,"num_read":5777,"num_read_kb":32124,"num_write":468,"num_write_kb":34048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.16","version":"161'633","reported_seq":14658,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.558768+0000","last_change":"2024-09-22T01:37:31.559204+0000","last_active":"2024-09-22T01:37:31.558768+0000","last_peered":"2024-09-22T01:37:31.558768+0000","last_clean":"2024-09-22T01:37:31.558768+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:37:31.558768+0000","last_undegraded":"2024-09-22T01:37:31.558768+0000","last_fullsized":"2024-09-22T01:37:31.558768+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:30:17.495399+0000","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.011741582,"stat_sum":{"num_bytes":68461157,"num_objects":50,"num_object_clones":18,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":16,"num_read":14736,"num_read_kb":34367,"num_write":666,"num_write_kb":12432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.15","version":"161'270","reported_seq":4917,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.550636+0000","last_change":"2024-09-22T01:37:31.551031+0000","last_active":"2024-09-22T01:37:31.550636+0000","last_peered":"2024-09-22T01:37:31.550636+0000","last_clean":"2024-09-22T01:37:31.550636+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:37:31.550636+0000","last_undegraded":"2024-09-22T01:37:31.550636+0000","last_fullsized":"2024-09-22T01:37:31.550636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:36:49.228636+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.012833567000000001,"stat_sum":{"num_bytes":10926978,"num_objects":28,"num_object_clones":11,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":11,"num_read":4129,"num_read_kb":34295,"num_write":241,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.14","version":"161'360","reported_seq":6058,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.538484+0000","last_change":"2024-09-22T01:37:31.538968+0000","last_active":"2024-09-22T01:37:31.538484+0000","last_peered":"2024-09-22T01:37:31.538484+0000","last_clean":"2024-09-22T01:37:31.538484+0000","last_became_active":"2024-09-22T01:36:00.564509+0000","last_became_peered":"2024-09-22T01:36:00.564509+0000","last_unstale":"2024-09-22T01:37:31.538484+0000","last_undegraded":"2024-09-22T01:37:31.538484+0000","last_fullsized":"2024-09-22T01:37:31.538484+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:33.077547+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0057214470000000002,"stat_sum":{"num_bytes":12916462,"num_objects":34,"num_object_clones":9,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":9,"num_read":6086,"num_read_kb":53973,"num_write":328,"num_write_kb":20591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":5198452,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"2.7","version":"0'0","reported_seq":312,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.547071+0000","last_change":"2024-09-22T01:35:57.529367+0000","last_active":"2024-09-22T01:37:31.547071+0000","last_peered":"2024-09-22T01:37:31.547071+0000","last_clean":"2024-09-22T01:37:31.547071+0000","last_became_active":"2024-09-22T01:35:57.528484+0000","last_became_peered":"2024-09-22T01:35:57.528484+0000","last_unstale":"2024-09-22T01:37:31.547071+0000","last_undegraded":"2024-09-22T01:37:31.547071+0000","last_fullsized":"2024-09-22T01:37:31.547071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:00.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'420","reported_seq":5567,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.544563+0000","last_change":"2024-09-22T01:37:31.545015+0000","last_active":"2024-09-22T01:37:31.544563+0000","last_peered":"2024-09-22T01:37:31.544563+0000","last_clean":"2024-09-22T01:37:31.544563+0000","last_became_active":"2024-09-22T01:36:06.618495+0000","last_became_peered":"2024-09-22T01:36:06.618495+0000","last_unstale":"2024-09-22T01:37:31.544563+0000","last_undegraded":"2024-09-22T01:37:31.544563+0000","last_fullsized":"2024-09-22T01:37:31.544563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:56:10.321271+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011053221,"stat_sum":{"num_bytes":61493133,"num_objects":51,"num_object_clones":19,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":23,"num_read":4986,"num_read_kb":38573,"num_write":384,"num_write_kb":38180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":25063433,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"2.6","version":"0'0","reported_seq":302,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.542385+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:37:31.542385+0000","last_peered":"2024-09-22T01:37:31.542385+0000","last_clean":"2024-09-22T01:37:31.542385+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:37:31.542385+0000","last_undegraded":"2024-09-22T01:37:31.542385+0000","last_fullsized":"2024-09-22T01:37:31.542385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'336","reported_seq":3335,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.551212+0000","last_change":"2024-09-22T01:37:31.551739+0000","last_active":"2024-09-22T01:37:31.551212+0000","last_peered":"2024-09-22T01:37:31.551212+0000","last_clean":"2024-09-22T01:37:31.551212+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:37:31.551212+0000","last_undegraded":"2024-09-22T01:37:31.551212+0000","last_fullsized":"2024-09-22T01:37:31.551212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:39:00.407503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011362996,"stat_sum":{"num_bytes":21114780,"num_objects":28,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":9,"num_read":3428,"num_read_kb":20696,"num_write":330,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"2.5","version":"0'0","reported_seq":187,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.537700+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:37:31.537700+0000","last_peered":"2024-09-22T01:37:31.537700+0000","last_clean":"2024-09-22T01:37:31.537700+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:37:31.537700+0000","last_undegraded":"2024-09-22T01:37:31.537700+0000","last_fullsized":"2024-09-22T01:37:31.537700+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"158'571","reported_seq":3928,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.534425+0000","last_change":"2024-09-22T01:37:31.537842+0000","last_active":"2024-09-22T01:37:31.534425+0000","last_peered":"2024-09-22T01:37:31.534425+0000","last_clean":"2024-09-22T01:37:31.534425+0000","last_became_active":"2024-09-22T01:36:12.660207+0000","last_became_peered":"2024-09-22T01:36:12.660207+0000","last_unstale":"2024-09-22T01:37:31.534425+0000","last_undegraded":"2024-09-22T01:37:31.534425+0000","last_fullsized":"2024-09-22T01:37:31.534425+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:15:18.266859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046835949999999996,"stat_sum":{"num_bytes":42791032,"num_objects":30,"num_object_clones":8,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":5385,"num_read_kb":37626,"num_write":596,"num_write_kb":11226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.534425+0000","last_change":"2024-09-22T01:36:03.520390+0000","last_active":"2024-09-22T01:37:31.534425+0000","last_peered":"2024-09-22T01:37:31.534425+0000","last_clean":"2024-09-22T01:37:31.534425+0000","last_became_active":"2024-09-22T01:36:03.519493+0000","last_became_peered":"2024-09-22T01:36:03.519493+0000","last_unstale":"2024-09-22T01:37:31.534425+0000","last_undegraded":"2024-09-22T01:37:31.534425+0000","last_fullsized":"2024-09-22T01:37:31.534425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:25:49.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"161'473","reported_seq":7934,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.563196+0000","last_change":"2024-09-22T01:37:31.563558+0000","last_active":"2024-09-22T01:37:31.563196+0000","last_peered":"2024-09-22T01:37:31.563196+0000","last_clean":"2024-09-22T01:37:31.563196+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:37:31.563196+0000","last_undegraded":"2024-09-22T01:37:31.563196+0000","last_fullsized":"2024-09-22T01:37:31.563196+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:40:18.703561+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.013740664,"stat_sum":{"num_bytes":34483794,"num_objects":31,"num_object_clones":9,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":8439,"num_read_kb":54192,"num_write":498,"num_write_kb":18740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.3","version":"160'295","reported_seq":1356,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.548555+0000","last_change":"2024-09-22T01:37:31.548555+0000","last_active":"2024-09-22T01:37:31.548555+0000","last_peered":"2024-09-22T01:37:31.548555+0000","last_clean":"2024-09-22T01:37:31.548555+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:37:31.548555+0000","last_undegraded":"2024-09-22T01:37:31.548555+0000","last_fullsized":"2024-09-22T01:37:31.548555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:46:06.411502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00128688,"stat_sum":{"num_bytes":4244156,"num_objects":34,"num_object_clones":10,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":14,"num_read":1337,"num_read_kb":6292,"num_write":284,"num_write_kb":3505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"2.2","version":"20'2","reported_seq":50,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.553365+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:37:31.553365+0000","last_peered":"2024-09-22T01:37:31.553365+0000","last_clean":"2024-09-22T01:37:31.553365+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:37:31.553365+0000","last_undegraded":"2024-09-22T01:37:31.553365+0000","last_fullsized":"2024-09-22T01:37:31.553365+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"156'481","reported_seq":3766,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.542834+0000","last_change":"2024-09-22T01:37:31.544167+0000","last_active":"2024-09-22T01:37:31.542834+0000","last_peered":"2024-09-22T01:37:31.542834+0000","last_clean":"2024-09-22T01:37:31.542834+0000","last_became_active":"2024-09-22T01:36:39.852969+0000","last_became_peered":"2024-09-22T01:36:39.852969+0000","last_unstale":"2024-09-22T01:37:31.542834+0000","last_undegraded":"2024-09-22T01:37:31.542834+0000","last_fullsized":"2024-09-22T01:37:31.542834+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:09:23.493655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001822698,"stat_sum":{"num_bytes":6209141,"num_objects":29,"num_object_clones":10,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":13,"num_read":4307,"num_read_kb":14841,"num_write":505,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"2.1","version":"0'0","reported_seq":158,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.532641+0000","last_change":"2024-09-22T01:36:09.627096+0000","last_active":"2024-09-22T01:37:31.532641+0000","last_peered":"2024-09-22T01:37:31.532641+0000","last_clean":"2024-09-22T01:37:31.532641+0000","last_became_active":"2024-09-22T01:36:09.626669+0000","last_became_peered":"2024-09-22T01:36:09.626669+0000","last_unstale":"2024-09-22T01:37:31.532641+0000","last_undegraded":"2024-09-22T01:37:31.532641+0000","last_fullsized":"2024-09-22T01:37:31.532641+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:35.787005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'473","reported_seq":4192,"reported_epoch":160,"state":"peering","last_fresh":"2024-09-22T01:37:30.749406+0000","last_change":"2024-09-22T01:37:31.535280+0000","last_active":"2024-09-22T01:37:31.535280+0000","last_peered":"2024-09-22T01:37:30.749406+0000","last_clean":"2024-09-22T01:37:30.749406+0000","last_became_active":"2024-09-22T01:37:01.529118+0000","last_became_peered":"2024-09-22T01:37:01.529118+0000","last_unstale":"2024-09-22T01:37:30.749406+0000","last_undegraded":"2024-09-22T01:37:30.749406+0000","last_fullsized":"2024-09-22T01:37:30.749406+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098227100000000006,"stat_sum":{"num_bytes":23356436,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":17,"num_read":4755,"num_read_kb":25717,"num_write":528,"num_write_kb":13025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":13991851,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1b","length":"5"}]},{"pgid":"2.0","version":"0'0","reported_seq":182,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.537512+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:37:31.537512+0000","last_peered":"2024-09-22T01:37:31.537512+0000","last_clean":"2024-09-22T01:37:31.537512+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:37:31.537512+0000","last_undegraded":"2024-09-22T01:37:31.537512+0000","last_fullsized":"2024-09-22T01:37:31.537512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"161'432","reported_seq":2514,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.553669+0000","last_change":"2024-09-22T01:37:31.554132+0000","last_active":"2024-09-22T01:37:31.553669+0000","last_peered":"2024-09-22T01:37:31.553669+0000","last_clean":"2024-09-22T01:37:31.553669+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:37:31.553669+0000","last_undegraded":"2024-09-22T01:37:31.553669+0000","last_fullsized":"2024-09-22T01:37:31.553669+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:15:49.422684+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.014371953,"stat_sum":{"num_bytes":16931902,"num_objects":34,"num_object_clones":11,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":15,"num_read":2666,"num_read_kb":16188,"num_write":479,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"2.3","version":"18'1","reported_seq":50,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.547037+0000","last_change":"2024-09-22T01:37:13.533524+0000","last_active":"2024-09-22T01:37:31.547037+0000","last_peered":"2024-09-22T01:37:31.547037+0000","last_clean":"2024-09-22T01:37:31.547037+0000","last_became_active":"2024-09-22T01:37:13.529493+0000","last_became_peered":"2024-09-22T01:37:13.529493+0000","last_unstale":"2024-09-22T01:37:31.547037+0000","last_undegraded":"2024-09-22T01:37:31.547037+0000","last_fullsized":"2024-09-22T01:37:31.547037+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:07.459369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":430,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.537629+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:37:31.537629+0000","last_peered":"2024-09-22T01:37:31.537629+0000","last_clean":"2024-09-22T01:37:31.537629+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:37:31.537629+0000","last_undegraded":"2024-09-22T01:37:31.537629+0000","last_fullsized":"2024-09-22T01:37:31.537629+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"161'683","reported_seq":2488,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.553920+0000","last_change":"2024-09-22T01:37:31.554813+0000","last_active":"2024-09-22T01:37:31.553920+0000","last_peered":"2024-09-22T01:37:31.553920+0000","last_clean":"2024-09-22T01:37:31.553920+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:37:31.553920+0000","last_undegraded":"2024-09-22T01:37:31.553920+0000","last_fullsized":"2024-09-22T01:37:31.553920+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:01.824640+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.014061934,"stat_sum":{"num_bytes":15310195,"num_objects":29,"num_object_clones":11,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":13,"num_read":7232,"num_read_kb":52540,"num_write":876,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.9","version":"160'417","reported_seq":5196,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.533663+0000","last_change":"2024-09-22T01:37:31.534403+0000","last_active":"2024-09-22T01:37:31.533663+0000","last_peered":"2024-09-22T01:37:31.533663+0000","last_clean":"2024-09-22T01:37:31.533663+0000","last_became_active":"2024-09-22T01:36:12.658535+0000","last_became_peered":"2024-09-22T01:36:12.658535+0000","last_unstale":"2024-09-22T01:37:31.533663+0000","last_undegraded":"2024-09-22T01:37:31.533663+0000","last_fullsized":"2024-09-22T01:37:31.533663+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:35:55.844729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001274818,"stat_sum":{"num_bytes":23476396,"num_objects":31,"num_object_clones":11,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":11,"num_read":4356,"num_read_kb":53912,"num_write":440,"num_write_kb":17684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2982858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.a","version":"159'494","reported_seq":13715,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.549698+0000","last_change":"2024-09-22T01:37:31.549990+0000","last_active":"2024-09-22T01:37:31.549698+0000","last_peered":"2024-09-22T01:37:31.549698+0000","last_clean":"2024-09-22T01:37:31.549698+0000","last_became_active":"2024-09-22T01:34:48.551682+0000","last_became_peered":"2024-09-22T01:34:48.551682+0000","last_unstale":"2024-09-22T01:37:31.549698+0000","last_undegraded":"2024-09-22T01:37:31.549698+0000","last_fullsized":"2024-09-22T01:37:31.549698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:43.199038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022401949999999999,"stat_sum":{"num_bytes":83418140,"num_objects":42,"num_object_clones":13,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":13,"num_read":14855,"num_read_kb":19967,"num_write":500,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.b","version":"161'388","reported_seq":2953,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.550058+0000","last_change":"2024-09-22T01:37:31.551125+0000","last_active":"2024-09-22T01:37:31.550058+0000","last_peered":"2024-09-22T01:37:31.550058+0000","last_clean":"2024-09-22T01:37:31.550058+0000","last_became_active":"2024-09-22T01:36:49.518943+0000","last_became_peered":"2024-09-22T01:36:49.518943+0000","last_unstale":"2024-09-22T01:37:31.550058+0000","last_undegraded":"2024-09-22T01:37:31.550058+0000","last_fullsized":"2024-09-22T01:37:31.550058+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:33:18.933592+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011073039999999999,"stat_sum":{"num_bytes":18730206,"num_objects":27,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":11,"num_read":2591,"num_read_kb":14151,"num_write":462,"num_write_kb":9040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":11703594,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.c","version":"161'499","reported_seq":5652,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.558287+0000","last_change":"2024-09-22T01:37:31.558994+0000","last_active":"2024-09-22T01:37:31.558287+0000","last_peered":"2024-09-22T01:37:31.558287+0000","last_clean":"2024-09-22T01:37:31.558287+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:37:31.558287+0000","last_undegraded":"2024-09-22T01:37:31.558287+0000","last_fullsized":"2024-09-22T01:37:31.558287+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:57:42.030376+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.011464518999999999,"stat_sum":{"num_bytes":65746947,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":14,"num_read":6751,"num_read_kb":34602,"num_write":485,"num_write_kb":16246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.d","version":"161'452","reported_seq":4652,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.550861+0000","last_change":"2024-09-22T01:37:31.551480+0000","last_active":"2024-09-22T01:37:31.550861+0000","last_peered":"2024-09-22T01:37:31.550861+0000","last_clean":"2024-09-22T01:37:31.550861+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:37:31.550861+0000","last_undegraded":"2024-09-22T01:37:31.550861+0000","last_fullsized":"2024-09-22T01:37:31.550861+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:17:31.475913+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.012676401,"stat_sum":{"num_bytes":19323540,"num_objects":29,"num_object_clones":10,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":9,"num_read":5392,"num_read_kb":19740,"num_write":519,"num_write_kb":16489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.e","version":"161'674","reported_seq":3914,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.542763+0000","last_change":"2024-09-22T01:37:31.543041+0000","last_active":"2024-09-22T01:37:31.542763+0000","last_peered":"2024-09-22T01:37:31.542763+0000","last_clean":"2024-09-22T01:37:31.542763+0000","last_became_active":"2024-09-22T01:36:00.566088+0000","last_became_peered":"2024-09-22T01:36:00.566088+0000","last_unstale":"2024-09-22T01:37:31.542763+0000","last_undegraded":"2024-09-22T01:37:31.542763+0000","last_fullsized":"2024-09-22T01:37:31.542763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:14:50.755679+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0051811649999999997,"stat_sum":{"num_bytes":12278447,"num_objects":38,"num_object_clones":13,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":17,"num_read":4543,"num_read_kb":18605,"num_write":871,"num_write_kb":13177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":4264442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.f","version":"161'684","reported_seq":3398,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.541654+0000","last_change":"2024-09-22T01:37:31.541957+0000","last_active":"2024-09-22T01:37:31.541654+0000","last_peered":"2024-09-22T01:37:31.541654+0000","last_clean":"2024-09-22T01:37:31.541654+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:37:31.541654+0000","last_undegraded":"2024-09-22T01:37:31.541654+0000","last_fullsized":"2024-09-22T01:37:31.541654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:03:46.445089+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0041183590000000003,"stat_sum":{"num_bytes":57063542,"num_objects":25,"num_object_clones":6,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":5,"num_read":5510,"num_read_kb":24684,"num_write":858,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.10","version":"160'601","reported_seq":2375,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.547677+0000","last_change":"2024-09-22T01:37:31.548077+0000","last_active":"2024-09-22T01:37:31.547677+0000","last_peered":"2024-09-22T01:37:31.547677+0000","last_clean":"2024-09-22T01:37:31.547677+0000","last_became_active":"2024-09-22T01:36:06.619734+0000","last_became_peered":"2024-09-22T01:36:06.619734+0000","last_unstale":"2024-09-22T01:37:31.547677+0000","last_undegraded":"2024-09-22T01:37:31.547677+0000","last_fullsized":"2024-09-22T01:37:31.547677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:16:32.639749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092311900000000002,"stat_sum":{"num_bytes":24518964,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":12,"num_read":3865,"num_read_kb":13996,"num_write":718,"num_write_kb":16243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":4400829,"num_keys_recovered":58,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.11","version":"158'345","reported_seq":5582,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.542111+0000","last_change":"2024-09-22T01:37:31.542750+0000","last_active":"2024-09-22T01:37:31.542111+0000","last_peered":"2024-09-22T01:37:31.542111+0000","last_clean":"2024-09-22T01:37:31.542111+0000","last_became_active":"2024-09-22T01:36:01.562260+0000","last_became_peered":"2024-09-22T01:36:01.562260+0000","last_unstale":"2024-09-22T01:37:31.542111+0000","last_undegraded":"2024-09-22T01:37:31.542111+0000","last_fullsized":"2024-09-22T01:37:31.542111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:30.680931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049216190000000003,"stat_sum":{"num_bytes":37899491,"num_objects":46,"num_object_clones":16,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":16,"num_read":4797,"num_read_kb":46848,"num_write":319,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.12","version":"154'448","reported_seq":4578,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.534664+0000","last_change":"2024-09-22T01:37:31.536104+0000","last_active":"2024-09-22T01:37:31.534664+0000","last_peered":"2024-09-22T01:37:31.534664+0000","last_clean":"2024-09-22T01:37:31.534664+0000","last_became_active":"2024-09-22T01:36:07.626370+0000","last_became_peered":"2024-09-22T01:36:07.626370+0000","last_unstale":"2024-09-22T01:37:31.534664+0000","last_undegraded":"2024-09-22T01:37:31.534664+0000","last_fullsized":"2024-09-22T01:37:31.534664+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:33:43.911539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023931180000000001,"stat_sum":{"num_bytes":14904901,"num_objects":21,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":9,"num_read":4779,"num_read_kb":18742,"num_write":512,"num_write_kb":10270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":5846025,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"6"}]},{"pgid":"3.13","version":"161'610","reported_seq":10767,"reported_epoch":161,"state":"active+clean","last_fresh":"2024-09-22T01:37:31.555315+0000","last_change":"2024-09-22T01:37:31.556247+0000","last_active":"2024-09-22T01:37:31.555315+0000","last_peered":"2024-09-22T01:37:31.555315+0000","last_clean":"2024-09-22T01:37:31.555315+0000","last_became_active":"2024-09-22T01:36:01.565891+0000","last_became_peered":"2024-09-22T01:36:01.565891+0000","last_unstale":"2024-09-22T01:37:31.555315+0000","last_undegraded":"2024-09-22T01:37:31.555315+0000","last_fullsized":"2024-09-22T01:37:31.555315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:12:10.615990+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.014902509,"stat_sum":{"num_bytes":17734322,"num_objects":30,"num_object_clones":9,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":8,"num_read":12247,"num_read_kb":47208,"num_write":543,"num_write_kb":13751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":5871820,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1a","length":"6"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":989263791,"num_objects":1087,"num_object_clones":344,"num_object_copies":2174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1087,"num_whiteouts":384,"num_read":193140,"num_read_kb":1031466,"num_write":20215,"num_write_kb":541232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4151,"num_bytes_recovered":349675162,"num_keys_recovered":856,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":230531072,"data_stored":324898740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17123,"ondisk_log_size":17123,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89560,"kb_used_data":36164,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94282280,"statfs":{"total":96636764160,"available":96545054720,"internally_reserved":0,"allocated":37031936,"data_stored":48504961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56220,"kb_used_data":12540,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94315620,"statfs":{"total":96636764160,"available":96579194880,"internally_reserved":0,"allocated":12840960,"data_stored":15354740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80856,"kb_used_data":27124,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94290984,"statfs":{"total":96636764160,"available":96553967616,"internally_reserved":0,"allocated":27774976,"data_stored":39708696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117524,"kb_used_data":41916,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94254316,"statfs":{"total":96636764160,"available":96516419584,"internally_reserved":0,"allocated":42921984,"data_stored":59559138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93176,"kb_used_data":35620,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94278664,"statfs":{"total":96636764160,"available":96541351936,"internally_reserved":0,"allocated":36474880,"data_stored":48567531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38060,"kb_used_data":11032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333780,"statfs":{"total":96636764160,"available":96597790720,"internally_reserved":0,"allocated":11296768,"data_stored":13290392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78580,"kb_used_data":42856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94293260,"statfs":{"total":96636764160,"available":96556298240,"internally_reserved":0,"allocated":43884544,"data_stored":57961375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93756,"kb_used_data":36188,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94278084,"statfs":{"total":96636764160,"available":96540758016,"internally_reserved":0,"allocated":37056512,"data_stored":53089137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34394112,"data_stored":51367717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41943040,"data_stored":57029357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9359360,"data_stored":12358393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33845248,"data_stored":46839608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40984576,"data_stored":58627139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25206784,"data_stored":38045624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10915840,"data_stored":14429055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":33882112,"data_stored":46201847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:37:37.215 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:37:37.215 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:37.209+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:37.310 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:37.304+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:37.390 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:37.390 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:37.390 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:37.390 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:37.405 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:37.448 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:37.444+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:37.513 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:37.509+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:37.561 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:37.561 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:37:37.565 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:37.565 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:37.565 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:37.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:37.583 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-22T01:37:37.425546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":812565112,"num_objects":980,"num_object_clones":301,"num_object_copies":1960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":980,"num_whiteouts":344,"num_read":194035,"num_read_kb":1032233,"num_write":20510,"num_write_kb":543686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4266,"num_bytes_recovered":353725705,"num_keys_recovered":868,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17480,"ondisk_log_size":17480,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":625396,"kb_used_data":221784,"kb_used_omap":12,"kb_used_meta":403379,"kb_avail":754349324,"statfs":{"total":773094113280,"available":772453707776,"internally_reserved":0,"allocated":227106816,"data_stored":309520062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":413060656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-177289066,"num_objects":-111,"num_object_clones":-43,"num_object_copies":-222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-111,"num_whiteouts":-40,"num_read":779,"num_read_kb":667,"num_write":134,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":2869769,"num_keys_recovered":12,"num_objects_omap":-3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000955"},"pg_stats":[{"pgid":"3.1f","version":"163'701","reported_seq":5909,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.823350+0000","last_change":"2024-09-22T01:37:36.823687+0000","last_active":"2024-09-22T01:37:36.823350+0000","last_peered":"2024-09-22T01:37:36.823350+0000","last_clean":"2024-09-22T01:37:36.823350+0000","last_became_active":"2024-09-22T01:37:19.529628+0000","last_became_peered":"2024-09-22T01:37:19.529628+0000","last_unstale":"2024-09-22T01:37:36.823350+0000","last_undegraded":"2024-09-22T01:37:36.823350+0000","last_fullsized":"2024-09-22T01:37:36.823350+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:50.298513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026927969999999998,"stat_sum":{"num_bytes":6929476,"num_objects":23,"num_object_clones":9,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":8,"num_read":6869,"num_read_kb":35443,"num_write":902,"num_write_kb":14992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":259,"num_bytes_recovered":23514092,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.1e","version":"165'518","reported_seq":4430,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.820620+0000","last_change":"2024-09-22T01:37:36.820945+0000","last_active":"2024-09-22T01:37:36.820620+0000","last_peered":"2024-09-22T01:37:36.820620+0000","last_clean":"2024-09-22T01:37:36.820620+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:37:36.820620+0000","last_undegraded":"2024-09-22T01:37:36.820620+0000","last_fullsized":"2024-09-22T01:37:36.820620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:15:17.167936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039107860000000003,"stat_sum":{"num_bytes":38359607,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":5,"num_read":5827,"num_read_kb":47549,"num_write":554,"num_write_kb":23734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.1d","version":"166'991","reported_seq":3302,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.849313+0000","last_change":"2024-09-22T01:37:36.849951+0000","last_active":"2024-09-22T01:37:36.849313+0000","last_peered":"2024-09-22T01:37:36.849313+0000","last_clean":"2024-09-22T01:37:36.849313+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:37:36.849313+0000","last_undegraded":"2024-09-22T01:37:36.849313+0000","last_fullsized":"2024-09-22T01:37:36.849313+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:33:38.687949+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.012908279999999999,"stat_sum":{"num_bytes":32907766,"num_objects":24,"num_object_clones":8,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":9,"num_read":5513,"num_read_kb":33890,"num_write":1511,"num_write_kb":16569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.1c","version":"166'267","reported_seq":2717,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.851439+0000","last_change":"2024-09-22T01:37:36.844674+0000","last_active":"2024-09-22T01:37:36.851439+0000","last_peered":"2024-09-22T01:37:36.851439+0000","last_clean":"2024-09-22T01:37:36.851439+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:37:36.851439+0000","last_undegraded":"2024-09-22T01:37:36.851439+0000","last_fullsized":"2024-09-22T01:37:36.851439+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:58:23.769149+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0095338200000000001,"stat_sum":{"num_bytes":8433579,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":4,"num_read":2068,"num_read_kb":34918,"num_write":278,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.1b","version":"166'1093","reported_seq":4998,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.837329+0000","last_change":"2024-09-22T01:37:36.837613+0000","last_active":"2024-09-22T01:37:36.837329+0000","last_peered":"2024-09-22T01:37:36.837329+0000","last_clean":"2024-09-22T01:37:36.837329+0000","last_became_active":"2024-09-22T01:36:07.623588+0000","last_became_peered":"2024-09-22T01:36:07.623588+0000","last_unstale":"2024-09-22T01:37:36.837329+0000","last_undegraded":"2024-09-22T01:37:36.837329+0000","last_fullsized":"2024-09-22T01:37:36.837329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1093,"log_dups_size":0,"ondisk_log_size":1093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:14:12.638672+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.015975001999999999,"stat_sum":{"num_bytes":19205671,"num_objects":29,"num_object_clones":7,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":12,"num_read":9518,"num_read_kb":24215,"num_write":1581,"num_write_kb":13728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":13691067,"num_keys_recovered":116,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.1a","version":"165'425","reported_seq":4863,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.854556+0000","last_change":"2024-09-22T01:37:36.835366+0000","last_active":"2024-09-22T01:37:36.854556+0000","last_peered":"2024-09-22T01:37:36.854556+0000","last_clean":"2024-09-22T01:37:36.854556+0000","last_became_active":"2024-09-22T01:34:48.539769+0000","last_became_peered":"2024-09-22T01:34:48.539769+0000","last_unstale":"2024-09-22T01:37:36.854556+0000","last_undegraded":"2024-09-22T01:37:36.854556+0000","last_fullsized":"2024-09-22T01:37:36.854556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:55:05.766758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084643349999999999,"stat_sum":{"num_bytes":36353761,"num_objects":52,"num_object_clones":17,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":14,"num_read":4681,"num_read_kb":40022,"num_write":458,"num_write_kb":25278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.19","version":"165'789","reported_seq":9381,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.824134+0000","last_change":"2024-09-22T01:37:36.824550+0000","last_active":"2024-09-22T01:37:36.824134+0000","last_peered":"2024-09-22T01:37:36.824134+0000","last_clean":"2024-09-22T01:37:36.824134+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:37:36.824134+0000","last_undegraded":"2024-09-22T01:37:36.824134+0000","last_fullsized":"2024-09-22T01:37:36.824134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:33:25.466268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063915399999999996,"stat_sum":{"num_bytes":66464861,"num_objects":45,"num_object_clones":16,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":10543,"num_read_kb":63629,"num_write":1093,"num_write_kb":22699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.18","version":"164'928","reported_seq":3128,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.819268+0000","last_change":"2024-09-22T01:37:36.819666+0000","last_active":"2024-09-22T01:37:36.819268+0000","last_peered":"2024-09-22T01:37:36.819268+0000","last_clean":"2024-09-22T01:37:36.819268+0000","last_became_active":"2024-09-22T01:36:03.522736+0000","last_became_peered":"2024-09-22T01:36:03.522736+0000","last_unstale":"2024-09-22T01:37:36.819268+0000","last_undegraded":"2024-09-22T01:37:36.819268+0000","last_fullsized":"2024-09-22T01:37:36.819268+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:40.159300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030676309999999999,"stat_sum":{"num_bytes":21368553,"num_objects":19,"num_object_clones":6,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":7,"num_read":5440,"num_read_kb":18150,"num_write":1479,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1215906,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.17","version":"158'451","reported_seq":5915,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.822700+0000","last_change":"2024-09-22T01:37:36.823190+0000","last_active":"2024-09-22T01:37:36.822700+0000","last_peered":"2024-09-22T01:37:36.822700+0000","last_clean":"2024-09-22T01:37:36.822700+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:37:36.822700+0000","last_undegraded":"2024-09-22T01:37:36.822700+0000","last_fullsized":"2024-09-22T01:37:36.822700+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:23.253726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002438277,"stat_sum":{"num_bytes":12989949,"num_objects":44,"num_object_clones":14,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":16,"num_read":5777,"num_read_kb":32124,"num_write":468,"num_write_kb":34048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.16","version":"166'642","reported_seq":14693,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.844562+0000","last_change":"2024-09-22T01:37:36.845561+0000","last_active":"2024-09-22T01:37:36.844562+0000","last_peered":"2024-09-22T01:37:36.844562+0000","last_clean":"2024-09-22T01:37:36.844562+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:37:36.844562+0000","last_undegraded":"2024-09-22T01:37:36.844562+0000","last_fullsized":"2024-09-22T01:37:36.844562+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:06:41.524590+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0085993289999999993,"stat_sum":{"num_bytes":50494788,"num_objects":44,"num_object_clones":16,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":14,"num_read":14743,"num_read_kb":34372,"num_write":670,"num_write_kb":12432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.15","version":"164'273","reported_seq":4945,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.837978+0000","last_change":"2024-09-22T01:37:36.839253+0000","last_active":"2024-09-22T01:37:36.837978+0000","last_peered":"2024-09-22T01:37:36.837978+0000","last_clean":"2024-09-22T01:37:36.837978+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:37:36.837978+0000","last_undegraded":"2024-09-22T01:37:36.837978+0000","last_fullsized":"2024-09-22T01:37:36.837978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:17:17.916355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060470489999999997,"stat_sum":{"num_bytes":8839162,"num_objects":26,"num_object_clones":10,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":11,"num_read":4129,"num_read_kb":34295,"num_write":242,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.14","version":"166'364","reported_seq":6087,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.833334+0000","last_change":"2024-09-22T01:37:36.834236+0000","last_active":"2024-09-22T01:37:36.833334+0000","last_peered":"2024-09-22T01:37:36.833334+0000","last_clean":"2024-09-22T01:37:36.833334+0000","last_became_active":"2024-09-22T01:36:00.564509+0000","last_became_peered":"2024-09-22T01:36:00.564509+0000","last_unstale":"2024-09-22T01:37:36.833334+0000","last_undegraded":"2024-09-22T01:37:36.833334+0000","last_fullsized":"2024-09-22T01:37:36.833334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:31:27.872245+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0080134820000000006,"stat_sum":{"num_bytes":9330606,"num_objects":30,"num_object_clones":8,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":8,"num_read":6086,"num_read_kb":53973,"num_write":330,"num_write_kb":20591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":5198452,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"2.7","version":"0'0","reported_seq":322,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.819964+0000","last_change":"2024-09-22T01:35:57.529367+0000","last_active":"2024-09-22T01:37:36.819964+0000","last_peered":"2024-09-22T01:37:36.819964+0000","last_clean":"2024-09-22T01:37:36.819964+0000","last_became_active":"2024-09-22T01:35:57.528484+0000","last_became_peered":"2024-09-22T01:35:57.528484+0000","last_unstale":"2024-09-22T01:37:36.819964+0000","last_undegraded":"2024-09-22T01:37:36.819964+0000","last_fullsized":"2024-09-22T01:37:36.819964+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:59:00.577837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"166'433","reported_seq":5604,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.825636+0000","last_change":"2024-09-22T01:37:36.826200+0000","last_active":"2024-09-22T01:37:36.825636+0000","last_peered":"2024-09-22T01:37:36.825636+0000","last_clean":"2024-09-22T01:37:36.825636+0000","last_became_active":"2024-09-22T01:36:06.618495+0000","last_became_peered":"2024-09-22T01:36:06.618495+0000","last_unstale":"2024-09-22T01:37:36.825636+0000","last_undegraded":"2024-09-22T01:37:36.825636+0000","last_fullsized":"2024-09-22T01:37:36.825636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:18:17.818932+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0056447930000000004,"stat_sum":{"num_bytes":39214762,"num_objects":41,"num_object_clones":14,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":18,"num_read":4986,"num_read_kb":38573,"num_write":384,"num_write_kb":38180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":25063433,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"2.6","version":"0'0","reported_seq":312,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.823993+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:37:36.823993+0000","last_peered":"2024-09-22T01:37:36.823993+0000","last_clean":"2024-09-22T01:37:36.823993+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:37:36.823993+0000","last_undegraded":"2024-09-22T01:37:36.823993+0000","last_fullsized":"2024-09-22T01:37:36.823993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'336","reported_seq":3360,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.821018+0000","last_change":"2024-09-22T01:37:36.821329+0000","last_active":"2024-09-22T01:37:36.821018+0000","last_peered":"2024-09-22T01:37:36.821018+0000","last_clean":"2024-09-22T01:37:36.821018+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:37:36.821018+0000","last_undegraded":"2024-09-22T01:37:36.821018+0000","last_fullsized":"2024-09-22T01:37:36.821018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:25:50.035245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041662230000000001,"stat_sum":{"num_bytes":21114780,"num_objects":28,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":9,"num_read":3428,"num_read_kb":20696,"num_write":330,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"2.5","version":"0'0","reported_seq":197,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.832576+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:37:36.832576+0000","last_peered":"2024-09-22T01:37:36.832576+0000","last_clean":"2024-09-22T01:37:36.832576+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:37:36.832576+0000","last_undegraded":"2024-09-22T01:37:36.832576+0000","last_fullsized":"2024-09-22T01:37:36.832576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"158'571","reported_seq":3953,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.817494+0000","last_change":"2024-09-22T01:37:36.818018+0000","last_active":"2024-09-22T01:37:36.817494+0000","last_peered":"2024-09-22T01:37:36.817494+0000","last_clean":"2024-09-22T01:37:36.817494+0000","last_became_active":"2024-09-22T01:36:12.660207+0000","last_became_peered":"2024-09-22T01:36:12.660207+0000","last_unstale":"2024-09-22T01:37:36.817494+0000","last_undegraded":"2024-09-22T01:37:36.817494+0000","last_fullsized":"2024-09-22T01:37:36.817494+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:20.031370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023610430000000002,"stat_sum":{"num_bytes":42791032,"num_objects":30,"num_object_clones":8,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":5385,"num_read_kb":37626,"num_write":596,"num_write_kb":11226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"2.4","version":"0'0","reported_seq":180,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.820373+0000","last_change":"2024-09-22T01:36:03.520390+0000","last_active":"2024-09-22T01:37:36.820373+0000","last_peered":"2024-09-22T01:37:36.820373+0000","last_clean":"2024-09-22T01:37:36.820373+0000","last_became_active":"2024-09-22T01:36:03.519493+0000","last_became_peered":"2024-09-22T01:36:03.519493+0000","last_unstale":"2024-09-22T01:37:36.820373+0000","last_undegraded":"2024-09-22T01:37:36.820373+0000","last_fullsized":"2024-09-22T01:37:36.820373+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:25:49.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"164'477","reported_seq":7963,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.845708+0000","last_change":"2024-09-22T01:37:36.847066+0000","last_active":"2024-09-22T01:37:36.845708+0000","last_peered":"2024-09-22T01:37:36.845708+0000","last_clean":"2024-09-22T01:37:36.845708+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:37:36.845708+0000","last_undegraded":"2024-09-22T01:37:36.845708+0000","last_fullsized":"2024-09-22T01:37:36.845708+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:06:12.522965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0099529500000000003,"stat_sum":{"num_bytes":32845394,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":10,"num_read":8439,"num_read_kb":54192,"num_write":500,"num_write_kb":18740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.3","version":"165'307","reported_seq":1405,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.829966+0000","last_change":"2024-09-22T01:37:36.830710+0000","last_active":"2024-09-22T01:37:36.829966+0000","last_peered":"2024-09-22T01:37:36.829966+0000","last_clean":"2024-09-22T01:37:36.829966+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:37:36.829966+0000","last_undegraded":"2024-09-22T01:37:36.829966+0000","last_fullsized":"2024-09-22T01:37:36.829966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:06:35.913829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010507079000000001,"stat_sum":{"num_bytes":4244156,"num_objects":34,"num_object_clones":10,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":14,"num_read":1355,"num_read_kb":6310,"num_write":296,"num_write_kb":3514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"2.2","version":"20'2","reported_seq":60,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.836259+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:37:36.836259+0000","last_peered":"2024-09-22T01:37:36.836259+0000","last_clean":"2024-09-22T01:37:36.836259+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:37:36.836259+0000","last_undegraded":"2024-09-22T01:37:36.836259+0000","last_fullsized":"2024-09-22T01:37:36.836259+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"164'483","reported_seq":3793,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.824195+0000","last_change":"2024-09-22T01:37:36.824536+0000","last_active":"2024-09-22T01:37:36.824195+0000","last_peered":"2024-09-22T01:37:36.824195+0000","last_clean":"2024-09-22T01:37:36.824195+0000","last_became_active":"2024-09-22T01:36:39.852969+0000","last_became_peered":"2024-09-22T01:36:39.852969+0000","last_unstale":"2024-09-22T01:37:36.824195+0000","last_undegraded":"2024-09-22T01:37:36.824195+0000","last_fullsized":"2024-09-22T01:37:36.824195+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:33:51.851414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056535199999999998,"stat_sum":{"num_bytes":6123924,"num_objects":27,"num_object_clones":9,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":12,"num_read":4307,"num_read_kb":14841,"num_write":505,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.815731+0000","last_change":"2024-09-22T01:36:09.627096+0000","last_active":"2024-09-22T01:37:36.815731+0000","last_peered":"2024-09-22T01:37:36.815731+0000","last_clean":"2024-09-22T01:37:36.815731+0000","last_became_active":"2024-09-22T01:36:09.626669+0000","last_became_peered":"2024-09-22T01:36:09.626669+0000","last_unstale":"2024-09-22T01:37:36.815731+0000","last_undegraded":"2024-09-22T01:37:36.815731+0000","last_fullsized":"2024-09-22T01:37:36.815731+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:35.787005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"166'505","reported_seq":4566,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.861095+0000","last_change":"2024-09-22T01:37:36.822632+0000","last_active":"2024-09-22T01:37:36.861095+0000","last_peered":"2024-09-22T01:37:36.861095+0000","last_clean":"2024-09-22T01:37:36.861095+0000","last_became_active":"2024-09-22T01:37:35.805157+0000","last_became_peered":"2024-09-22T01:37:35.805157+0000","last_unstale":"2024-09-22T01:37:36.861095+0000","last_undegraded":"2024-09-22T01:37:36.861095+0000","last_fullsized":"2024-09-22T01:37:36.861095+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:36:46.036053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022203309999999999,"stat_sum":{"num_bytes":21536741,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":15,"num_read":4956,"num_read_kb":25893,"num_write":549,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":16861620,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"2.0","version":"0'0","reported_seq":192,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.832308+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:37:36.832308+0000","last_peered":"2024-09-22T01:37:36.832308+0000","last_clean":"2024-09-22T01:37:36.832308+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:37:36.832308+0000","last_undegraded":"2024-09-22T01:37:36.832308+0000","last_fullsized":"2024-09-22T01:37:36.832308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"165'439","reported_seq":2545,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.819768+0000","last_change":"2024-09-22T01:37:36.820377+0000","last_active":"2024-09-22T01:37:36.819768+0000","last_peered":"2024-09-22T01:37:36.819768+0000","last_clean":"2024-09-22T01:37:36.819768+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:37:36.819768+0000","last_undegraded":"2024-09-22T01:37:36.819768+0000","last_fullsized":"2024-09-22T01:37:36.819768+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:17:35.946827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037597899999999998,"stat_sum":{"num_bytes":15436609,"num_objects":27,"num_object_clones":8,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":12,"num_read":2666,"num_read_kb":16188,"num_write":480,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"2.3","version":"18'1","reported_seq":60,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.835036+0000","last_change":"2024-09-22T01:37:13.533524+0000","last_active":"2024-09-22T01:37:36.835036+0000","last_peered":"2024-09-22T01:37:36.835036+0000","last_clean":"2024-09-22T01:37:36.835036+0000","last_became_active":"2024-09-22T01:37:13.529493+0000","last_became_peered":"2024-09-22T01:37:13.529493+0000","last_unstale":"2024-09-22T01:37:36.835036+0000","last_undegraded":"2024-09-22T01:37:36.835036+0000","last_fullsized":"2024-09-22T01:37:36.835036+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:07.459369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":440,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.832402+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:37:36.832402+0000","last_peered":"2024-09-22T01:37:36.832402+0000","last_clean":"2024-09-22T01:37:36.832402+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:37:36.832402+0000","last_undegraded":"2024-09-22T01:37:36.832402+0000","last_fullsized":"2024-09-22T01:37:36.832402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"165'688","reported_seq":2518,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.816563+0000","last_change":"2024-09-22T01:37:36.817689+0000","last_active":"2024-09-22T01:37:36.816563+0000","last_peered":"2024-09-22T01:37:36.816563+0000","last_clean":"2024-09-22T01:37:36.816563+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:37:36.816563+0000","last_undegraded":"2024-09-22T01:37:36.816563+0000","last_fullsized":"2024-09-22T01:37:36.816563+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:12:07.961296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013332769999999999,"stat_sum":{"num_bytes":11824432,"num_objects":24,"num_object_clones":9,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":11,"num_read":7232,"num_read_kb":52540,"num_write":877,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.9","version":"166'422","reported_seq":5228,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.832211+0000","last_change":"2024-09-22T01:37:36.833729+0000","last_active":"2024-09-22T01:37:36.832211+0000","last_peered":"2024-09-22T01:37:36.832211+0000","last_clean":"2024-09-22T01:37:36.832211+0000","last_became_active":"2024-09-22T01:36:12.658535+0000","last_became_peered":"2024-09-22T01:36:12.658535+0000","last_unstale":"2024-09-22T01:37:36.832211+0000","last_undegraded":"2024-09-22T01:37:36.832211+0000","last_fullsized":"2024-09-22T01:37:36.832211+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:38:41.736302+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0074965839999999997,"stat_sum":{"num_bytes":17380134,"num_objects":26,"num_object_clones":9,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":9,"num_read":4359,"num_read_kb":53913,"num_write":441,"num_write_kb":17684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2982858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.a","version":"166'523","reported_seq":13851,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.828972+0000","last_change":"2024-09-22T01:37:36.829704+0000","last_active":"2024-09-22T01:37:36.828972+0000","last_peered":"2024-09-22T01:37:36.828972+0000","last_clean":"2024-09-22T01:37:36.828972+0000","last_became_active":"2024-09-22T01:34:48.551682+0000","last_became_peered":"2024-09-22T01:34:48.551682+0000","last_unstale":"2024-09-22T01:37:36.828972+0000","last_undegraded":"2024-09-22T01:37:36.828972+0000","last_fullsized":"2024-09-22T01:37:36.828972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:35:56.968690+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0094915859999999998,"stat_sum":{"num_bytes":71518306,"num_objects":37,"num_object_clones":11,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":11,"num_read":15066,"num_read_kb":20149,"num_write":520,"num_write_kb":18751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.b","version":"166'402","reported_seq":2996,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.821099+0000","last_change":"2024-09-22T01:37:36.821411+0000","last_active":"2024-09-22T01:37:36.821099+0000","last_peered":"2024-09-22T01:37:36.821099+0000","last_clean":"2024-09-22T01:37:36.821099+0000","last_became_active":"2024-09-22T01:36:49.518943+0000","last_became_peered":"2024-09-22T01:36:49.518943+0000","last_unstale":"2024-09-22T01:37:36.821099+0000","last_undegraded":"2024-09-22T01:37:36.821099+0000","last_fullsized":"2024-09-22T01:37:36.821099+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:02:25.648510+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0050080009999999998,"stat_sum":{"num_bytes":4508336,"num_objects":24,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":10,"num_read":2622,"num_read_kb":14175,"num_write":475,"num_write_kb":9044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":11703594,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.c","version":"161'499","reported_seq":5677,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.837353+0000","last_change":"2024-09-22T01:37:36.839009+0000","last_active":"2024-09-22T01:37:36.837353+0000","last_peered":"2024-09-22T01:37:36.837353+0000","last_clean":"2024-09-22T01:37:36.837353+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:37:36.837353+0000","last_undegraded":"2024-09-22T01:37:36.837353+0000","last_fullsized":"2024-09-22T01:37:36.837353+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:10:44.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020954620000000002,"stat_sum":{"num_bytes":65746947,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":14,"num_read":6751,"num_read_kb":34602,"num_write":485,"num_write_kb":16246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.d","version":"164'454","reported_seq":4679,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.839406+0000","last_change":"2024-09-22T01:37:36.840549+0000","last_active":"2024-09-22T01:37:36.839406+0000","last_peered":"2024-09-22T01:37:36.839406+0000","last_clean":"2024-09-22T01:37:36.839406+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:37:36.839406+0000","last_undegraded":"2024-09-22T01:37:36.839406+0000","last_fullsized":"2024-09-22T01:37:36.839406+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:26:21.689638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069466900000000002,"stat_sum":{"num_bytes":18772911,"num_objects":27,"num_object_clones":9,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":8,"num_read":5392,"num_read_kb":19740,"num_write":519,"num_write_kb":16489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.e","version":"164'678","reported_seq":3944,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.840682+0000","last_change":"2024-09-22T01:37:36.841637+0000","last_active":"2024-09-22T01:37:36.840682+0000","last_peered":"2024-09-22T01:37:36.840682+0000","last_clean":"2024-09-22T01:37:36.840682+0000","last_became_active":"2024-09-22T01:36:00.566088+0000","last_became_peered":"2024-09-22T01:36:00.566088+0000","last_unstale":"2024-09-22T01:37:36.840682+0000","last_undegraded":"2024-09-22T01:37:36.840682+0000","last_fullsized":"2024-09-22T01:37:36.840682+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:51:32.221958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079796229999999999,"stat_sum":{"num_bytes":11688559,"num_objects":34,"num_object_clones":12,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":16,"num_read":4545,"num_read_kb":18606,"num_write":873,"num_write_kb":13177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":4264442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.f","version":"163'686","reported_seq":3425,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.841795+0000","last_change":"2024-09-22T01:37:36.842654+0000","last_active":"2024-09-22T01:37:36.841795+0000","last_peered":"2024-09-22T01:37:36.841795+0000","last_clean":"2024-09-22T01:37:36.841795+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:37:36.841795+0000","last_undegraded":"2024-09-22T01:37:36.841795+0000","last_fullsized":"2024-09-22T01:37:36.841795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:35:52.844034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001666839,"stat_sum":{"num_bytes":56941052,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":5,"num_read":5510,"num_read_kb":24684,"num_write":860,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.10","version":"166'606","reported_seq":2416,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.833279+0000","last_change":"2024-09-22T01:37:36.834033+0000","last_active":"2024-09-22T01:37:36.833279+0000","last_peered":"2024-09-22T01:37:36.833279+0000","last_clean":"2024-09-22T01:37:36.833279+0000","last_became_active":"2024-09-22T01:36:06.619734+0000","last_became_peered":"2024-09-22T01:36:06.619734+0000","last_unstale":"2024-09-22T01:37:36.833279+0000","last_undegraded":"2024-09-22T01:37:36.833279+0000","last_fullsized":"2024-09-22T01:37:36.833279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:04.987906+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.013830112,"stat_sum":{"num_bytes":3547428,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":10,"num_read":3903,"num_read_kb":14027,"num_write":719,"num_write_kb":16243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":4400829,"num_keys_recovered":58,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.11","version":"166'349","reported_seq":5611,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.846143+0000","last_change":"2024-09-22T01:37:36.846789+0000","last_active":"2024-09-22T01:37:36.846143+0000","last_peered":"2024-09-22T01:37:36.846143+0000","last_clean":"2024-09-22T01:37:36.846143+0000","last_became_active":"2024-09-22T01:36:01.562260+0000","last_became_peered":"2024-09-22T01:36:01.562260+0000","last_unstale":"2024-09-22T01:37:36.846143+0000","last_undegraded":"2024-09-22T01:37:36.846143+0000","last_fullsized":"2024-09-22T01:37:36.846143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:14:17.910393+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.013992753,"stat_sum":{"num_bytes":25840867,"num_objects":42,"num_object_clones":14,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":14,"num_read":4797,"num_read_kb":46848,"num_write":319,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.12","version":"165'450","reported_seq":4605,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.820384+0000","last_change":"2024-09-22T01:37:36.821013+0000","last_active":"2024-09-22T01:37:36.820384+0000","last_peered":"2024-09-22T01:37:36.820384+0000","last_clean":"2024-09-22T01:37:36.820384+0000","last_became_active":"2024-09-22T01:36:07.626370+0000","last_became_peered":"2024-09-22T01:36:07.626370+0000","last_unstale":"2024-09-22T01:37:36.820384+0000","last_undegraded":"2024-09-22T01:37:36.820384+0000","last_fullsized":"2024-09-22T01:37:36.820384+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:24:08.846830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080090200000000004,"stat_sum":{"num_bytes":11486254,"num_objects":19,"num_object_clones":6,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":8,"num_read":4779,"num_read_kb":18742,"num_write":512,"num_write_kb":10270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":5846025,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"17","length":"9"}]},{"pgid":"3.13","version":"161'610","reported_seq":10792,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-22T01:37:36.833586+0000","last_change":"2024-09-22T01:37:36.835069+0000","last_active":"2024-09-22T01:37:36.833586+0000","last_peered":"2024-09-22T01:37:36.833586+0000","last_clean":"2024-09-22T01:37:36.833586+0000","last_became_active":"2024-09-22T01:36:01.565891+0000","last_became_peered":"2024-09-22T01:36:01.565891+0000","last_unstale":"2024-09-22T01:37:36.833586+0000","last_undegraded":"2024-09-22T01:37:36.833586+0000","last_fullsized":"2024-09-22T01:37:36.833586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:08:53.930203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022907090000000001,"stat_sum":{"num_bytes":17734322,"num_objects":30,"num_object_clones":9,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":8,"num_read":12247,"num_read_kb":47208,"num_write":543,"num_write_kb":13751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":5871820,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"17","length":"9"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":811974725,"num_objects":976,"num_object_clones":301,"num_object_copies":1952,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":976,"num_whiteouts":344,"num_read":193919,"num_read_kb":1032133,"num_write":20349,"num_write_kb":541268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4255,"num_bytes_recovered":352544931,"num_keys_recovered":868,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196435968,"data_stored":287316678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17360,"ondisk_log_size":17360,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87404,"kb_used_data":34000,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94284436,"statfs":{"total":96636764160,"available":96547262464,"internally_reserved":0,"allocated":34816000,"data_stored":45739198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55536,"kb_used_data":11864,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94316304,"statfs":{"total":96636764160,"available":96579895296,"internally_reserved":0,"allocated":12148736,"data_stored":14657588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76520,"kb_used_data":23116,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94295320,"statfs":{"total":96636764160,"available":96558407680,"internally_reserved":0,"allocated":23670784,"data_stored":33906824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118300,"kb_used_data":42688,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94253540,"statfs":{"total":96636764160,"available":96515624960,"internally_reserved":0,"allocated":43712512,"data_stored":62247566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85612,"kb_used_data":28044,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94286228,"statfs":{"total":96636764160,"available":96549097472,"internally_reserved":0,"allocated":28717056,"data_stored":36867141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38084,"kb_used_data":11048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333756,"statfs":{"total":96636764160,"available":96597766144,"internally_reserved":0,"allocated":11313152,"data_stored":13296743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73360,"kb_used_data":38008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94298480,"statfs":{"total":96636764160,"available":96561643520,"internally_reserved":0,"allocated":38920192,"data_stored":53017869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90580,"kb_used_data":33016,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94281260,"statfs":{"total":96636764160,"available":96544010240,"internally_reserved":0,"allocated":33808384,"data_stored":49787133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27852800,"data_stored":44911986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36859904,"data_stored":52005521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7581696,"data_stored":10616452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25001984,"data_stored":34198842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":38043648,"data_stored":57654865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21553152,"data_stored":32835388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7512064,"data_stored":11084544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32030720,"data_stored":44009080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:37:37.585 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T01:37:37.585 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:37:37.585 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-22T01:37:37.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-09-22T01:37:37.613 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:37.609+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:37.713 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:37.708+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:37.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:37.746 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:37.746 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:37.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:37.746 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:37.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.746 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.746 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326721550000002, 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:37.750 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326691361000002, 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:37:37.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:37:37.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326662267000003, 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:37:37.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326632642000007, 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.758 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:37:37.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:37:37.761 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326582748999996, 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:37:37.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:37:37.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:37:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326551038999995, 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326521600000007, 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.770 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:37:37.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.774 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.775 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:37.775 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326492143999999, 2024-09-22T01:37:37.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:37:37.775 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.775 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.775 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.775 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.775 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.775 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.775 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:37:37.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.776 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:37.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326462121000006, 2024-09-22T01:37:37.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:37:37.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.783 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326416707999996, 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.786 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326387139000005, 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:37:37.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326357329000004, 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:37:37.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326328043000004, 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.796 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:37:37.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:37:37.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326294736999998, 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:37:37.800 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326264831000003, 2024-09-22T01:37:37.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:37:37.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:37:37.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326235048000001, 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.809 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:37:37.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326171231999993, 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326136296000001, 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326106555999999, 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:37.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:37:37.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:37:37.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.824 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.326076430000001, 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:37.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:37.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:37.828 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:37.829 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:37.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:37.831 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:37.829+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:37.833 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:37:37.931 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:37.929+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:37.941 INFO:teuthology.orchestra.run.smithi018.stdout:moved 0 / 82 (0%) 2024-09-22T01:37:37.941 INFO:teuthology.orchestra.run.smithi018.stdout:avg 10.25 2024-09-22T01:37:37.941 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 2.68095 -> 2.68095 (expected baseline 2.99479) 2024-09-22T01:37:37.941 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 6 -> 6 pgs (0.585366 -> 0.585366 * mean) 2024-09-22T01:37:37.941 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-22T01:37:37.941 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:37.941 INFO:teuthology.orchestra.run.smithi018.stdout:oload 1000 2024-09-22T01:37:37.941 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 0.05 2024-09-22T01:37:37.941 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-22T01:37:37.942 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0008 2024-09-22T01:37:37.942 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0083 2024-09-22T01:37:37.942 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-09-22T01:37:37.967 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-22T01:37:37.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-22T01:37:37.980 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:37.980 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:38.001 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:38.002 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:38.002 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:38.002 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:38.003 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:38.003 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:38.021 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:38.021 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:38.023 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:38.039 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:38.039 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:38.040 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:38.032+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:38.076 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:38.076 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:38.112 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:38.132 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:38.128+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:38.135 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:38.155 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:38.155 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:38.156 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:38.156 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:38.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:38.234 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:38.233+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:38.323 INFO:teuthology.orchestra.run.smithi018.stdout:moved 0 / 82 (0%) 2024-09-22T01:37:38.323 INFO:teuthology.orchestra.run.smithi018.stdout:avg 10.25 2024-09-22T01:37:38.323 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 2.68095 -> 2.68095 (expected baseline 2.99479) 2024-09-22T01:37:38.324 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 6 -> 6 pgs (0.585366 -> 0.585366 * mean) 2024-09-22T01:37:38.324 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-22T01:37:38.324 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:38.324 INFO:teuthology.orchestra.run.smithi018.stdout:oload 1000 2024-09-22T01:37:38.324 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 3 2024-09-22T01:37:38.324 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-22T01:37:38.324 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0008 2024-09-22T01:37:38.324 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0083 2024-09-22T01:37:38.324 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-09-22T01:37:38.330 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:38.330 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:38.335 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:38.333+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:38.342 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-22T01:37:38.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-22T01:37:38.345 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:38.435 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:38.428+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:38.479 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:38.479 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:38.493 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:38.525 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:37:38.536 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:38.532+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:38.631 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:38.631 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:38.636 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:38.632+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:38.647 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:38.737 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:38.732+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:38.776 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:38.776 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:38.790 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:38.839 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:38.832+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:38.912 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:38.912 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:38.926 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:38.970 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:38.969+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:39.041 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:39.037+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:39.042 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:39.042 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:39.057 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:39.142 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:39.136+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:39.220 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:39.221 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:39.235 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:39.243 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:39.240+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:39.344 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:39.340+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:39.358 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:39.358 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:39.372 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:39.444 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:39.441+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:39.493 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:39.493 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:39.507 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:39.549 INFO:teuthology.orchestra.run.smithi018.stdout:moved 7 / 82 (8.53659%) 2024-09-22T01:37:39.549 INFO:teuthology.orchestra.run.smithi018.stdout:avg 10.25 2024-09-22T01:37:39.549 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 2.68095 -> 2.63391 (expected baseline 2.99479) 2024-09-22T01:37:39.549 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.2 with 6 -> 8 pgs (0.585366 -> 0.780488 * mean) 2024-09-22T01:37:39.549 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.7 with 14 -> 15 pgs (1.36585 -> 1.46341 * mean) 2024-09-22T01:37:39.550 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:39.550 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-09-22T01:37:39.550 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 3 2024-09-22T01:37:39.550 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-22T01:37:39.550 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0008 2024-09-22T01:37:39.550 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0009 2024-09-22T01:37:39.550 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 weight 1.0000 -> 0.6608 2024-09-22T01:37:39.550 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 weight 1.0000 -> 0.8630 2024-09-22T01:37:39.550 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 weight 1.0000 -> 0.8944 2024-09-22T01:37:39.551 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:39.549+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:39.578 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-22T01:37:39.578 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-22T01:37:39.672 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:39.668+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:39.680 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:39.680 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:39.695 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:39.748 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:39.745+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:39.815 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:39.815 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:39.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:39.850 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:39.844+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:39.951 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:39.949+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:39.996 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:39.996 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:40.010 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:40.054 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:40.053+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:40.152 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:40.149+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:40.180 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:40.180 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:40.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:40.193 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:40.272 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:40.268+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:40.334 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:40.334 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:40.350 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:40.350 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:40.352 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:40.352 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:40.354 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:40.348+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:40.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:40.369 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:40.369 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:40.387 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:40.388 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:40.408 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:40.408 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:40.429 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:40.430 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:40.450 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:40.451 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:40.455 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:40.453+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:40.473 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:40.474 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:40.486 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:40.486 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:40.486 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:40.487 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:40.487 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:40.501 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:40.546 INFO:teuthology.orchestra.run.smithi018.stdout:moved 7 / 82 (8.53659%) 2024-09-22T01:37:40.546 INFO:teuthology.orchestra.run.smithi018.stdout:avg 10.25 2024-09-22T01:37:40.546 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 2.63391 -> 2.98957 (expected baseline 2.99479) 2024-09-22T01:37:40.546 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.6 with 6 -> 7 pgs (0.585366 -> 0.682927 * mean) 2024-09-22T01:37:40.547 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.7 with 15 -> 14 pgs (1.46341 -> 1.36585 * mean) 2024-09-22T01:37:40.547 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:40.547 INFO:teuthology.orchestra.run.smithi018.stdout:oload 110 2024-09-22T01:37:40.547 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 3 2024-09-22T01:37:40.547 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-22T01:37:40.547 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0008 2024-09-22T01:37:40.547 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0009 2024-09-22T01:37:40.547 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4 weight 0.6608 -> 0.4367 2024-09-22T01:37:40.547 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0 weight 0.8630 -> 0.7448 2024-09-22T01:37:40.547 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7 weight 0.8944 -> 0.7999 2024-09-22T01:37:40.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:37:40.556 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:40.553+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:40.567 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-22T01:37:40.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-09-22T01:37:40.658 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:40.657+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:40.669 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:40.669 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:40.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138405 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 245760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.472640828999999, 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398091244, 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138405 2024-09-22T01:37:40.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:40.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0999999999999998e-07 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191651+0000", 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1529999999999997e-06 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191659+0000", 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7470000000000005e-06 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191665+0000", 2024-09-22T01:37:40.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2439999999999998e-06 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191817+0000", 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151414 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191827+0000", 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0305e-05 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537811+0000", 2024-09-22T01:37:40.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34598379000000001 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537817+0000", 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7359999999999998e-06 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589536+0000", 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517191669999999 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589611+0000", 2024-09-22T01:37:40.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5436000000000001e-05 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589734+0000", 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012264200000000001 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138406 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 266240~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.472546291999997, 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3985561479999999, 2024-09-22T01:37:40.675 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138406 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191738+0000", 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191741+0000", 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4479999999999999e-06 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191749+0000", 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6029999999999999e-06 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191755+0000", 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.139e-06 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191922+0000", 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000166589 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191931+0000", 2024-09-22T01:37:40.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.132e-06 2024-09-22T01:37:40.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537867+0000", 2024-09-22T01:37:40.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34593649399999998 2024-09-22T01:37:40.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537879+0000", 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-05 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589835+0000", 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519563439999999 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590007+0000", 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171182 2024-09-22T01:37:40.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590293+0000", 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00028668699999999999 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138407 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 286720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.472445280999999, 2024-09-22T01:37:40.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3989841119999999, 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138407 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191839+0000", 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191843+0000", 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7189999999999999e-06 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191854+0000", 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1728e-05 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191861+0000", 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3589999999999996e-06 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192030+0000", 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169789 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192040+0000", 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.251e-06 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537916+0000", 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34587605199999999 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537921+0000", 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0370000000000002e-06 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590343+0000", 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0524222999999999 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590511+0000", 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001683 2024-09-22T01:37:40.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590822+0000", 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00031091400000000003 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138408 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 307200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.472341735999997, 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399171419, 2024-09-22T01:37:40.687 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.688 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.688 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.688 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.688 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.688 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138408 2024-09-22T01:37:40.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.688 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2200000000000004e-07 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191946+0000", 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7309999999999999e-06 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191958+0000", 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1678000000000001e-05 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191974+0000", 2024-09-22T01:37:40.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6158e-05 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192127+0000", 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000153614 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192136+0000", 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7290000000000006e-06 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537946+0000", 2024-09-22T01:37:40.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345810267 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537954+0000", 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5320000000000001e-06 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590877+0000", 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529233330000001 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590965+0000", 2024-09-22T01:37:40.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8134999999999996e-05 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591113+0000", 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014762 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138409 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 327680~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.472232546999997, 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399404775, 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138409 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2799999999999996e-07 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192055+0000", 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8510000000000001e-06 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192065+0000", 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2739999999999996e-06 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192071+0000", 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4679999999999997e-06 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192214+0000", 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000142948 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192223+0000", 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8130000000000002e-06 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538006+0000", 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34578290299999997 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538028+0000", 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2002999999999999e-05 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591185+0000", 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053157688 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591278+0000", 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2434000000000003e-05 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591456+0000", 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000177765 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138410 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 348160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.472136413999998, 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399528573, 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138410 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192148+0000", 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9599999999999999e-07 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192151+0000", 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.63e-06 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192159+0000", 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6510000000000001e-06 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192165+0000", 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2349999999999996e-06 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192301+0000", 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136124 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192309+0000", 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2320000000000001e-06 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538066+0000", 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345756485 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538075+0000", 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309999999999992e-06 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591495+0000", 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053420759 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591559+0000", 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4108000000000004e-05 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591676+0000", 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116122 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138411 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 368640~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.472050095999997, 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3997209019999999, 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.704 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138411 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192234+0000", 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192237+0000", 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4850000000000001e-06 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192245+0000", 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9079999999999995e-06 2024-09-22T01:37:40.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192251+0000", 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8880000000000002e-06 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192388+0000", 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013639500000000001 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192413+0000", 2024-09-22T01:37:40.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5411000000000001e-05 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538143+0000", 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573035800000002 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538165+0000", 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1929e-05 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591711+0000", 2024-09-22T01:37:40.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0535457159999999 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591800+0000", 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8556999999999999e-05 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591954+0000", 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154628 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138412 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 389120~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.471963637000002, 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399867717, 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138412 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:37:40.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192324+0000", 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5219999999999999e-06 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192332+0000", 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.96e-06 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192338+0000", 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2140000000000001e-06 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192490+0000", 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015239 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192499+0000", 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8240000000000006e-06 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538235+0000", 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573599700000002 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538244+0000", 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9490000000000002e-06 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592004+0000", 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0537599369999999 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592070+0000", 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5321999999999996e-05 2024-09-22T01:37:40.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592187+0000", 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117973 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138413 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 409600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.471860155999998, 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4000562969999999, 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138413 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192424+0000", 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192427+0000", 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.506e-06 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192435+0000", 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8760000000000005e-06 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192441+0000", 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5049999999999998e-06 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192578+0000", 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013744699999999999 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192587+0000", 2024-09-22T01:37:40.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5380000000000002e-06 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538307+0000", 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345719954 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538320+0000", 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2976000000000001e-05 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592226+0000", 2024-09-22T01:37:40.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053906327 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592318+0000", 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2199000000000003e-05 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592480+0000", 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016129800000000001 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.720 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138414 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 430080~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.471773071999998, 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4002321010000001, 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138414 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:40.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192511+0000", 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7899999999999998e-07 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192515+0000", 2024-09-22T01:37:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8659999999999999e-06 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192523+0000", 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9480000000000008e-06 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192529+0000", 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.088e-06 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192670+0000", 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014069199999999999 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192678+0000", 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6880000000000005e-06 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538397+0000", 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34571886600000001 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538403+0000", 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.724 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592507+0000", 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0541037799999999 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592590+0000", 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3506999999999999e-05 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592742+0000", 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015220500000000001 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.725 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138415 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 450560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.471685960000002, 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4003886910000001, 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138415 2024-09-22T01:37:40.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192598+0000", 2024-09-22T01:37:40.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192602+0000", 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4079999999999998e-06 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192609+0000", 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9109999999999993e-06 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.728 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192616+0000", 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1879999999999999e-06 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192888+0000", 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000272475 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192898+0000", 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-06 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538424+0000", 2024-09-22T01:37:40.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34552665100000002 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538433+0000", 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2979999999999992e-06 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592785+0000", 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0543528529999999 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592863+0000", 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7534999999999995e-05 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592986+0000", 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123201 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138416 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 471040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.471594359999997, 2024-09-22T01:37:40.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4005776480000001, 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138416 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192690+0000", 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192693+0000", 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6669999999999998e-06 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192701+0000", 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1089999999999998e-06 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192708+0000", 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0569999999999998e-06 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193001+0000", 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000293288 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193010+0000", 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.346e-06 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538482+0000", 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34547171599999998 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538494+0000", 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1936999999999999e-05 2024-09-22T01:37:40.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593021+0000", 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.054527456 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593108+0000", 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6743000000000006e-05 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593267+0000", 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015870599999999999 2024-09-22T01:37:40.736 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138417 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 491520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.471373550000003, 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4006197579999999, 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.737 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138417 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.738 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192911+0000", 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4899999999999995e-07 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192920+0000", 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1679999999999993e-06 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192933+0000", 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3132000000000001e-05 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192940+0000", 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193107+0000", 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016665899999999999 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193117+0000", 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0009e-05 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538566+0000", 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34544893700000001 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538581+0000", 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5438e-05 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593293+0000", 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547119359999999 2024-09-22T01:37:40.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593375+0000", 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.195e-05 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593530+0000", 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015473 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138418 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 512000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.471262496999998, 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4007298539999999, 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138418 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193022+0000", 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5899999999999996e-07 2024-09-22T01:37:40.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193026+0000", 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649999999999999e-06 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193038+0000", 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2099000000000001e-05 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193044+0000", 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.567e-06 2024-09-22T01:37:40.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193248+0000", 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203978 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193257+0000", 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0070000000000003e-06 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538642+0000", 2024-09-22T01:37:40.746 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34538508099999998 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538657+0000", 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.452e-05 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593568+0000", 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0549109299999999 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593636+0000", 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7702999999999999e-05 2024-09-22T01:37:40.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593751+0000", 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115145 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138429 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 458752~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.471115079, 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.400882792, 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.748 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138429 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193169+0000", 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193172+0000", 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1319999999999998e-06 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193190+0000", 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8184000000000001e-05 2024-09-22T01:37:40.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193197+0000", 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3929999999999996e-06 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194935+0000", 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001738306 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194945+0000", 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8859999999999999e-06 2024-09-22T01:37:40.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538696+0000", 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34375087300000001 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538702+0000", 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3339999999999998e-06 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593785+0000", 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.055083478 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593882+0000", 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6512e-05 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594051+0000", 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169185 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138457 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.469425631999997, 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3994306999999999, 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138457 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6199999999999998e-07 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194867+0000", 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4980000000000006e-06 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194875+0000", 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3429999999999996e-06 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194881+0000", 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7690000000000002e-06 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195318+0000", 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043666400000000002 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195327+0000", 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538752+0000", 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34342517700000003 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538763+0000", 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1368e-05 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.757 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594096+0000", 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0553327100000001 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594164+0000", 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8319999999999996e-05 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594288+0000", 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000124067 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138468 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 704512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.469047975999999, 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3993414930000001, 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138468 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195236+0000", 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5099999999999999e-07 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195240+0000", 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9720000000000003e-06 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195249+0000", 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1859999999999998e-06 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195256+0000", 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7989999999999996e-06 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195467+0000", 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021063599999999999 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195477+0000", 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0468e-05 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538799+0000", 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34332192700000003 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538805+0000", 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594324+0000", 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0555192959999999 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594414+0000", 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0303000000000006e-05 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594577+0000", 2024-09-22T01:37:40.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016252500000000001 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138471 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 487424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.468647140999998, 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399163084, 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.764 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138471 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195637+0000", 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0500000000000004e-07 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195640+0000", 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1300000000000001e-06 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195648+0000", 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8790000000000003e-06 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195654+0000", 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2949999999999999e-06 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195704+0000", 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0281999999999997e-05 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195714+0000", 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5219999999999996e-06 2024-09-22T01:37:40.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538855+0000", 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34314121400000003 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538868+0000", 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2814e-05 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594614+0000", 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0557457189999999 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594680+0000", 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5955000000000001e-05 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594799+0000", 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119769 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138482 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 499712~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.468284566999998, 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399082626, 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138482 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.770 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:40.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000005e-07 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196004+0000", 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0609999999999997e-06 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196012+0000", 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9039999999999998e-06 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196019+0000", 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8090000000000004e-06 2024-09-22T01:37:40.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197752+0000", 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017325159999999999 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197770+0000", 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8615e-05 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538901+0000", 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34113091499999998 2024-09-22T01:37:40.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538907+0000", 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4140000000000002e-06 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594834+0000", 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559273490000001 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594922+0000", 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8182000000000004e-05 2024-09-22T01:37:40.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.595081+0000", 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015923599999999999 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138776 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 634880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 42.461387619, 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398108922, 2024-09-22T01:37:40.775 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138776 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8799999999999998e-07 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202898+0000", 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1229999999999998e-06 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202905+0000", 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9120000000000001e-06 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202910+0000", 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.169e-06 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202961+0000", 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0173000000000002e-05 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202969+0000", 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8980000000000002e-06 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539828+0000", 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.336858714 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539834+0000", 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4840000000000003e-06 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600811+0000", 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0609770540000001 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600885+0000", 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4010000000000005e-05 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.601005+0000", 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119997 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.780 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:40.781 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:40.781 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:40.782 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:40.783 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:40.776+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:40.883 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:40.881+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:40.911 INFO:teuthology.orchestra.run.smithi018.stdout:moved 0 / 82 (0%) 2024-09-22T01:37:40.911 INFO:teuthology.orchestra.run.smithi018.stdout:avg 10.25 2024-09-22T01:37:40.911 INFO:teuthology.orchestra.run.smithi018.stdout:stddev 2.98957 -> 2.98957 (expected baseline 2.99479) 2024-09-22T01:37:40.911 INFO:teuthology.orchestra.run.smithi018.stdout:min osd.4 with 6 -> 6 pgs (0.585366 -> 0.585366 * mean) 2024-09-22T01:37:40.911 INFO:teuthology.orchestra.run.smithi018.stdout:max osd.7 with 14 -> 14 pgs (1.36585 -> 1.36585 * mean) 2024-09-22T01:37:40.911 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:40.911 INFO:teuthology.orchestra.run.smithi018.stdout:oload 1000 2024-09-22T01:37:40.911 INFO:teuthology.orchestra.run.smithi018.stdout:max_change 1 2024-09-22T01:37:40.911 INFO:teuthology.orchestra.run.smithi018.stdout:max_change_osds 4 2024-09-22T01:37:40.911 INFO:teuthology.orchestra.run.smithi018.stdout:average_utilization 0.0008 2024-09-22T01:37:40.912 INFO:teuthology.orchestra.run.smithi018.stdout:overload_utilization 0.0083 2024-09-22T01:37:40.912 INFO:teuthology.orchestra.run.smithi018.stderr:no change 2024-09-22T01:37:40.942 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:40.943 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:40.943 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:40.943 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:40.956 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:41.000 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:40.996+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:41.085 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:41.081+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:41.118 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:41.119 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:41.119 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:41.119 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:41.119 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:41.133 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:41.186 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:41.185+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:41.254 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44979372899999, 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.257 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:37:41.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:37:41.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.449738553, 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.260 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.262 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:37:41.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.265 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44967344, 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.266 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:41.267 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.268 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.269 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:37:41.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44960769299999, 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.272 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.274 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.275 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.276 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44957022299999, 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.277 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.278 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.279 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:37:41.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:37:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44951960700001, 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:37:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.448334268, 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:37:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.448272441, 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:37:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:37:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44822364199999, 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44815008899999, 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:37:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:37:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:37:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:37:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.448079627, 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44800912400001, 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:37:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.447961892, 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44789901600001, 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:37:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:37:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44785834999999, 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:37:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44776348299999, 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:37:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.447722446, 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:37:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.447684955, 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.447644806, 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:37:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.360 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 132.44760201099999, 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:37:41.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:37:41.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:37:41.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:37:41.366 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.366 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.366 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.366 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.366 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.366 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:41.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:41.368 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:41.360+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:41.468 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:41.464+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:41.543 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:37:41.543 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:41.544 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:41.544 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:41.544 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:41.568 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:41.565+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:41.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:41.680 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:41.676+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:41.770 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:41.764+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:41.794 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:41.794 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:41.794 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:41.794 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:41.794 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:41.812 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:41.871 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:41.869+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:41.972 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:41.969+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:41.982 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:41.982 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562546402999999, 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.987 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562516213999999, 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.988 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:37:41.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.56248712, 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.993 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:37:41.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:41.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562457495000004, 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:41.998 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:41.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:42.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:37:42.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562407601999993, 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:37:42.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.008 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562375892000006, 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.009 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:37:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:37:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:37:42.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:37:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:37:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:37:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:37:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562346453000004, 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:37:42.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562316996999996, 2024-09-22T01:37:42.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:42.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.022 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562286974000003, 2024-09-22T01:37:42.024 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.025 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:37:42.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:37:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:37:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:37:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:37:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562241560999993, 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.030 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:42.031 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.033 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:37:42.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562211992000002, 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:37:42.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:37:42.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562182182000001, 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.040 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:37:42.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:37:42.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:37:42.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:37:42.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:37:42.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562152896000001, 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:42.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:42.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:37:42.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:37:42.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562119589999995, 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.051 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.052 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:37:42.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.055 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562089684, 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.056 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.058 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:37:42.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.060 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.562059900999998, 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.061 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:42.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.064 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:37:42.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.561996085000004, 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.066 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:37:42.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:37:42.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.561961148999998, 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.071 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:37:42.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:37:42.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.561931408999996, 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.076 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:37:42.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:37:42.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:37:42.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:37:42.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:37:42.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.561901282999997, 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.081 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:37:42.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:37:42.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:37:42.086 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.086 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.086 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.086 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.086 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.086 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:42.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:42.088 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:42.084+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:42.188 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:42.184+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:42.267 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:42.267 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:42.267 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:42.267 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:42.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:42.289 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:42.285+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:42.390 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:42.389+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:42.453 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:42.453 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:42.453 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:42.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:42.491 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:42.489+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:42.491 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:42.591 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:42.589+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:42.623 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.623 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49574816800001, 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:37:42.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.627 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49572243200001, 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.630 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49569665000001, 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49565173100001, 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:37:42.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49561957500001, 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.639 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:37:42.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.495591843, 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49555601899999, 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:37:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49551987500001, 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:37:42.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49548367, 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.655 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:37:42.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.658 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49545631800001, 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:37:42.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49541923999999, 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.663 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:42.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:37:42.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:37:42.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49539570300001, 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.670 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49484850299999, 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:37:42.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:37:42.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49482074599999, 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.675 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49479868, 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.679 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49476852000001, 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:37:42.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49434803, 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:37:42.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:37:42.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49432224899999, 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:42.694 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 157.49430098100001, 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:42.698 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 54.083295585999998, 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:37:42.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:37:42.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:37:42.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:42.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:42.704 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:42.706 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:42.706 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:42.705+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:42.712 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:42.712 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:42.737 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:42.737 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:42.758 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:42.758 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:42.779 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:42.780 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:42.800 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:42.800 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:42.806 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:42.800+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:42.819 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:42.819 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:42.841 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:42.841 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:42.861 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:42.861 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:42.876 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:42.876 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:42.895 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:42.938 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:42.937+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:43.007 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:43.000+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:43.028 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:43.028 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:43.043 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:43.130 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:43.129+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:43.206 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:43.206 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:43.209 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:43.204+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:43.221 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:43.310 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:43.308+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:43.386 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:43.386 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:43.400 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:43.446 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:43.445+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:43.512 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:43.508+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:43.517 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:43.517 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:43.532 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:43.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:37:43.636 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:43.632+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:43.695 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:43.695 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:43.709 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:43.712 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:43.709+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:43.813 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:43.809+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:43.831 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:43.831 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:43.846 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:43.934 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:43.933+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:44.014 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:44.014 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:44.014 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:44.012+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:44.028 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:44.115 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:44.112+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:44.198 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:44.198 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:44.212 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:44.258 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:44.257+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:44.317 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:44.311+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:44.329 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:44.329 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:44.344 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:44.419 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:44.415+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:44.502 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:44.502 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:44.516 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:44.519 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:44.517+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:44.529 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:37:44.621 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:44.615+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:44.643 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:44.644 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:44.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:44.722 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:44.721+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:44.791 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:44.791 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:44.806 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:44.852 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:44.847+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:44.883 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:44.928 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:44.923+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:44.933 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:44.933 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:44.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:45.025 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:45.021+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:45.030 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:45.030 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:45.047 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:45.047 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:45.064 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:45.064 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:45.081 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:45.081 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:45.101 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:45.102 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:45.126 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:45.125+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:45.129 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:45.129 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138405 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 245760~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.935691298999998, 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398091244, 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138405 2024-09-22T01:37:45.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191643+0000", 2024-09-22T01:37:45.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0999999999999998e-07 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191651+0000", 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1529999999999997e-06 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191659+0000", 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7470000000000005e-06 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191665+0000", 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2439999999999998e-06 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191817+0000", 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000151414 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191827+0000", 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0305e-05 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537811+0000", 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34598379000000001 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537817+0000", 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7359999999999998e-06 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589536+0000", 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517191669999999 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589611+0000", 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5436000000000001e-05 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589734+0000", 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012264200000000001 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.135 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138406 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 266240~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.935596762000003, 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3985561479999999, 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138406 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191737+0000", 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191738+0000", 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191741+0000", 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4479999999999999e-06 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191749+0000", 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6029999999999999e-06 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191755+0000", 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.139e-06 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191922+0000", 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000166589 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191931+0000", 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.132e-06 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537867+0000", 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34593649399999998 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537879+0000", 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.186e-05 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.589835+0000", 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519563439999999 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590007+0000", 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000171182 2024-09-22T01:37:45.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590293+0000", 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00028668699999999999 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138407 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 286720~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.935495750999998, 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3989841119999999, 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.141 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138407 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191838+0000", 2024-09-22T01:37:45.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191839+0000", 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191843+0000", 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7189999999999999e-06 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191854+0000", 2024-09-22T01:37:45.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1728e-05 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191861+0000", 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3589999999999996e-06 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192030+0000", 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169789 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192040+0000", 2024-09-22T01:37:45.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.251e-06 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537916+0000", 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34587605199999999 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537921+0000", 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0370000000000002e-06 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590343+0000", 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0524222999999999 2024-09-22T01:37:45.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590511+0000", 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0001683 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590822+0000", 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00031091400000000003 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.146 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138408 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 307200~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.935392206000003, 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399171419, 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138408 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191942+0000", 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2200000000000004e-07 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191946+0000", 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7309999999999999e-06 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191958+0000", 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1678000000000001e-05 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.191974+0000", 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6158e-05 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192127+0000", 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000153614 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192136+0000", 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7290000000000006e-06 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537946+0000", 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345810267 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.150 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.537954+0000", 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5320000000000001e-06 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590877+0000", 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529233330000001 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.590965+0000", 2024-09-22T01:37:45.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8134999999999996e-05 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591113+0000", 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014762 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138409 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 327680~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.935283017000003, 2024-09-22T01:37:45.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399404775, 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138409 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192051+0000", 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2799999999999996e-07 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192055+0000", 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8510000000000001e-06 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192065+0000", 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2739999999999996e-06 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192071+0000", 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4679999999999997e-06 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192214+0000", 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000142948 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192223+0000", 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8130000000000002e-06 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538006+0000", 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34578290299999997 2024-09-22T01:37:45.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538028+0000", 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2002999999999999e-05 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591185+0000", 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053157688 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591278+0000", 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2434000000000003e-05 2024-09-22T01:37:45.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591456+0000", 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000177765 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138410 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 348160~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.935186883999997, 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399528573, 2024-09-22T01:37:45.158 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138410 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192147+0000", 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192148+0000", 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9599999999999999e-07 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192151+0000", 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.63e-06 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192159+0000", 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6510000000000001e-06 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192165+0000", 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2349999999999996e-06 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192301+0000", 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000136124 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192309+0000", 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2320000000000001e-06 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538066+0000", 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345756485 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538075+0000", 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6309999999999992e-06 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591495+0000", 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053420759 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591559+0000", 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4108000000000004e-05 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591676+0000", 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000116122 2024-09-22T01:37:45.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138411 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 368640~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.935100566000003, 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3997209019999999, 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.164 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138411 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192233+0000", 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192234+0000", 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2699999999999999e-07 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192237+0000", 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4850000000000001e-06 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192245+0000", 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9079999999999995e-06 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192251+0000", 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8880000000000002e-06 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192388+0000", 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013639500000000001 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192413+0000", 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5411000000000001e-05 2024-09-22T01:37:45.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538143+0000", 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573035800000002 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538165+0000", 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1929e-05 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591711+0000", 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0535457159999999 2024-09-22T01:37:45.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591800+0000", 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8556999999999999e-05 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.591954+0000", 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000154628 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.169 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138412 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 389120~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.935014107000001, 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399867717, 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138412 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192320+0000", 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2900000000000003e-07 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192324+0000", 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5219999999999999e-06 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192332+0000", 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.96e-06 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192338+0000", 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2140000000000001e-06 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192490+0000", 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015239 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192499+0000", 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8240000000000006e-06 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538235+0000", 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34573599700000002 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.173 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538244+0000", 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9490000000000002e-06 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592004+0000", 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0537599369999999 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592070+0000", 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5321999999999996e-05 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592187+0000", 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117973 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138413 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 409600~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.934910625999997, 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4000562969999999, 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.175 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138413 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192423+0000", 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192424+0000", 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192427+0000", 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.506e-06 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192435+0000", 2024-09-22T01:37:45.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8760000000000005e-06 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192441+0000", 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.5049999999999998e-06 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192578+0000", 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013744699999999999 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.178 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192587+0000", 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5380000000000002e-06 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538307+0000", 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.345719954 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538320+0000", 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2976000000000001e-05 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592226+0000", 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053906327 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592318+0000", 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2199000000000003e-05 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592480+0000", 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016129800000000001 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138414 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 430080~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.934823541999997, 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4002321010000001, 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138414 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.181 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192510+0000", 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192511+0000", 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7899999999999998e-07 2024-09-22T01:37:45.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192515+0000", 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8659999999999999e-06 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192523+0000", 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9480000000000008e-06 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192529+0000", 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.088e-06 2024-09-22T01:37:45.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192670+0000", 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014069199999999999 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192678+0000", 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6880000000000005e-06 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538397+0000", 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34571886600000001 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538403+0000", 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7819999999999999e-06 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592507+0000", 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0541037799999999 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592590+0000", 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3506999999999999e-05 2024-09-22T01:37:45.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592742+0000", 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015220500000000001 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138415 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 450560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.934736430000001, 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4003886910000001, 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138415 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192597+0000", 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192598+0000", 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7100000000000001e-07 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192602+0000", 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.4079999999999998e-06 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192609+0000", 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9109999999999993e-06 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192616+0000", 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1879999999999999e-06 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192888+0000", 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000272475 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192898+0000", 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5000000000000005e-06 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538424+0000", 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34552665100000002 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538433+0000", 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2979999999999992e-06 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592785+0000", 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0543528529999999 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592863+0000", 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7534999999999995e-05 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.592986+0000", 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000123201 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138416 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 471040~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.934644830000003, 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4005776480000001, 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138416 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.192 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192689+0000", 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192690+0000", 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192693+0000", 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6669999999999998e-06 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192701+0000", 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1089999999999998e-06 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192708+0000", 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0569999999999998e-06 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193001+0000", 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000293288 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193010+0000", 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.346e-06 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538482+0000", 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34547171599999998 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538494+0000", 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1936999999999999e-05 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593021+0000", 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.054527456 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593108+0000", 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6743000000000006e-05 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593267+0000", 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015870599999999999 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138417 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 491520~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.934424020000002, 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4006197579999999, 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138417 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192910+0000", 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192911+0000", 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4899999999999995e-07 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192920+0000", 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1679999999999993e-06 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192933+0000", 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3132000000000001e-05 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.192940+0000", 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1500000000000002e-06 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193107+0000", 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016665899999999999 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193117+0000", 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0009e-05 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538566+0000", 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34544893700000001 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538581+0000", 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5438e-05 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593293+0000", 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0547119359999999 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593375+0000", 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.195e-05 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593530+0000", 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015473 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.202 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138418 3.1 3:815e4309:::rbd_data.110f99820dc6.000000000000000e:2d [read 512000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.934312966999997, 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4007298539999999, 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.203 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138418 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193021+0000", 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.204 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193022+0000", 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5899999999999996e-07 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193026+0000", 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1649999999999999e-06 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193038+0000", 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2099000000000001e-05 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.205 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193044+0000", 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.567e-06 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193248+0000", 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000203978 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193257+0000", 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0070000000000003e-06 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538642+0000", 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34538508099999998 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538657+0000", 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.452e-05 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593568+0000", 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0549109299999999 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593636+0000", 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7702999999999999e-05 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593751+0000", 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000115145 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138429 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 458752~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.208 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.934165548999999, 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.400882792, 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138429 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193168+0000", 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193169+0000", 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193172+0000", 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1319999999999998e-06 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193190+0000", 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8184000000000001e-05 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.193197+0000", 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3929999999999996e-06 2024-09-22T01:37:45.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194935+0000", 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001738306 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194945+0000", 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8859999999999999e-06 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538696+0000", 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34375087300000001 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538702+0000", 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3339999999999998e-06 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593785+0000", 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.055083478 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.593882+0000", 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6512e-05 2024-09-22T01:37:45.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594051+0000", 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000169185 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138457 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 692224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.932476102000003, 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3994306999999999, 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138457 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.215 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194858+0000", 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6199999999999998e-07 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194867+0000", 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4980000000000006e-06 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194875+0000", 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3429999999999996e-06 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.194881+0000", 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7690000000000002e-06 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195318+0000", 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00043666400000000002 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195327+0000", 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2220000000000008e-06 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538752+0000", 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34342517700000003 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538763+0000", 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1368e-05 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594096+0000", 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0553327100000001 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594164+0000", 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8319999999999996e-05 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594288+0000", 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000124067 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138468 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 704512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.932098445999998, 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3993414930000001, 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138468 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195235+0000", 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195236+0000", 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5099999999999999e-07 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195240+0000", 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9720000000000003e-06 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195249+0000", 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1859999999999998e-06 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195256+0000", 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7989999999999996e-06 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195467+0000", 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021063599999999999 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195477+0000", 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0468e-05 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538799+0000", 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34332192700000003 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538805+0000", 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7300000000000002e-06 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594324+0000", 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0555192959999999 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594414+0000", 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0303000000000006e-05 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.224 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594577+0000", 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016252500000000001 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138471 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 487424~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.931697610999997, 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399163084, 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.225 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138471 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195636+0000", 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195637+0000", 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0500000000000004e-07 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195640+0000", 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1300000000000001e-06 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195648+0000", 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8790000000000003e-06 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195654+0000", 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2949999999999999e-06 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195704+0000", 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0281999999999997e-05 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195714+0000", 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5219999999999996e-06 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538855+0000", 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34314121400000003 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538868+0000", 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2814e-05 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594614+0000", 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0557457189999999 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594680+0000", 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5955000000000001e-05 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594799+0000", 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119769 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138482 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 499712~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.230 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.931335036999997, 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.399082626, 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138482 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:45.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.195999+0000", 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000005e-07 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196004+0000", 2024-09-22T01:37:45.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0609999999999997e-06 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196012+0000", 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9039999999999998e-06 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.196019+0000", 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8090000000000004e-06 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197752+0000", 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0017325159999999999 2024-09-22T01:37:45.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.197770+0000", 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8615e-05 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538901+0000", 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.34113091499999998 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.538907+0000", 2024-09-22T01:37:45.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4140000000000002e-06 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594834+0000", 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559273490000001 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.594922+0000", 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8182000000000004e-05 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.595081+0000", 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015923599999999999 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:138776 3.1 3:854899b5:::rbd_data.110fc5678388.0000000000000009:2c [read 634880~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e128)", 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 46.924438088999999, 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.398108922, 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.236 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 138776 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202896+0000", 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.8799999999999998e-07 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202898+0000", 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1229999999999998e-06 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202905+0000", 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9120000000000001e-06 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202910+0000", 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.169e-06 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202961+0000", 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0173000000000002e-05 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.202969+0000", 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8980000000000002e-06 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539828+0000", 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.336858714 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:58.539834+0000", 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4840000000000003e-06 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600811+0000", 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0609770540000001 2024-09-22T01:37:45.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.600885+0000", 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4010000000000005e-05 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:59.601005+0000", 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000119997 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.241 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.242 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:45.242 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:45.243 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:45.244 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:45.244 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:45.244 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:45.244 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:45.245 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:45.245 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:45.239+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:45.344 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:45.341+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:45.418 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:45.418 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:45.418 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:45.418 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:45.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:45.480 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:45.475+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:45.546 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:45.539+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:45.558 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:45.559 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:45.559 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:45.559 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:45.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:45.664 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:45.659+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:45.747 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:45.739+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:45.757 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:45.757 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:45.757 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:45.757 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:45.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95325215099999, 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:37:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:37:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:37:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.953196975, 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:37:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:37:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95313186199999, 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:37:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:37:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95306611500001, 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:37:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:37:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95302864499999, 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:37:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:37:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:37:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:37:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:37:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95297802900001, 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95179268999999, 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:37:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:37:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:37:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95173086299999, 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:37:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:37:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:37:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95168206400001, 2024-09-22T01:37:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:37:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:37:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:37:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:37:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95160851099999, 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:37:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95153804899999, 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:37:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:37:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:37:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.951467546, 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:37:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:37:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95142031399999, 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:37:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:37:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:37:45.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.951357438, 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:37:45.830 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95131677200001, 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.836 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95122190500001, 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.845 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:37:45.846 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95118086799999, 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.847 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.849 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:37:45.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95114337699999, 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.852 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:37:45.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.857 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95110322799999, 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.858 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:37:45.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:37:45.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.863 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 136.95106043300001, 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:45.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:37:45.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:37:45.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.868 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:45.869 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:45.869 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:45.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:45.870 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:45.863+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:45.930 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 6, 7, 0, 2, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:37:45.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T01:37:45.970 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:45.969+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:46.050 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:46.050 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:46.050 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:46.065 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:46.071 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:46.069+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:46.172 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:46.169+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:46.187 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:46.187 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:46.187 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:46.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:46.273 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:46.267+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:46.324 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:46.324 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904436914000001, 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.325 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:46.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:37:46.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:37:46.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904406725000001, 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:37:46.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904377631000003, 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:37:46.333 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.337 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904348006000006, 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.338 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:37:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904298112999996, 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904266402999994, 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904236964000006, 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904207507999999, 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:37:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904177485000005, 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:37:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:37:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904132071999996, 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:37:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:37:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904102503000004, 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:37:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:37:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:37:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904072693000003, 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:37:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904043407000003, 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:37:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.904010100999997, 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.903980195000003, 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.903950412, 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:37:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:37:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.903886596000007, 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.903851660000001, 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:37:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.903821919999999, 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:37:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:37:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:37:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 79.903791794, 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:37:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:37:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.409 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:46.410 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:46.411 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:46.403+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:46.511 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:46.507+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:46.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:37:46.573 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T01:37:46.609 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T01:37:46.612 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:46.612 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:46.612 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:46.613 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:46.607+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:46.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:46.712 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:46.709+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:46.810 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:46.810 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:46.810 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:46.813 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:46.813+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:46.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:46.914 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:46.907+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:46.938 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:46.938 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81098120600001, 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.939 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81095547000001, 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.943 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:46.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:37:46.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81092968799999, 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.947 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:37:46.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:37:46.950 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81088476900001, 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.951 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:37:46.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81085261300001, 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.955 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.958 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.810824881, 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.959 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.961 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:37:46.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81078905699999, 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.963 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:37:46.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81075291299999, 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.967 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:37:46.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.810716708, 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81068935600001, 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.975 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:37:46.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81065227799999, 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.979 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:37:46.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:37:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81062874099999, 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.983 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.984 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:37:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:37:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81008154099999, 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.987 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:37:46.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:37:46.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81005378399999, 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.991 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:37:46.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.810031718, 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.995 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:37:46.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:37:46.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.81000155800001, 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:46.999 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.002 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.809581068, 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.003 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:47.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.006 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.80955528699999, 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:47.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:47.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 161.80953401900001, 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:37:47.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:37:47.012 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:37:47.013 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 58.398528624000001, 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.015 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.016 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.017 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:37:47.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:37:47.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.021 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:47.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:47.021 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:47.021 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:47.022 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:47.023 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:47.019+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:47.123 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:47.119+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:47.154 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:47.155 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:47.155 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:47.155 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:47.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:47.224 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:47.223+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:47.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:47.285 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:47.285 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:47.285 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:47.285 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:47.285 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:47.299 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:47.346 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:47.345+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:47.396 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:47.396 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:47.413 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:47.422 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:47.422 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 138.62320666700001, 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:37:47.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.424 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:37:47.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:37:47.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:37:47.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:37:47.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:37:47.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:37:47.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 109.911063949, 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:37:47.430 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.431 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:47.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105543 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 10911744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:47.436 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.309545722999999, 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064938994, 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105543 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110043+0000", 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110048+0000", 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6470000000000003e-06 2024-09-22T01:37:47.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110066+0000", 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8306999999999999e-05 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110081+0000", 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4362000000000001e-05 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174758+0000", 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064676685999999997 2024-09-22T01:37:47.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174867+0000", 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109701 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174980+0000", 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000113238 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.440 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.309460041999998, 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.441 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:37:47.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:37:47.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.444 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.309394358999995, 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.309328610999998, 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:47.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:37:47.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.309286012000001, 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:37:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:37:47.456 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.309138305000005, 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.457 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.458 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308978916000001, 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.461 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:37:47.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:37:47.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308915114000001, 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:37:47.465 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.466 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:47.469 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308854925000006, 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:37:47.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:47.473 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308791482999993, 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:37:47.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:37:47.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308736228000001, 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.481 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308682429000001, 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.482 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:37:47.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.485 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308621477000003, 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:37:47.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:37:47.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:37:47.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:37:47.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308563778000007, 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308475326999996, 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.494 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308389431999998, 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 80.308304583999998, 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.503 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.504 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.505 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 53.188229292999999, 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:47.507 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:47.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:47.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:47.512 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:47.512 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:37:47.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:37:47.512 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.512 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.512 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.512 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:47.512 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:47.512 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:47.513 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:47.514 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:47.515 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:47.515 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:47.509+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:47.515 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:47.516 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:47.516 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:47.516 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:47.516 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:47.517 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:47.530 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:47.531 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:47.570 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:37:47.570 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T01:37:47.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-22T01:37:47.649 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:47.643+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:47.699 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:47.699 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:47.714 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:47.711+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:47.716 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:47.815 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:47.807+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:47.839 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:47.839 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:47.853 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:47.916 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:47.913+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:47.974 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:47.974 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:47.988 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:48.030 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:48.029+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:48.119 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:48.115+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:48.152 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:48.152 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:48.166 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:48.220 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:48.217+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:48.285 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:48.285 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:48.299 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:48.342 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:48.341+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:48.422 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:48.421+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:48.459 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:48.459 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:48.475 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:48.523 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:48.519+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:48.529 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 1 (10000) 2024-09-22T01:37:48.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-22T01:37:48.624 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:48.621+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:48.645 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:48.645 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:48.659 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:48.746 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:48.745+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:48.825 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:48.825 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:48.825 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:48.823+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:48.839 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:48.926 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:48.925+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:49.007 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:49.007 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:49.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:49.068 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:49.067+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:49.127 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:49.125+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:49.154 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:49.154 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:49.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:49.228 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:49.225+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:49.329 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:49.327+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:49.340 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:49.340 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:49.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:49.444 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:49.443+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:49.525 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:49.525 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:49.531 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:49.529+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:49.532 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.6 to 1 (10000) 2024-09-22T01:37:49.543 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:49.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:49.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-22T01:37:49.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:37:49.649 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:49.647+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:49.723 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:49.723 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:49.732 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:49.731+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:49.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:49.758 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:49.759 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:49.781 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:49.781 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:49.815 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:49.815 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:49.833 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:49.831+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:49.835 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:49.856 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:49.856 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:49.877 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:49.877 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:49.892 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:49.892 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:49.892 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:49.892 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:49.892 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:49.898 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:49.898 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:49.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:49.920 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:49.921 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:49.944 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:49.943+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:50.034 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:50.034 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:50.034 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:50.034 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:50.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.034 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.034 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:50.034 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.231524914, 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:50.035 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.036 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:37:50.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.038 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.039 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.040 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.23146973799999, 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.041 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.042 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.043 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.044 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:37:50.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.23140462500001, 2024-09-22T01:37:50.046 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:37:50.048 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.049 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.050 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.051 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.231338878, 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.052 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.053 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.054 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.055 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.056 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.23130140800001, 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.058 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:37:50.061 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:37:50.063 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.231250792, 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.064 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.066 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:37:50.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:37:50.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:37:50.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.068 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.068 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:37:50.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:37:50.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.23006545300001, 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.071 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:37:50.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:37:50.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.23000362600001, 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.077 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:37:50.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.080 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.229954827, 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:37:50.082 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.084 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:37:50.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:37:50.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.22988127400001, 2024-09-22T01:37:50.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:37:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.089 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:37:50.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.095 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.22981081200001, 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:37:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:37:50.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:37:50.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:37:50.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.22974030899999, 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.103 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.106 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:37:50.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.109 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.22969307700001, 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.110 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:37:50.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:37:50.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:50.116 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.22963020099999, 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:37:50.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.122 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.229589535, 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.123 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.125 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:37:50.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.129 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.229494668, 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:37:50.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:37:50.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.22945363100001, 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:37:50.136 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:37:50.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:37:50.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.142 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.22941614000001, 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.143 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:37:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.22937599100001, 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:37:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:37:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 141.229333196, 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:37:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:37:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:37:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.163 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:50.165 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:50.165 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:50.163+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:50.264 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:50.263+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:50.324 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:50.324 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:50.324 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:50.325 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:50.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:50.380 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:50.379+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:50.467 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:50.465+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:50.498 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:50.498 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:50.498 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:50.498 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:50.498 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:50.511 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:50.538 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:37:50.542 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.7 to 1 (10000) 2024-09-22T01:37:50.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T01:37:50.573 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:50.571+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:50.650 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:50.650 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232652993000002, 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.651 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:50.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232622804000002, 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.655 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.659 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232593710000003, 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:37:50.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232564085000007, 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.664 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:37:50.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232514191999996, 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232482481999995, 2024-09-22T01:37:50.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:37:50.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:50.676 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232453043000007, 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:50.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:37:50.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232423587, 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232393564000006, 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232348150999997, 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:50.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.691 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232318582000005, 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.693 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:37:50.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232288772000004, 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.697 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.701 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232259486000004, 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:37:50.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232226179999998, 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.706 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.709 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232196274000003, 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.711 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:37:50.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:37:50.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.714 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232166491000001, 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.715 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.717 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.718 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232102674999993, 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:37:50.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:37:50.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:37:50.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232067739000001, 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.724 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.725 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.726 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.727 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232037998999999, 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.728 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.729 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.730 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.731 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 84.232007873000001, 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:50.732 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.733 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:50.735 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:50.736 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:37:50.736 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:37:50.736 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.736 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.736 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.736 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:50.736 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:50.736 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:50.737 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:50.738 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:50.733+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:50.838 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:50.835+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:50.892 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:50.893 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:50.893 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:50.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:50.939 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:50.937+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:51.041 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:51.039+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:51.082 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:51.082 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:51.083 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:51.083 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:51.099 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:51.142 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:51.139+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:51.242 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:51.239+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:51.280 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:51.280 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.151259724, 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:51.281 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.282 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:37:51.283 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:37:51.284 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.151233988, 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:37:51.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.286 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.287 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.288 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:37:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:37:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:51.289 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.15120820600001, 2024-09-22T01:37:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:37:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:37:51.290 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:51.291 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:37:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:37:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.292 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:37:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:37:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:37:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:37:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.293 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:37:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:37:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:37:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:37:51.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:37:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:37:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.151163287, 2024-09-22T01:37:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:37:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.296 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:37:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:37:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:37:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:37:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:37:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:37:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:37:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:37:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:37:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:37:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:37:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:37:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:37:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.301 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.151131131, 2024-09-22T01:37:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:37:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:37:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.304 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.306 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.15110339899999, 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.307 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:37:51.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:37:51.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.15106757500001, 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.311 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:37:51.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:37:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:37:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.315 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.15103143100001, 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:37:51.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.15099522599999, 2024-09-22T01:37:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:37:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.320 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.321 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.150967874, 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:51.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.15093079600001, 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.329 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.331 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.15090725900001, 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:37:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:37:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:37:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:37:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.335 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.15036005900001, 2024-09-22T01:37:51.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:37:51.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:37:51.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.15033230200001, 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:37:51.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:37:51.344 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.150310236, 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:37:51.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.348 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.150280076, 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.349 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:37:51.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:37:51.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.352 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.14985958599999, 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:51.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:37:51.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.356 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.14983380499999, 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:37:51.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:37:51.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 166.149812537, 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:37:51.364 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 62.738807141999999, 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:51.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:51.366 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:37:51.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:37:51.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:37:51.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:51.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:37:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:37:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:51.371 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:51.371 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:51.372 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:51.373 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:51.369+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:51.473 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:51.469+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:51.515 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:51.515 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:51.515 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:51.515 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:51.530 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T01:37:51.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T01:37:51.612 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:51.611+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:51.675 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:51.671+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:51.703 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:51.703 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:51.704 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:51.704 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:51.719 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:51.776 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:51.773+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:51.856 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:51.856 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:51.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:51.856 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:51.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.856 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:51.856 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:51.856 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 143.056661529, 2024-09-22T01:37:51.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:37:51.857 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.857 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.857 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:51.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.857 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:37:51.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.857 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:37:51.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:37:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 114.344518811, 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.864 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:37:51.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:37:51.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:37:51.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:37:51.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:37:51.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:37:51.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:37:51.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:37:51.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:37:51.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:37:51.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:51.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:37:51.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:37:51.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:37:51.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:37:51.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:51.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:37:51.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:37:51.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:37:51.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:37:51.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:37:51.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:37:51.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:37:51.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:37:51.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:37:51.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:37:51.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:37:51.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:37:51.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:37:51.875 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.875 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.875 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.876 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105543 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 10911744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.876 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:51.876 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.743000585000004, 2024-09-22T01:37:51.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064938994, 2024-09-22T01:37:51.877 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.877 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.877 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.877 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105543 2024-09-22T01:37:51.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.878 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:51.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:51.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110043+0000", 2024-09-22T01:37:51.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:51.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110048+0000", 2024-09-22T01:37:51.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6470000000000003e-06 2024-09-22T01:37:51.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110066+0000", 2024-09-22T01:37:51.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8306999999999999e-05 2024-09-22T01:37:51.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110081+0000", 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4362000000000001e-05 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174758+0000", 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064676685999999997 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174867+0000", 2024-09-22T01:37:51.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109701 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174980+0000", 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000113238 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.883 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742914904000003, 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.887 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742849221, 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.888 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:37:51.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:37:51.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742783473000003, 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.892 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.894 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742740874000006, 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.896 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.898 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.899 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742593166999995, 2024-09-22T01:37:51.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:37:51.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.903 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742433778000006, 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:37:51.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:37:51.907 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:37:51.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742369976000006, 2024-09-22T01:37:51.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:37:51.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742309786999996, 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.914 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742246344999998, 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.918 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:37:51.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:37:51.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742191090000006, 2024-09-22T01:37:51.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.925 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.926 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742137291000006, 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.927 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.928 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:37:51.929 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.930 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742076338999993, 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.931 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.932 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.933 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.934 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.934 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:37:51.934 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:37:51.934 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.934 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.934 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.934 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:37:51.934 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:37:51.934 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.935 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.742018639999998, 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:51.936 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:37:51.937 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:37:51.938 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.939 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.741930189000001, 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.940 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.941 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.942 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.943 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.741844294000003, 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.944 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.945 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.945 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:51.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.945 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.945 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.945 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:51.945 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.945 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.946 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.947 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.948 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 84.741759446000003, 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.949 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:51.950 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.951 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.952 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 57.621684154999997, 2024-09-22T01:37:51.953 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.954 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.955 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:37:51.956 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:51.957 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:51.958 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:51.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:51.960 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:51.960 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:51.957+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:52.061 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:52.059+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:52.112 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:52.112 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:52.129 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:52.145 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:52.146 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:52.161 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:52.159+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:52.161 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:52.162 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:52.162 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:52.163 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:52.163 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:52.177 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:52.180 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:52.180 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:52.198 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:52.198 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:52.217 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:52.235 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:52.235 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:52.296 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:52.295+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:52.316 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:52.316 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:52.331 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:52.362 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:52.359+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:52.451 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:52.451 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:52.463 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:52.461+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:52.465 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T01:37:52.564 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:52.561+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:52.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:37:52.579 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-22T01:37:52.645 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:52.645 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:52.660 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:52.665 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:52.663+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:52.766 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:52.765+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:52.829 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:52.829 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:52.843 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:52.886 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:52.885+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:52.967 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:52.965+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:53.006 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:53.006 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:53.019 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:53.069 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:53.067+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:53.170 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:53.169+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:53.185 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:53.185 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:53.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:53.271 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:53.267+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:53.362 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:53.362 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:53.372 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:53.371+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:53.377 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:53.473 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:53.471+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:53.500 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:53.500 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:53.515 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:53.532 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.5 to 1 (10000) 2024-09-22T01:37:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:37:53.575 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:53.571+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:53.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T01:37:53.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:37:53.676 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:53.675+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:53.680 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:53.680 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:53.699 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:53.784 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:53.783+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:53.872 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:53.872 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:53.879 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:53.875+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:53.891 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:53.982 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:53.977+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:53.993 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:53.993 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:37:54.013 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-09-22T01:37:53.533093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":416787842,"num_objects":553,"num_object_clones":145,"num_object_copies":1106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":119,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":553,"num_whiteouts":195,"num_read":174508,"num_read_kb":935584,"num_write":17988,"num_write_kb":476875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5282,"num_bytes_recovered":326736674,"num_keys_recovered":831,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15878,"ondisk_log_size":15878,"up":82,"acting":77,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":569244,"kb_used_data":159892,"kb_used_omap":12,"kb_used_meta":408947,"kb_avail":754405476,"statfs":{"total":773094113280,"available":772511207424,"internally_reserved":0,"allocated":163729408,"data_stored":253763987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":418762288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-172782403,"num_objects":-97,"num_object_clones":-27,"num_object_copies":-194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":119,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":-97,"num_whiteouts":-36,"num_read":-20975,"num_read_kb":-97882,"num_write":-2812,"num_write_kb":-66887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-346,"num_bytes_recovered":-62994390,"num_keys_recovered":-161,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.996737"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":181,"state":"unknown","last_fresh":"2024-09-22T01:37:51.546219+0000","last_change":"2024-09-22T01:37:51.864886+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T01:37:51.546219+0000","last_undegraded":"2024-09-22T01:37:51.546219+0000","last_fullsized":"2024-09-22T01:37:51.546219+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"176'548","reported_seq":4617,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543298+0000","last_change":"2024-09-22T01:37:48.539173+0000","last_active":"2024-09-22T01:37:51.543298+0000","last_peered":"2024-09-22T01:37:51.543298+0000","last_clean":"2024-09-22T01:37:51.543298+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:37:51.543298+0000","last_undegraded":"2024-09-22T01:37:51.543298+0000","last_fullsized":"2024-09-22T01:37:51.543298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:36:06.748911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042030269999999998,"stat_sum":{"num_bytes":2695081,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":6073,"num_read_kb":47761,"num_write":575,"num_write_kb":23740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.1d","version":"176'996","reported_seq":3371,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548982+0000","last_change":"2024-09-22T01:37:48.547322+0000","last_active":"2024-09-22T01:37:51.548982+0000","last_peered":"2024-09-22T01:37:51.548982+0000","last_clean":"2024-09-22T01:37:51.548982+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:37:51.548982+0000","last_undegraded":"2024-09-22T01:37:51.548982+0000","last_fullsized":"2024-09-22T01:37:51.548982+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:55.069642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023410480000000001,"stat_sum":{"num_bytes":23588376,"num_objects":19,"num_object_clones":6,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":7,"num_read":5513,"num_read_kb":33890,"num_write":1512,"num_write_kb":16569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.1c","version":"180'282","reported_seq":2828,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548787+0000","last_change":"2024-09-22T01:37:48.546957+0000","last_active":"2024-09-22T01:37:51.548787+0000","last_peered":"2024-09-22T01:37:51.548787+0000","last_clean":"2024-09-22T01:37:51.548787+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:37:51.548787+0000","last_undegraded":"2024-09-22T01:37:51.548787+0000","last_fullsized":"2024-09-22T01:37:51.548787+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:13:55.690655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001977829,"stat_sum":{"num_bytes":7788443,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":2117,"num_read_kb":34965,"num_write":297,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":181,"state":"unknown","last_fresh":"2024-09-22T01:37:51.547497+0000","last_change":"2024-09-22T01:37:51.864826+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T01:37:51.547497+0000","last_undegraded":"2024-09-22T01:37:51.547497+0000","last_fullsized":"2024-09-22T01:37:51.547497+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"180'451","reported_seq":5197,"reported_epoch":181,"state":"creating+peering","last_fresh":"2024-09-22T01:37:51.410531+0000","last_change":"2024-09-22T01:37:51.864728+0000","last_active":"2024-09-22T01:37:51.864728+0000","last_peered":"2024-09-22T01:37:51.410531+0000","last_clean":"2024-09-22T01:37:47.755988+0000","last_became_active":"2024-09-22T01:37:50.588617+0000","last_became_peered":"2024-09-22T01:37:50.588617+0000","last_unstale":"2024-09-22T01:37:51.410531+0000","last_undegraded":"2024-09-22T01:37:51.410531+0000","last_fullsized":"2024-09-22T01:37:50.539805+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030239809999999998,"stat_sum":{"num_bytes":16542559,"num_objects":37,"num_object_clones":12,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":4733,"num_read_kb":40067,"num_write":476,"num_write_kb":25283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.19","version":"177'830","reported_seq":9497,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.539444+0000","last_change":"2024-09-22T01:37:48.541765+0000","last_active":"2024-09-22T01:37:51.539444+0000","last_peered":"2024-09-22T01:37:51.539444+0000","last_clean":"2024-09-22T01:37:51.539444+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:37:51.539444+0000","last_undegraded":"2024-09-22T01:37:51.539444+0000","last_fullsized":"2024-09-22T01:37:51.539444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:24.449134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011518660000000001,"stat_sum":{"num_bytes":25029118,"num_objects":27,"num_object_clones":10,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":7,"num_read":10611,"num_read_kb":63679,"num_write":1125,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.18","version":"177'939","reported_seq":3381,"reported_epoch":180,"state":"peering","last_fresh":"2024-09-22T01:37:50.541406+0000","last_change":"2024-09-22T01:37:51.543031+0000","last_active":"2024-09-22T01:37:51.543031+0000","last_peered":"2024-09-22T01:37:50.541406+0000","last_clean":"2024-09-22T01:37:50.541406+0000","last_became_active":"2024-09-22T01:37:43.538323+0000","last_became_peered":"2024-09-22T01:37:43.538323+0000","last_unstale":"2024-09-22T01:37:50.541406+0000","last_undegraded":"2024-09-22T01:37:50.541406+0000","last_fullsized":"2024-09-22T01:37:50.541406+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022849300000000001,"stat_sum":{"num_bytes":15537572,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1482,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":1799854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.17","version":"176'467","reported_seq":6003,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.546628+0000","last_change":"2024-09-22T01:37:48.540847+0000","last_active":"2024-09-22T01:37:51.546628+0000","last_peered":"2024-09-22T01:37:51.546628+0000","last_clean":"2024-09-22T01:37:51.546628+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:37:51.546628+0000","last_undegraded":"2024-09-22T01:37:51.546628+0000","last_fullsized":"2024-09-22T01:37:51.546628+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:16:45.391396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017429240000000001,"stat_sum":{"num_bytes":11533255,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":10,"num_read":5811,"num_read_kb":32153,"num_write":472,"num_write_kb":34048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.16","version":"180'682","reported_seq":14802,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.549162+0000","last_change":"2024-09-22T01:37:48.546647+0000","last_active":"2024-09-22T01:37:51.549162+0000","last_peered":"2024-09-22T01:37:51.549162+0000","last_clean":"2024-09-22T01:37:51.549162+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:37:51.549162+0000","last_undegraded":"2024-09-22T01:37:51.549162+0000","last_fullsized":"2024-09-22T01:37:51.549162+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:20:34.250218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017740340000000001,"stat_sum":{"num_bytes":18734673,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":7,"num_read":14786,"num_read_kb":34405,"num_write":695,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.15","version":"176'285","reported_seq":5019,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543142+0000","last_change":"2024-09-22T01:37:48.535365+0000","last_active":"2024-09-22T01:37:51.543142+0000","last_peered":"2024-09-22T01:37:51.543142+0000","last_clean":"2024-09-22T01:37:51.543142+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:37:51.543142+0000","last_undegraded":"2024-09-22T01:37:51.543142+0000","last_fullsized":"2024-09-22T01:37:51.543142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:20.002795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001191374,"stat_sum":{"num_bytes":7954426,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":5,"num_read":4129,"num_read_kb":34295,"num_write":242,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.14","version":"176'372","reported_seq":6329,"reported_epoch":181,"state":"peering","last_fresh":"2024-09-22T01:37:50.766467+0000","last_change":"2024-09-22T01:37:51.864777+0000","last_active":"2024-09-22T01:37:51.864777+0000","last_peered":"2024-09-22T01:37:50.766467+0000","last_clean":"2024-09-22T01:37:46.583022+0000","last_became_active":"2024-09-22T01:37:50.577732+0000","last_became_peered":"2024-09-22T01:37:50.577732+0000","last_unstale":"2024-09-22T01:37:50.766467+0000","last_undegraded":"2024-09-22T01:37:50.766467+0000","last_fullsized":"2024-09-22T01:37:50.766467+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.010038729,"stat_sum":{"num_bytes":8838399,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":6086,"num_read_kb":53973,"num_write":334,"num_write_kb":20591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":362,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.552938+0000","last_change":"2024-09-22T01:37:51.552938+0000","last_active":"2024-09-22T01:37:51.552938+0000","last_peered":"2024-09-22T01:37:51.552938+0000","last_clean":"2024-09-22T01:37:51.552938+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:37:51.552938+0000","last_undegraded":"2024-09-22T01:37:51.552938+0000","last_fullsized":"2024-09-22T01:37:51.552938+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:20.798595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":181,"state":"unknown","last_fresh":"2024-09-22T01:37:51.544828+0000","last_change":"2024-09-22T01:37:51.864865+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T01:37:51.544828+0000","last_undegraded":"2024-09-22T01:37:51.544828+0000","last_fullsized":"2024-09-22T01:37:51.544828+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":342,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.541274+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:37:51.541274+0000","last_peered":"2024-09-22T01:37:51.541274+0000","last_clean":"2024-09-22T01:37:51.541274+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:37:51.541274+0000","last_undegraded":"2024-09-22T01:37:51.541274+0000","last_fullsized":"2024-09-22T01:37:51.541274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"180'344","reported_seq":3432,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542801+0000","last_change":"2024-09-22T01:37:48.538123+0000","last_active":"2024-09-22T01:37:51.542801+0000","last_peered":"2024-09-22T01:37:51.542801+0000","last_clean":"2024-09-22T01:37:51.542801+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:37:51.542801+0000","last_undegraded":"2024-09-22T01:37:51.542801+0000","last_fullsized":"2024-09-22T01:37:51.542801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:48.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035216710000000001,"stat_sum":{"num_bytes":12168092,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":3428,"num_read_kb":20696,"num_write":334,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":227,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542997+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:37:51.542997+0000","last_peered":"2024-09-22T01:37:51.542997+0000","last_clean":"2024-09-22T01:37:51.542997+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:37:51.542997+0000","last_undegraded":"2024-09-22T01:37:51.542997+0000","last_fullsized":"2024-09-22T01:37:51.542997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"180'580","reported_seq":4027,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542084+0000","last_change":"2024-09-22T01:37:48.535316+0000","last_active":"2024-09-22T01:37:51.542084+0000","last_peered":"2024-09-22T01:37:51.542084+0000","last_clean":"2024-09-22T01:37:51.542084+0000","last_became_active":"2024-09-22T01:36:12.660207+0000","last_became_peered":"2024-09-22T01:36:12.660207+0000","last_unstale":"2024-09-22T01:37:51.542084+0000","last_undegraded":"2024-09-22T01:37:51.542084+0000","last_fullsized":"2024-09-22T01:37:51.542084+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:06.525388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000657666,"stat_sum":{"num_bytes":18624456,"num_objects":21,"num_object_clones":6,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":5387,"num_read_kb":37627,"num_write":601,"num_write_kb":11226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":210,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.545366+0000","last_change":"2024-09-22T01:36:03.520390+0000","last_active":"2024-09-22T01:37:51.545366+0000","last_peered":"2024-09-22T01:37:51.545366+0000","last_clean":"2024-09-22T01:37:51.545366+0000","last_became_active":"2024-09-22T01:36:03.519493+0000","last_became_peered":"2024-09-22T01:36:03.519493+0000","last_unstale":"2024-09-22T01:37:51.545366+0000","last_undegraded":"2024-09-22T01:37:51.545366+0000","last_fullsized":"2024-09-22T01:37:51.545366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:25:49.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"177'499","reported_seq":8055,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.549372+0000","last_change":"2024-09-22T01:37:48.547887+0000","last_active":"2024-09-22T01:37:51.549372+0000","last_peered":"2024-09-22T01:37:51.549372+0000","last_clean":"2024-09-22T01:37:51.549372+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:37:51.549372+0000","last_undegraded":"2024-09-22T01:37:51.549372+0000","last_fullsized":"2024-09-22T01:37:51.549372+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:22.405721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002476813,"stat_sum":{"num_bytes":28212283,"num_objects":17,"num_object_clones":5,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":7,"num_read":8474,"num_read_kb":54218,"num_write":518,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.3","version":"180'354","reported_seq":1546,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.545558+0000","last_change":"2024-09-22T01:37:48.540415+0000","last_active":"2024-09-22T01:37:51.545558+0000","last_peered":"2024-09-22T01:37:51.545558+0000","last_clean":"2024-09-22T01:37:51.545558+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:37:51.545558+0000","last_undegraded":"2024-09-22T01:37:51.545558+0000","last_fullsized":"2024-09-22T01:37:51.545558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:16:39.950874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017922140000000001,"stat_sum":{"num_bytes":2969902,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":9,"num_read":1403,"num_read_kb":6358,"num_write":331,"num_write_kb":3538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.2","version":"20'2","reported_seq":90,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548547+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:37:51.548547+0000","last_peered":"2024-09-22T01:37:51.548547+0000","last_clean":"2024-09-22T01:37:51.548547+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:37:51.548547+0000","last_undegraded":"2024-09-22T01:37:51.548547+0000","last_fullsized":"2024-09-22T01:37:51.548547+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"177'501","reported_seq":3876,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.540491+0000","last_change":"2024-09-22T01:37:48.542715+0000","last_active":"2024-09-22T01:37:51.540491+0000","last_peered":"2024-09-22T01:37:51.540491+0000","last_clean":"2024-09-22T01:37:51.540491+0000","last_became_active":"2024-09-22T01:36:39.852969+0000","last_became_peered":"2024-09-22T01:36:39.852969+0000","last_unstale":"2024-09-22T01:37:51.540491+0000","last_undegraded":"2024-09-22T01:37:51.540491+0000","last_fullsized":"2024-09-22T01:37:51.540491+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:31.969186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018044070000000001,"stat_sum":{"num_bytes":524358,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":4,"num_read":4313,"num_read_kb":14844,"num_write":507,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":198,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.541782+0000","last_change":"2024-09-22T01:36:09.627096+0000","last_active":"2024-09-22T01:37:51.541782+0000","last_peered":"2024-09-22T01:37:51.541782+0000","last_clean":"2024-09-22T01:37:51.541782+0000","last_became_active":"2024-09-22T01:36:09.626669+0000","last_became_peered":"2024-09-22T01:36:09.626669+0000","last_unstale":"2024-09-22T01:37:51.541782+0000","last_undegraded":"2024-09-22T01:37:51.541782+0000","last_fullsized":"2024-09-22T01:37:51.541782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:35.787005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"176'530","reported_seq":5115,"reported_epoch":181,"state":"active+undersized+remapped","last_fresh":"2024-09-22T01:37:51.814198+0000","last_change":"2024-09-22T01:37:51.814509+0000","last_active":"2024-09-22T01:37:51.814198+0000","last_peered":"2024-09-22T01:37:51.814198+0000","last_clean":"2024-09-22T01:37:47.573048+0000","last_became_active":"2024-09-22T01:37:50.595228+0000","last_became_peered":"2024-09-22T01:37:50.595228+0000","last_unstale":"2024-09-22T01:37:51.814198+0000","last_undegraded":"2024-09-22T01:37:51.814198+0000","last_fullsized":"2024-09-22T01:37:50.538093+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069905800000000001,"stat_sum":{"num_bytes":18717319,"num_objects":26,"num_object_clones":5,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":12,"num_read":5023,"num_read_kb":25952,"num_write":559,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0","objects":26}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":222,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542801+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:37:51.542801+0000","last_peered":"2024-09-22T01:37:51.542801+0000","last_clean":"2024-09-22T01:37:51.542801+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:37:51.542801+0000","last_undegraded":"2024-09-22T01:37:51.542801+0000","last_fullsized":"2024-09-22T01:37:51.542801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"177'449","reported_seq":2621,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543147+0000","last_change":"2024-09-22T01:37:48.537694+0000","last_active":"2024-09-22T01:37:51.543147+0000","last_peered":"2024-09-22T01:37:51.543147+0000","last_clean":"2024-09-22T01:37:51.543147+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:37:51.543147+0000","last_undegraded":"2024-09-22T01:37:51.543147+0000","last_fullsized":"2024-09-22T01:37:51.543147+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:14.442267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003111436,"stat_sum":{"num_bytes":13796531,"num_objects":17,"num_object_clones":4,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":8,"num_read":2669,"num_read_kb":16189,"num_write":482,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.3","version":"18'1","reported_seq":90,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548685+0000","last_change":"2024-09-22T01:37:13.533524+0000","last_active":"2024-09-22T01:37:51.548685+0000","last_peered":"2024-09-22T01:37:51.548685+0000","last_clean":"2024-09-22T01:37:51.548685+0000","last_became_active":"2024-09-22T01:37:13.529493+0000","last_became_peered":"2024-09-22T01:37:13.529493+0000","last_unstale":"2024-09-22T01:37:51.548685+0000","last_undegraded":"2024-09-22T01:37:51.548685+0000","last_fullsized":"2024-09-22T01:37:51.548685+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:07.459369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":470,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542802+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:37:51.542802+0000","last_peered":"2024-09-22T01:37:51.542802+0000","last_clean":"2024-09-22T01:37:51.542802+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:37:51.542802+0000","last_undegraded":"2024-09-22T01:37:51.542802+0000","last_fullsized":"2024-09-22T01:37:51.542802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"176'697","reported_seq":2592,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542667+0000","last_change":"2024-09-22T01:37:48.535801+0000","last_active":"2024-09-22T01:37:51.542667+0000","last_peered":"2024-09-22T01:37:51.542667+0000","last_clean":"2024-09-22T01:37:51.542667+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:37:51.542667+0000","last_undegraded":"2024-09-22T01:37:51.542667+0000","last_fullsized":"2024-09-22T01:37:51.542667+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:26.049464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027203010000000001,"stat_sum":{"num_bytes":11225033,"num_objects":15,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":7,"num_read":7235,"num_read_kb":52541,"num_write":878,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.9","version":"177'437","reported_seq":5691,"reported_epoch":181,"state":"active+undersized+remapped","last_fresh":"2024-09-22T01:37:51.644251+0000","last_change":"2024-09-22T01:37:51.644728+0000","last_active":"2024-09-22T01:37:51.644251+0000","last_peered":"2024-09-22T01:37:51.644251+0000","last_clean":"2024-09-22T01:37:47.578664+0000","last_became_active":"2024-09-22T01:37:50.594489+0000","last_became_peered":"2024-09-22T01:37:50.594489+0000","last_unstale":"2024-09-22T01:37:51.644251+0000","last_undegraded":"2024-09-22T01:37:51.644251+0000","last_fullsized":"2024-09-22T01:37:50.536018+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0042522649999999999,"stat_sum":{"num_bytes":15069870,"num_objects":11,"num_object_clones":2,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":4359,"num_read_kb":53913,"num_write":442,"num_write_kb":17684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":396,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[2],"avail_no_missing":["2","4","7"],"object_location_counts":[{"shards":"2","objects":11}],"blocked_by":[],"up_primary":4,"acting_primary":2,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.a","version":"180'590","reported_seq":14369,"reported_epoch":181,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-09-22T01:37:51.859174+0000","last_change":"2024-09-22T01:37:51.815651+0000","last_active":"2024-09-22T01:37:51.859174+0000","last_peered":"2024-09-22T01:37:51.859174+0000","last_clean":"2024-09-22T01:37:47.723359+0000","last_became_active":"2024-09-22T01:37:50.590866+0000","last_became_peered":"2024-09-22T01:37:50.590866+0000","last_unstale":"2024-09-22T01:37:51.859174+0000","last_undegraded":"2024-09-22T01:37:50.545169+0000","last_fullsized":"2024-09-22T01:37:50.540427+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.0097751890000000001,"stat_sum":{"num_bytes":16882979,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":5,"num_read":15441,"num_read_kb":20475,"num_write":563,"num_write_kb":18763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":2277723,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6],"avail_no_missing":["6","1"],"object_location_counts":[{"shards":"1,6","objects":6},{"shards":"6","objects":11}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.b","version":"176'406","reported_seq":3076,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543165+0000","last_change":"2024-09-22T01:37:48.536960+0000","last_active":"2024-09-22T01:37:51.543165+0000","last_peered":"2024-09-22T01:37:51.543165+0000","last_clean":"2024-09-22T01:37:51.543165+0000","last_became_active":"2024-09-22T01:36:49.518943+0000","last_became_peered":"2024-09-22T01:36:49.518943+0000","last_unstale":"2024-09-22T01:37:51.543165+0000","last_undegraded":"2024-09-22T01:37:51.543165+0000","last_fullsized":"2024-09-22T01:37:51.543165+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:00:41.579102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024692009999999999,"stat_sum":{"num_bytes":4099760,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":8,"num_read":2659,"num_read_kb":14205,"num_write":475,"num_write_kb":9044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":11703594,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.c","version":"180'533","reported_seq":5855,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548829+0000","last_change":"2024-09-22T01:37:48.548321+0000","last_active":"2024-09-22T01:37:51.548829+0000","last_peered":"2024-09-22T01:37:51.548829+0000","last_clean":"2024-09-22T01:37:51.548829+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:37:51.548829+0000","last_undegraded":"2024-09-22T01:37:51.548829+0000","last_fullsized":"2024-09-22T01:37:51.548829+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:51:08.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027825319999999999,"stat_sum":{"num_bytes":56776707,"num_objects":26,"num_object_clones":8,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":11,"num_read":6959,"num_read_kb":34783,"num_write":506,"num_write_kb":16252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.d","version":"176'491","reported_seq":4861,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543233+0000","last_change":"2024-09-22T01:37:48.536859+0000","last_active":"2024-09-22T01:37:51.543233+0000","last_peered":"2024-09-22T01:37:51.543233+0000","last_clean":"2024-09-22T01:37:51.543233+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:37:51.543233+0000","last_undegraded":"2024-09-22T01:37:51.543233+0000","last_fullsized":"2024-09-22T01:37:51.543233+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:39.336341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002219642,"stat_sum":{"num_bytes":7690004,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":5,"num_read":5594,"num_read_kb":19915,"num_write":540,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.e","version":"176'692","reported_seq":4470,"reported_epoch":180,"state":"peering","last_fresh":"2024-09-22T01:37:51.032018+0000","last_change":"2024-09-22T01:37:51.544317+0000","last_active":"2024-09-22T01:37:51.544317+0000","last_peered":"2024-09-22T01:37:51.032018+0000","last_clean":"2024-09-22T01:37:47.585064+0000","last_became_active":"2024-09-22T01:37:50.584688+0000","last_became_peered":"2024-09-22T01:37:50.584688+0000","last_unstale":"2024-09-22T01:37:51.032018+0000","last_undegraded":"2024-09-22T01:37:51.032018+0000","last_fullsized":"2024-09-22T01:37:50.545894+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041511589999999998,"stat_sum":{"num_bytes":10453121,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":9,"num_read":4545,"num_read_kb":18606,"num_write":873,"num_write_kb":13177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.f","version":"177'706","reported_seq":3513,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543132+0000","last_change":"2024-09-22T01:37:48.536256+0000","last_active":"2024-09-22T01:37:51.543132+0000","last_peered":"2024-09-22T01:37:51.543132+0000","last_clean":"2024-09-22T01:37:51.543132+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:37:51.543132+0000","last_undegraded":"2024-09-22T01:37:51.543132+0000","last_fullsized":"2024-09-22T01:37:51.543132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:45.344182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014644250000000001,"stat_sum":{"num_bytes":11983340,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":5529,"num_read_kb":24698,"num_write":871,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.10","version":"176'658","reported_seq":2900,"reported_epoch":180,"state":"peering","last_fresh":"2024-09-22T01:37:50.722099+0000","last_change":"2024-09-22T01:37:51.546148+0000","last_active":"2024-09-22T01:37:51.546148+0000","last_peered":"2024-09-22T01:37:50.722099+0000","last_clean":"2024-09-22T01:37:50.722099+0000","last_became_active":"2024-09-22T01:37:44.543325+0000","last_became_peered":"2024-09-22T01:37:44.543325+0000","last_unstale":"2024-09-22T01:37:50.722099+0000","last_undegraded":"2024-09-22T01:37:50.722099+0000","last_fullsized":"2024-09-22T01:37:50.722099+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001021098,"stat_sum":{"num_bytes":3145933,"num_objects":17,"num_object_clones":3,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":7,"num_read":4252,"num_read_kb":14328,"num_write":755,"num_write_kb":16255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":5983349,"num_keys_recovered":82,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.11","version":"176'369","reported_seq":5693,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542851+0000","last_change":"2024-09-22T01:37:48.533834+0000","last_active":"2024-09-22T01:37:51.542851+0000","last_peered":"2024-09-22T01:37:51.542851+0000","last_clean":"2024-09-22T01:37:51.542851+0000","last_became_active":"2024-09-22T01:36:01.562260+0000","last_became_peered":"2024-09-22T01:36:01.562260+0000","last_unstale":"2024-09-22T01:37:51.542851+0000","last_undegraded":"2024-09-22T01:37:51.542851+0000","last_fullsized":"2024-09-22T01:37:51.542851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:36.473124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094419899999999995,"stat_sum":{"num_bytes":17174553,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":10,"num_read":4797,"num_read_kb":46848,"num_write":325,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.12","version":"176'455","reported_seq":4853,"reported_epoch":180,"state":"remapped+peering","last_fresh":"2024-09-22T01:37:50.538963+0000","last_change":"2024-09-22T01:37:51.548785+0000","last_active":"2024-09-22T01:37:50.538963+0000","last_peered":"2024-09-22T01:37:49.539067+0000","last_clean":"2024-09-22T01:37:49.539067+0000","last_became_active":"2024-09-22T01:37:44.539460+0000","last_became_peered":"2024-09-22T01:37:44.539460+0000","last_unstale":"2024-09-22T01:37:50.538963+0000","last_undegraded":"2024-09-22T01:37:50.538963+0000","last_fullsized":"2024-09-22T01:37:50.538963+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00227261,"stat_sum":{"num_bytes":11141166,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":7,"num_read":4779,"num_read_kb":18742,"num_write":513,"num_write_kb":10270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":7299962,"num_keys_recovered":55,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.13","version":"176'615","reported_seq":11103,"reported_epoch":181,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-22T01:37:51.543323+0000","last_change":"2024-09-22T01:37:50.595095+0000","last_active":"2024-09-22T01:37:51.543323+0000","last_peered":"2024-09-22T01:37:51.543323+0000","last_clean":"2024-09-22T01:37:47.581611+0000","last_became_active":"2024-09-22T01:37:50.593598+0000","last_became_peered":"2024-09-22T01:37:50.593598+0000","last_unstale":"2024-09-22T01:37:51.543323+0000","last_undegraded":"2024-09-22T01:37:50.551282+0000","last_fullsized":"2024-09-22T01:37:50.545774+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016052340000000001,"stat_sum":{"num_bytes":17300146,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":118,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":6,"num_read":12247,"num_read_kb":47208,"num_write":544,"num_write_kb":13751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":8676658,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7],"avail_no_missing":["7","2"],"object_location_counts":[{"shards":"2,7","objects":25}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"11","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":416197455,"num_objects":549,"num_object_clones":145,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":119,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":195,"num_read":174392,"num_read_kb":935484,"num_write":17827,"num_write_kb":474457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5271,"num_bytes_recovered":325555900,"num_keys_recovered":831,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146952192,"data_stored":247555160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15758,"ondisk_log_size":15758,"up":64,"acting":59,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78436,"kb_used_data":20872,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94293404,"statfs":{"total":96636764160,"available":96556445696,"internally_reserved":0,"allocated":21372928,"data_stored":33129846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38428,"kb_used_data":11396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333412,"statfs":{"total":96636764160,"available":96597413888,"internally_reserved":0,"allocated":11669504,"data_stored":15802974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78036,"kb_used_data":20476,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94293804,"statfs":{"total":96636764160,"available":96556855296,"internally_reserved":0,"allocated":20967424,"data_stored":32917864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95504,"kb_used_data":32380,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94276336,"statfs":{"total":96636764160,"available":96538968064,"internally_reserved":0,"allocated":33157120,"data_stored":53333606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80276,"kb_used_data":18560,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94291564,"statfs":{"total":96636764160,"available":96554561536,"internally_reserved":0,"allocated":19005440,"data_stored":29374333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47500,"kb_used_data":16308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324340,"statfs":{"total":96636764160,"available":96588124160,"internally_reserved":0,"allocated":16699392,"data_stored":26378383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81448,"kb_used_data":27844,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94290392,"statfs":{"total":96636764160,"available":96553361408,"internally_reserved":0,"allocated":28512256,"data_stored":45372202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69616,"kb_used_data":12056,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302224,"statfs":{"total":96636764160,"available":96565477376,"internally_reserved":0,"allocated":12345344,"data_stored":17454779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9580544,"data_stored":15813555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26337280,"data_stored":44321327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14528512,"data_stored":25327527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":28317228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32784384,"data_stored":55667794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18792448,"data_stored":31866989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":14752118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18608128,"data_stored":31488622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:37:54.015 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:37:54.058 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:54.058 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:54.075 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:54.120 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:54.119+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:54.182 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:54.179+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:54.248 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:54.249 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:54.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:54.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:54.283 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:54.281+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:54.359 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:54.360 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:37:54.380 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-09-22T01:37:53.533093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":416787842,"num_objects":553,"num_object_clones":145,"num_object_copies":1106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":119,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":553,"num_whiteouts":195,"num_read":174508,"num_read_kb":935584,"num_write":17988,"num_write_kb":476875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5282,"num_bytes_recovered":326736674,"num_keys_recovered":831,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15878,"ondisk_log_size":15878,"up":82,"acting":77,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":569244,"kb_used_data":159892,"kb_used_omap":12,"kb_used_meta":408947,"kb_avail":754405476,"statfs":{"total":773094113280,"available":772511207424,"internally_reserved":0,"allocated":163729408,"data_stored":253763987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":418762288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-172782403,"num_objects":-97,"num_object_clones":-27,"num_object_copies":-194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":119,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":-97,"num_whiteouts":-36,"num_read":-20975,"num_read_kb":-97882,"num_write":-2812,"num_write_kb":-66887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-346,"num_bytes_recovered":-62994390,"num_keys_recovered":-161,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.996737"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":181,"state":"unknown","last_fresh":"2024-09-22T01:37:51.546219+0000","last_change":"2024-09-22T01:37:51.864886+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T01:37:51.546219+0000","last_undegraded":"2024-09-22T01:37:51.546219+0000","last_fullsized":"2024-09-22T01:37:51.546219+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"176'548","reported_seq":4617,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543298+0000","last_change":"2024-09-22T01:37:48.539173+0000","last_active":"2024-09-22T01:37:51.543298+0000","last_peered":"2024-09-22T01:37:51.543298+0000","last_clean":"2024-09-22T01:37:51.543298+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:37:51.543298+0000","last_undegraded":"2024-09-22T01:37:51.543298+0000","last_fullsized":"2024-09-22T01:37:51.543298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:36:06.748911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042030269999999998,"stat_sum":{"num_bytes":2695081,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":6073,"num_read_kb":47761,"num_write":575,"num_write_kb":23740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.1d","version":"176'996","reported_seq":3371,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548982+0000","last_change":"2024-09-22T01:37:48.547322+0000","last_active":"2024-09-22T01:37:51.548982+0000","last_peered":"2024-09-22T01:37:51.548982+0000","last_clean":"2024-09-22T01:37:51.548982+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:37:51.548982+0000","last_undegraded":"2024-09-22T01:37:51.548982+0000","last_fullsized":"2024-09-22T01:37:51.548982+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:55.069642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023410480000000001,"stat_sum":{"num_bytes":23588376,"num_objects":19,"num_object_clones":6,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":7,"num_read":5513,"num_read_kb":33890,"num_write":1512,"num_write_kb":16569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.1c","version":"180'282","reported_seq":2828,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548787+0000","last_change":"2024-09-22T01:37:48.546957+0000","last_active":"2024-09-22T01:37:51.548787+0000","last_peered":"2024-09-22T01:37:51.548787+0000","last_clean":"2024-09-22T01:37:51.548787+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:37:51.548787+0000","last_undegraded":"2024-09-22T01:37:51.548787+0000","last_fullsized":"2024-09-22T01:37:51.548787+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:13:55.690655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001977829,"stat_sum":{"num_bytes":7788443,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":2117,"num_read_kb":34965,"num_write":297,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":181,"state":"unknown","last_fresh":"2024-09-22T01:37:51.547497+0000","last_change":"2024-09-22T01:37:51.864826+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T01:37:51.547497+0000","last_undegraded":"2024-09-22T01:37:51.547497+0000","last_fullsized":"2024-09-22T01:37:51.547497+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"180'451","reported_seq":5197,"reported_epoch":181,"state":"creating+peering","last_fresh":"2024-09-22T01:37:51.410531+0000","last_change":"2024-09-22T01:37:51.864728+0000","last_active":"2024-09-22T01:37:51.864728+0000","last_peered":"2024-09-22T01:37:51.410531+0000","last_clean":"2024-09-22T01:37:47.755988+0000","last_became_active":"2024-09-22T01:37:50.588617+0000","last_became_peered":"2024-09-22T01:37:50.588617+0000","last_unstale":"2024-09-22T01:37:51.410531+0000","last_undegraded":"2024-09-22T01:37:51.410531+0000","last_fullsized":"2024-09-22T01:37:50.539805+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030239809999999998,"stat_sum":{"num_bytes":16542559,"num_objects":37,"num_object_clones":12,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":4733,"num_read_kb":40067,"num_write":476,"num_write_kb":25283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.19","version":"177'830","reported_seq":9497,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.539444+0000","last_change":"2024-09-22T01:37:48.541765+0000","last_active":"2024-09-22T01:37:51.539444+0000","last_peered":"2024-09-22T01:37:51.539444+0000","last_clean":"2024-09-22T01:37:51.539444+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:37:51.539444+0000","last_undegraded":"2024-09-22T01:37:51.539444+0000","last_fullsized":"2024-09-22T01:37:51.539444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:24.449134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011518660000000001,"stat_sum":{"num_bytes":25029118,"num_objects":27,"num_object_clones":10,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":7,"num_read":10611,"num_read_kb":63679,"num_write":1125,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.18","version":"177'939","reported_seq":3381,"reported_epoch":180,"state":"peering","last_fresh":"2024-09-22T01:37:50.541406+0000","last_change":"2024-09-22T01:37:51.543031+0000","last_active":"2024-09-22T01:37:51.543031+0000","last_peered":"2024-09-22T01:37:50.541406+0000","last_clean":"2024-09-22T01:37:50.541406+0000","last_became_active":"2024-09-22T01:37:43.538323+0000","last_became_peered":"2024-09-22T01:37:43.538323+0000","last_unstale":"2024-09-22T01:37:50.541406+0000","last_undegraded":"2024-09-22T01:37:50.541406+0000","last_fullsized":"2024-09-22T01:37:50.541406+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022849300000000001,"stat_sum":{"num_bytes":15537572,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1482,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":1799854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.17","version":"176'467","reported_seq":6003,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.546628+0000","last_change":"2024-09-22T01:37:48.540847+0000","last_active":"2024-09-22T01:37:51.546628+0000","last_peered":"2024-09-22T01:37:51.546628+0000","last_clean":"2024-09-22T01:37:51.546628+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:37:51.546628+0000","last_undegraded":"2024-09-22T01:37:51.546628+0000","last_fullsized":"2024-09-22T01:37:51.546628+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:16:45.391396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017429240000000001,"stat_sum":{"num_bytes":11533255,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":10,"num_read":5811,"num_read_kb":32153,"num_write":472,"num_write_kb":34048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.16","version":"180'682","reported_seq":14802,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.549162+0000","last_change":"2024-09-22T01:37:48.546647+0000","last_active":"2024-09-22T01:37:51.549162+0000","last_peered":"2024-09-22T01:37:51.549162+0000","last_clean":"2024-09-22T01:37:51.549162+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:37:51.549162+0000","last_undegraded":"2024-09-22T01:37:51.549162+0000","last_fullsized":"2024-09-22T01:37:51.549162+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:20:34.250218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017740340000000001,"stat_sum":{"num_bytes":18734673,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":7,"num_read":14786,"num_read_kb":34405,"num_write":695,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.15","version":"176'285","reported_seq":5019,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543142+0000","last_change":"2024-09-22T01:37:48.535365+0000","last_active":"2024-09-22T01:37:51.543142+0000","last_peered":"2024-09-22T01:37:51.543142+0000","last_clean":"2024-09-22T01:37:51.543142+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:37:51.543142+0000","last_undegraded":"2024-09-22T01:37:51.543142+0000","last_fullsized":"2024-09-22T01:37:51.543142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:20.002795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001191374,"stat_sum":{"num_bytes":7954426,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":5,"num_read":4129,"num_read_kb":34295,"num_write":242,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.14","version":"176'372","reported_seq":6329,"reported_epoch":181,"state":"peering","last_fresh":"2024-09-22T01:37:50.766467+0000","last_change":"2024-09-22T01:37:51.864777+0000","last_active":"2024-09-22T01:37:51.864777+0000","last_peered":"2024-09-22T01:37:50.766467+0000","last_clean":"2024-09-22T01:37:46.583022+0000","last_became_active":"2024-09-22T01:37:50.577732+0000","last_became_peered":"2024-09-22T01:37:50.577732+0000","last_unstale":"2024-09-22T01:37:50.766467+0000","last_undegraded":"2024-09-22T01:37:50.766467+0000","last_fullsized":"2024-09-22T01:37:50.766467+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.010038729,"stat_sum":{"num_bytes":8838399,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":6086,"num_read_kb":53973,"num_write":334,"num_write_kb":20591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":362,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.552938+0000","last_change":"2024-09-22T01:37:51.552938+0000","last_active":"2024-09-22T01:37:51.552938+0000","last_peered":"2024-09-22T01:37:51.552938+0000","last_clean":"2024-09-22T01:37:51.552938+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:37:51.552938+0000","last_undegraded":"2024-09-22T01:37:51.552938+0000","last_fullsized":"2024-09-22T01:37:51.552938+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:20.798595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":181,"state":"unknown","last_fresh":"2024-09-22T01:37:51.544828+0000","last_change":"2024-09-22T01:37:51.864865+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T01:37:51.544828+0000","last_undegraded":"2024-09-22T01:37:51.544828+0000","last_fullsized":"2024-09-22T01:37:51.544828+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":342,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.541274+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:37:51.541274+0000","last_peered":"2024-09-22T01:37:51.541274+0000","last_clean":"2024-09-22T01:37:51.541274+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:37:51.541274+0000","last_undegraded":"2024-09-22T01:37:51.541274+0000","last_fullsized":"2024-09-22T01:37:51.541274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"180'344","reported_seq":3432,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542801+0000","last_change":"2024-09-22T01:37:48.538123+0000","last_active":"2024-09-22T01:37:51.542801+0000","last_peered":"2024-09-22T01:37:51.542801+0000","last_clean":"2024-09-22T01:37:51.542801+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:37:51.542801+0000","last_undegraded":"2024-09-22T01:37:51.542801+0000","last_fullsized":"2024-09-22T01:37:51.542801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:48.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035216710000000001,"stat_sum":{"num_bytes":12168092,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":3428,"num_read_kb":20696,"num_write":334,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":227,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542997+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:37:51.542997+0000","last_peered":"2024-09-22T01:37:51.542997+0000","last_clean":"2024-09-22T01:37:51.542997+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:37:51.542997+0000","last_undegraded":"2024-09-22T01:37:51.542997+0000","last_fullsized":"2024-09-22T01:37:51.542997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"180'580","reported_seq":4027,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542084+0000","last_change":"2024-09-22T01:37:48.535316+0000","last_active":"2024-09-22T01:37:51.542084+0000","last_peered":"2024-09-22T01:37:51.542084+0000","last_clean":"2024-09-22T01:37:51.542084+0000","last_became_active":"2024-09-22T01:36:12.660207+0000","last_became_peered":"2024-09-22T01:36:12.660207+0000","last_unstale":"2024-09-22T01:37:51.542084+0000","last_undegraded":"2024-09-22T01:37:51.542084+0000","last_fullsized":"2024-09-22T01:37:51.542084+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:06.525388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000657666,"stat_sum":{"num_bytes":18624456,"num_objects":21,"num_object_clones":6,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":5387,"num_read_kb":37627,"num_write":601,"num_write_kb":11226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":210,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.545366+0000","last_change":"2024-09-22T01:36:03.520390+0000","last_active":"2024-09-22T01:37:51.545366+0000","last_peered":"2024-09-22T01:37:51.545366+0000","last_clean":"2024-09-22T01:37:51.545366+0000","last_became_active":"2024-09-22T01:36:03.519493+0000","last_became_peered":"2024-09-22T01:36:03.519493+0000","last_unstale":"2024-09-22T01:37:51.545366+0000","last_undegraded":"2024-09-22T01:37:51.545366+0000","last_fullsized":"2024-09-22T01:37:51.545366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:25:49.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"177'499","reported_seq":8055,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.549372+0000","last_change":"2024-09-22T01:37:48.547887+0000","last_active":"2024-09-22T01:37:51.549372+0000","last_peered":"2024-09-22T01:37:51.549372+0000","last_clean":"2024-09-22T01:37:51.549372+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:37:51.549372+0000","last_undegraded":"2024-09-22T01:37:51.549372+0000","last_fullsized":"2024-09-22T01:37:51.549372+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:22.405721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002476813,"stat_sum":{"num_bytes":28212283,"num_objects":17,"num_object_clones":5,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":7,"num_read":8474,"num_read_kb":54218,"num_write":518,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.3","version":"180'354","reported_seq":1546,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.545558+0000","last_change":"2024-09-22T01:37:48.540415+0000","last_active":"2024-09-22T01:37:51.545558+0000","last_peered":"2024-09-22T01:37:51.545558+0000","last_clean":"2024-09-22T01:37:51.545558+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:37:51.545558+0000","last_undegraded":"2024-09-22T01:37:51.545558+0000","last_fullsized":"2024-09-22T01:37:51.545558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:16:39.950874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017922140000000001,"stat_sum":{"num_bytes":2969902,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":9,"num_read":1403,"num_read_kb":6358,"num_write":331,"num_write_kb":3538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.2","version":"20'2","reported_seq":90,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548547+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:37:51.548547+0000","last_peered":"2024-09-22T01:37:51.548547+0000","last_clean":"2024-09-22T01:37:51.548547+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:37:51.548547+0000","last_undegraded":"2024-09-22T01:37:51.548547+0000","last_fullsized":"2024-09-22T01:37:51.548547+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"177'501","reported_seq":3876,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.540491+0000","last_change":"2024-09-22T01:37:48.542715+0000","last_active":"2024-09-22T01:37:51.540491+0000","last_peered":"2024-09-22T01:37:51.540491+0000","last_clean":"2024-09-22T01:37:51.540491+0000","last_became_active":"2024-09-22T01:36:39.852969+0000","last_became_peered":"2024-09-22T01:36:39.852969+0000","last_unstale":"2024-09-22T01:37:51.540491+0000","last_undegraded":"2024-09-22T01:37:51.540491+0000","last_fullsized":"2024-09-22T01:37:51.540491+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:31.969186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018044070000000001,"stat_sum":{"num_bytes":524358,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":4,"num_read":4313,"num_read_kb":14844,"num_write":507,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":198,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.541782+0000","last_change":"2024-09-22T01:36:09.627096+0000","last_active":"2024-09-22T01:37:51.541782+0000","last_peered":"2024-09-22T01:37:51.541782+0000","last_clean":"2024-09-22T01:37:51.541782+0000","last_became_active":"2024-09-22T01:36:09.626669+0000","last_became_peered":"2024-09-22T01:36:09.626669+0000","last_unstale":"2024-09-22T01:37:51.541782+0000","last_undegraded":"2024-09-22T01:37:51.541782+0000","last_fullsized":"2024-09-22T01:37:51.541782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:35.787005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"176'530","reported_seq":5115,"reported_epoch":181,"state":"active+undersized+remapped","last_fresh":"2024-09-22T01:37:51.814198+0000","last_change":"2024-09-22T01:37:51.814509+0000","last_active":"2024-09-22T01:37:51.814198+0000","last_peered":"2024-09-22T01:37:51.814198+0000","last_clean":"2024-09-22T01:37:47.573048+0000","last_became_active":"2024-09-22T01:37:50.595228+0000","last_became_peered":"2024-09-22T01:37:50.595228+0000","last_unstale":"2024-09-22T01:37:51.814198+0000","last_undegraded":"2024-09-22T01:37:51.814198+0000","last_fullsized":"2024-09-22T01:37:50.538093+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069905800000000001,"stat_sum":{"num_bytes":18717319,"num_objects":26,"num_object_clones":5,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":12,"num_read":5023,"num_read_kb":25952,"num_write":559,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0","objects":26}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":222,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542801+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:37:51.542801+0000","last_peered":"2024-09-22T01:37:51.542801+0000","last_clean":"2024-09-22T01:37:51.542801+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:37:51.542801+0000","last_undegraded":"2024-09-22T01:37:51.542801+0000","last_fullsized":"2024-09-22T01:37:51.542801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"177'449","reported_seq":2621,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543147+0000","last_change":"2024-09-22T01:37:48.537694+0000","last_active":"2024-09-22T01:37:51.543147+0000","last_peered":"2024-09-22T01:37:51.543147+0000","last_clean":"2024-09-22T01:37:51.543147+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:37:51.543147+0000","last_undegraded":"2024-09-22T01:37:51.543147+0000","last_fullsized":"2024-09-22T01:37:51.543147+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:14.442267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003111436,"stat_sum":{"num_bytes":13796531,"num_objects":17,"num_object_clones":4,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":8,"num_read":2669,"num_read_kb":16189,"num_write":482,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.3","version":"18'1","reported_seq":90,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548685+0000","last_change":"2024-09-22T01:37:13.533524+0000","last_active":"2024-09-22T01:37:51.548685+0000","last_peered":"2024-09-22T01:37:51.548685+0000","last_clean":"2024-09-22T01:37:51.548685+0000","last_became_active":"2024-09-22T01:37:13.529493+0000","last_became_peered":"2024-09-22T01:37:13.529493+0000","last_unstale":"2024-09-22T01:37:51.548685+0000","last_undegraded":"2024-09-22T01:37:51.548685+0000","last_fullsized":"2024-09-22T01:37:51.548685+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:07.459369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":470,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542802+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:37:51.542802+0000","last_peered":"2024-09-22T01:37:51.542802+0000","last_clean":"2024-09-22T01:37:51.542802+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:37:51.542802+0000","last_undegraded":"2024-09-22T01:37:51.542802+0000","last_fullsized":"2024-09-22T01:37:51.542802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"176'697","reported_seq":2592,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542667+0000","last_change":"2024-09-22T01:37:48.535801+0000","last_active":"2024-09-22T01:37:51.542667+0000","last_peered":"2024-09-22T01:37:51.542667+0000","last_clean":"2024-09-22T01:37:51.542667+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:37:51.542667+0000","last_undegraded":"2024-09-22T01:37:51.542667+0000","last_fullsized":"2024-09-22T01:37:51.542667+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:26.049464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027203010000000001,"stat_sum":{"num_bytes":11225033,"num_objects":15,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":7,"num_read":7235,"num_read_kb":52541,"num_write":878,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.9","version":"177'437","reported_seq":5691,"reported_epoch":181,"state":"active+undersized+remapped","last_fresh":"2024-09-22T01:37:51.644251+0000","last_change":"2024-09-22T01:37:51.644728+0000","last_active":"2024-09-22T01:37:51.644251+0000","last_peered":"2024-09-22T01:37:51.644251+0000","last_clean":"2024-09-22T01:37:47.578664+0000","last_became_active":"2024-09-22T01:37:50.594489+0000","last_became_peered":"2024-09-22T01:37:50.594489+0000","last_unstale":"2024-09-22T01:37:51.644251+0000","last_undegraded":"2024-09-22T01:37:51.644251+0000","last_fullsized":"2024-09-22T01:37:50.536018+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0042522649999999999,"stat_sum":{"num_bytes":15069870,"num_objects":11,"num_object_clones":2,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":4359,"num_read_kb":53913,"num_write":442,"num_write_kb":17684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":396,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[2],"avail_no_missing":["2","4","7"],"object_location_counts":[{"shards":"2","objects":11}],"blocked_by":[],"up_primary":4,"acting_primary":2,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.a","version":"180'590","reported_seq":14369,"reported_epoch":181,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-09-22T01:37:51.859174+0000","last_change":"2024-09-22T01:37:51.815651+0000","last_active":"2024-09-22T01:37:51.859174+0000","last_peered":"2024-09-22T01:37:51.859174+0000","last_clean":"2024-09-22T01:37:47.723359+0000","last_became_active":"2024-09-22T01:37:50.590866+0000","last_became_peered":"2024-09-22T01:37:50.590866+0000","last_unstale":"2024-09-22T01:37:51.859174+0000","last_undegraded":"2024-09-22T01:37:50.545169+0000","last_fullsized":"2024-09-22T01:37:50.540427+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.0097751890000000001,"stat_sum":{"num_bytes":16882979,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":5,"num_read":15441,"num_read_kb":20475,"num_write":563,"num_write_kb":18763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":2277723,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6],"avail_no_missing":["6","1"],"object_location_counts":[{"shards":"1,6","objects":6},{"shards":"6","objects":11}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.b","version":"176'406","reported_seq":3076,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543165+0000","last_change":"2024-09-22T01:37:48.536960+0000","last_active":"2024-09-22T01:37:51.543165+0000","last_peered":"2024-09-22T01:37:51.543165+0000","last_clean":"2024-09-22T01:37:51.543165+0000","last_became_active":"2024-09-22T01:36:49.518943+0000","last_became_peered":"2024-09-22T01:36:49.518943+0000","last_unstale":"2024-09-22T01:37:51.543165+0000","last_undegraded":"2024-09-22T01:37:51.543165+0000","last_fullsized":"2024-09-22T01:37:51.543165+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:00:41.579102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024692009999999999,"stat_sum":{"num_bytes":4099760,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":8,"num_read":2659,"num_read_kb":14205,"num_write":475,"num_write_kb":9044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":11703594,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.c","version":"180'533","reported_seq":5855,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548829+0000","last_change":"2024-09-22T01:37:48.548321+0000","last_active":"2024-09-22T01:37:51.548829+0000","last_peered":"2024-09-22T01:37:51.548829+0000","last_clean":"2024-09-22T01:37:51.548829+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:37:51.548829+0000","last_undegraded":"2024-09-22T01:37:51.548829+0000","last_fullsized":"2024-09-22T01:37:51.548829+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:51:08.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027825319999999999,"stat_sum":{"num_bytes":56776707,"num_objects":26,"num_object_clones":8,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":11,"num_read":6959,"num_read_kb":34783,"num_write":506,"num_write_kb":16252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.d","version":"176'491","reported_seq":4861,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543233+0000","last_change":"2024-09-22T01:37:48.536859+0000","last_active":"2024-09-22T01:37:51.543233+0000","last_peered":"2024-09-22T01:37:51.543233+0000","last_clean":"2024-09-22T01:37:51.543233+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:37:51.543233+0000","last_undegraded":"2024-09-22T01:37:51.543233+0000","last_fullsized":"2024-09-22T01:37:51.543233+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:39.336341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002219642,"stat_sum":{"num_bytes":7690004,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":5,"num_read":5594,"num_read_kb":19915,"num_write":540,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.e","version":"176'692","reported_seq":4470,"reported_epoch":180,"state":"peering","last_fresh":"2024-09-22T01:37:51.032018+0000","last_change":"2024-09-22T01:37:51.544317+0000","last_active":"2024-09-22T01:37:51.544317+0000","last_peered":"2024-09-22T01:37:51.032018+0000","last_clean":"2024-09-22T01:37:47.585064+0000","last_became_active":"2024-09-22T01:37:50.584688+0000","last_became_peered":"2024-09-22T01:37:50.584688+0000","last_unstale":"2024-09-22T01:37:51.032018+0000","last_undegraded":"2024-09-22T01:37:51.032018+0000","last_fullsized":"2024-09-22T01:37:50.545894+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041511589999999998,"stat_sum":{"num_bytes":10453121,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":9,"num_read":4545,"num_read_kb":18606,"num_write":873,"num_write_kb":13177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.f","version":"177'706","reported_seq":3513,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543132+0000","last_change":"2024-09-22T01:37:48.536256+0000","last_active":"2024-09-22T01:37:51.543132+0000","last_peered":"2024-09-22T01:37:51.543132+0000","last_clean":"2024-09-22T01:37:51.543132+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:37:51.543132+0000","last_undegraded":"2024-09-22T01:37:51.543132+0000","last_fullsized":"2024-09-22T01:37:51.543132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:45.344182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014644250000000001,"stat_sum":{"num_bytes":11983340,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":5529,"num_read_kb":24698,"num_write":871,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.10","version":"176'658","reported_seq":2900,"reported_epoch":180,"state":"peering","last_fresh":"2024-09-22T01:37:50.722099+0000","last_change":"2024-09-22T01:37:51.546148+0000","last_active":"2024-09-22T01:37:51.546148+0000","last_peered":"2024-09-22T01:37:50.722099+0000","last_clean":"2024-09-22T01:37:50.722099+0000","last_became_active":"2024-09-22T01:37:44.543325+0000","last_became_peered":"2024-09-22T01:37:44.543325+0000","last_unstale":"2024-09-22T01:37:50.722099+0000","last_undegraded":"2024-09-22T01:37:50.722099+0000","last_fullsized":"2024-09-22T01:37:50.722099+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001021098,"stat_sum":{"num_bytes":3145933,"num_objects":17,"num_object_clones":3,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":7,"num_read":4252,"num_read_kb":14328,"num_write":755,"num_write_kb":16255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":5983349,"num_keys_recovered":82,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.11","version":"176'369","reported_seq":5693,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542851+0000","last_change":"2024-09-22T01:37:48.533834+0000","last_active":"2024-09-22T01:37:51.542851+0000","last_peered":"2024-09-22T01:37:51.542851+0000","last_clean":"2024-09-22T01:37:51.542851+0000","last_became_active":"2024-09-22T01:36:01.562260+0000","last_became_peered":"2024-09-22T01:36:01.562260+0000","last_unstale":"2024-09-22T01:37:51.542851+0000","last_undegraded":"2024-09-22T01:37:51.542851+0000","last_fullsized":"2024-09-22T01:37:51.542851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:36.473124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094419899999999995,"stat_sum":{"num_bytes":17174553,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":10,"num_read":4797,"num_read_kb":46848,"num_write":325,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.12","version":"176'455","reported_seq":4853,"reported_epoch":180,"state":"remapped+peering","last_fresh":"2024-09-22T01:37:50.538963+0000","last_change":"2024-09-22T01:37:51.548785+0000","last_active":"2024-09-22T01:37:50.538963+0000","last_peered":"2024-09-22T01:37:49.539067+0000","last_clean":"2024-09-22T01:37:49.539067+0000","last_became_active":"2024-09-22T01:37:44.539460+0000","last_became_peered":"2024-09-22T01:37:44.539460+0000","last_unstale":"2024-09-22T01:37:50.538963+0000","last_undegraded":"2024-09-22T01:37:50.538963+0000","last_fullsized":"2024-09-22T01:37:50.538963+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00227261,"stat_sum":{"num_bytes":11141166,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":7,"num_read":4779,"num_read_kb":18742,"num_write":513,"num_write_kb":10270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":7299962,"num_keys_recovered":55,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.13","version":"176'615","reported_seq":11103,"reported_epoch":181,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-22T01:37:51.543323+0000","last_change":"2024-09-22T01:37:50.595095+0000","last_active":"2024-09-22T01:37:51.543323+0000","last_peered":"2024-09-22T01:37:51.543323+0000","last_clean":"2024-09-22T01:37:47.581611+0000","last_became_active":"2024-09-22T01:37:50.593598+0000","last_became_peered":"2024-09-22T01:37:50.593598+0000","last_unstale":"2024-09-22T01:37:51.543323+0000","last_undegraded":"2024-09-22T01:37:50.551282+0000","last_fullsized":"2024-09-22T01:37:50.545774+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016052340000000001,"stat_sum":{"num_bytes":17300146,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":118,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":6,"num_read":12247,"num_read_kb":47208,"num_write":544,"num_write_kb":13751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":8676658,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7],"avail_no_missing":["7","2"],"object_location_counts":[{"shards":"2,7","objects":25}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"11","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":416197455,"num_objects":549,"num_object_clones":145,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":119,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":195,"num_read":174392,"num_read_kb":935484,"num_write":17827,"num_write_kb":474457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5271,"num_bytes_recovered":325555900,"num_keys_recovered":831,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146952192,"data_stored":247555160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15758,"ondisk_log_size":15758,"up":64,"acting":59,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78436,"kb_used_data":20872,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94293404,"statfs":{"total":96636764160,"available":96556445696,"internally_reserved":0,"allocated":21372928,"data_stored":33129846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38428,"kb_used_data":11396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333412,"statfs":{"total":96636764160,"available":96597413888,"internally_reserved":0,"allocated":11669504,"data_stored":15802974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78036,"kb_used_data":20476,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94293804,"statfs":{"total":96636764160,"available":96556855296,"internally_reserved":0,"allocated":20967424,"data_stored":32917864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95504,"kb_used_data":32380,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94276336,"statfs":{"total":96636764160,"available":96538968064,"internally_reserved":0,"allocated":33157120,"data_stored":53333606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80276,"kb_used_data":18560,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94291564,"statfs":{"total":96636764160,"available":96554561536,"internally_reserved":0,"allocated":19005440,"data_stored":29374333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47500,"kb_used_data":16308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324340,"statfs":{"total":96636764160,"available":96588124160,"internally_reserved":0,"allocated":16699392,"data_stored":26378383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81448,"kb_used_data":27844,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94290392,"statfs":{"total":96636764160,"available":96553361408,"internally_reserved":0,"allocated":28512256,"data_stored":45372202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69616,"kb_used_data":12056,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302224,"statfs":{"total":96636764160,"available":96565477376,"internally_reserved":0,"allocated":12345344,"data_stored":17454779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9580544,"data_stored":15813555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26337280,"data_stored":44321327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14528512,"data_stored":25327527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":28317228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32784384,"data_stored":55667794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18792448,"data_stored":31866989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":14752118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18608128,"data_stored":31488622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:37:54.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-22T01:37:54.384 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:54.381+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:54.397 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:54.397 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:54.414 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:54.425 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:54.425 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:54.425 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:54.425 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:54.425 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:54.433 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:54.441 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:54.451 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:54.451 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:54.476 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:54.476 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:54.484 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:54.483+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:54.496 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:54.497 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:54.517 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:54.517 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:54.548 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:54.548 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:54.584 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:54.584 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:54.584 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:54.584 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:54.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.584 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72742 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3389440~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.78158392899999, 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0590001280000001, 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72742 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:54.585 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800086+0000", 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8500000000000001e-07 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800090+0000", 2024-09-22T01:37:54.586 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5750000000000001e-06 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800101+0000", 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0861e-05 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800108+0000", 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6969999999999993e-06 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800209+0000", 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100293 2024-09-22T01:37:54.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800214+0000", 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9510000000000003e-06 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809693+0000", 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009478264 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809700+0000", 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1330000000000001e-06 2024-09-22T01:37:54.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858899+0000", 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0491990499999999 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.858989+0000", 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0431000000000002e-05 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859086+0000", 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6287999999999997e-05 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.589 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72743 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3401728~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.781528753, 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0595735259999999, 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.590 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72743 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.591 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800141+0000", 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2399999999999997e-07 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800146+0000", 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5040000000000004e-06 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800167+0000", 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.1248000000000001e-05 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.592 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800178+0000", 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0587999999999999e-05 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800259+0000", 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1326e-05 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800275+0000", 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5645e-05 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.593 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809724+0000", 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.009449652 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809733+0000", 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2160000000000006e-06 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859146+0000", 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.049413567 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859364+0000", 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00021791900000000001 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859714+0000", 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035013699999999999 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.595 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72744 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3414016~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.78146364, 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0597362559999999, 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72744 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.596 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800206+0000", 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6499999999999999e-07 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.597 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800218+0000", 2024-09-22T01:37:54.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1746000000000001e-05 2024-09-22T01:37:54.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.598 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800232+0000", 2024-09-22T01:37:54.598 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3686000000000001e-05 2024-09-22T01:37:54.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.598 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800242+0000", 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.73e-06 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800314+0000", 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2176999999999997e-05 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800326+0000", 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1952e-05 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.599 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809758+0000", 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094318689999999 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809766+0000", 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0499999999999992e-06 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859763+0000", 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0499976660000001 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.600 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859846+0000", 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2528000000000007e-05 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859942+0000", 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6187000000000006e-05 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72745 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3426304~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:54.601 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.78139789299999, 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.059899723, 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72745 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:54.602 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800272+0000", 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3300000000000001e-07 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.603 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800277+0000", 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6090000000000003e-06 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800288+0000", 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1165000000000001e-05 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800297+0000", 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6139999999999992e-06 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800367+0000", 2024-09-22T01:37:54.604 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0664e-05 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800379+0000", 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1491999999999999e-05 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809791+0000", 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.00941215 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.605 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809799+0000", 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6599999999999995e-06 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.859970+0000", 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0501710449999999 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860065+0000", 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877999999999995e-05 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.606 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860171+0000", 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010671300000000001 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72746 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3438592~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.781360423, 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060494185, 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.607 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72746 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800309+0000", 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800310+0000", 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3200000000000005e-07 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800313+0000", 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7349999999999998e-06 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800323+0000", 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0043e-05 2024-09-22T01:37:54.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800331+0000", 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7859999999999997e-06 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800415+0000", 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3387999999999995e-05 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800424+0000", 2024-09-22T01:37:54.610 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9430000000000006e-06 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809825+0000", 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0094010529999999 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809833+0000", 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2449999999999998e-06 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.611 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860229+0000", 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0503958419999999 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860454+0000", 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00022494100000000001 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860803+0000", 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000349577 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72747 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3450880~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.78130980700001, 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0606449690000002, 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72747 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.613 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800360+0000", 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9500000000000001e-07 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.800365+0000", 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.4569999999999998e-06 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801513+0000", 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0011482409999999999 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801523+0000", 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0101e-05 2024-09-22T01:37:54.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801600+0000", 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6508000000000007e-05 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801611+0000", 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1049999999999999e-05 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809857+0000", 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082460200000001 2024-09-22T01:37:54.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809865+0000", 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0080000000000002e-06 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860856+0000", 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0509911329999999 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.860912+0000", 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.6505999999999997e-05 2024-09-22T01:37:54.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861005+0000", 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2150000000000004e-05 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72748 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3463168~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.780124468, 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0600511140000002, 2024-09-22T01:37:54.618 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72748 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.619 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801545+0000", 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801546+0000", 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5009999999999999e-06 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801553+0000", 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.8349999999999998e-06 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801564+0000", 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0764999999999999e-05 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801573+0000", 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4989999999999994e-06 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801648+0000", 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5844000000000001e-05 2024-09-22T01:37:54.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801657+0000", 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6200000000000005e-06 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809894+0000", 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008237238 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809902+0000", 2024-09-22T01:37:54.622 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8609999999999998e-06 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861058+0000", 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0511553769999999 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861247+0000", 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00018993499999999999 2024-09-22T01:37:54.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861596+0000", 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00034863899999999998 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72749 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3475456~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.780062641, 2024-09-22T01:37:54.624 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0601792489999999, 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72749 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801607+0000", 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801608+0000", 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4600000000000004e-07 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.626 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801612+0000", 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.6940000000000003e-06 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801626+0000", 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3844e-05 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801635+0000", 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6719999999999993e-06 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801709+0000", 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3900999999999996e-05 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801724+0000", 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5637999999999998e-05 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809926+0000", 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082021080000001 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.628 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809935+0000", 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.704e-06 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861639+0000", 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0517034439999999 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861693+0000", 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4870000000000002e-05 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.629 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861786+0000", 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2627999999999995e-05 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72750 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3487744~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.78001384199999, 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603018469999999, 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.630 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72750 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:54.631 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801656+0000", 2024-09-22T01:37:54.632 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8100000000000002e-07 2024-09-22T01:37:54.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.632 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.632 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801660+0000", 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9870000000000001e-06 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801671+0000", 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0694e-05 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801680+0000", 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.285e-06 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.633 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801779+0000", 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8752000000000006e-05 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801795+0000", 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5812e-05 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809963+0000", 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081685600000001 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809971+0000", 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.9410000000000007e-06 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861804+0000", 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051832264 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861866+0000", 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1867999999999998e-05 2024-09-22T01:37:54.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861957+0000", 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1903000000000004e-05 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72751 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3500032~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.779940289, 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0603804569999999, 2024-09-22T01:37:54.636 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72751 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.637 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801729+0000", 2024-09-22T01:37:54.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.638 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801730+0000", 2024-09-22T01:37:54.638 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.37e-07 2024-09-22T01:37:54.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.638 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801735+0000", 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8239999999999999e-06 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801747+0000", 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2233e-05 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801756+0000", 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4199999999999996e-06 2024-09-22T01:37:54.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801840+0000", 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3868000000000004e-05 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801847+0000", 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6630000000000004e-06 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.640 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.809997+0000", 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0081499709999999 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810007+0000", 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8749999999999995e-06 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.861974+0000", 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.051966851 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.641 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862025+0000", 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1416999999999999e-05 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862110+0000", 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4598000000000006e-05 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72752 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3512320~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.642 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.779869827, 2024-09-22T01:37:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0605375779999999, 2024-09-22T01:37:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72752 2024-09-22T01:37:54.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.644 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.644 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.644 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:54.644 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801800+0000", 2024-09-22T01:37:54.645 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.645 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.645 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801801+0000", 2024-09-22T01:37:54.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.5710000000000001e-06 2024-09-22T01:37:54.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.646 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.646 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801808+0000", 2024-09-22T01:37:54.646 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3139999999999998e-06 2024-09-22T01:37:54.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801829+0000", 2024-09-22T01:37:54.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0562999999999999e-05 2024-09-22T01:37:54.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.647 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.647 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801843+0000", 2024-09-22T01:37:54.647 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.347e-05 2024-09-22T01:37:54.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.648 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801927+0000", 2024-09-22T01:37:54.648 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4797999999999997e-05 2024-09-22T01:37:54.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.648 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801948+0000", 2024-09-22T01:37:54.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0293e-05 2024-09-22T01:37:54.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.649 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.649 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810282+0000", 2024-09-22T01:37:54.649 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008334117 2024-09-22T01:37:54.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.650 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810288+0000", 2024-09-22T01:37:54.650 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2639999999999997e-06 2024-09-22T01:37:54.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.650 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862142+0000", 2024-09-22T01:37:54.651 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0518544110000001 2024-09-22T01:37:54.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.651 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.651 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862211+0000", 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9059000000000004e-05 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862337+0000", 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125718 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72753 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3524608~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:54.652 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.77979932400001, 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.060690701, 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72753 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801870+0000", 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801871+0000", 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1699999999999997e-07 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.654 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801876+0000", 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9030000000000003e-06 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801889+0000", 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.341e-05 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801899+0000", 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5470000000000002e-06 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801984+0000", 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4788000000000002e-05 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801990+0000", 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0079999999999999e-06 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810315+0000", 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008325592 2024-09-22T01:37:54.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810324+0000", 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4470000000000006e-06 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862366+0000", 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0520428310000001 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862467+0000", 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000100988 2024-09-22T01:37:54.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862561+0000", 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3369999999999995e-05 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72754 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3536896~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:54.658 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.779752092, 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0608454420000002, 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72754 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:54.659 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801917+0000", 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801918+0000", 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1200000000000003e-07 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801922+0000", 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.754e-06 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801933+0000", 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1311999999999999e-05 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801955+0000", 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.2192e-05 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802013+0000", 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.7599000000000002e-05 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802019+0000", 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5699999999999998e-06 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810350+0000", 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008331012 2024-09-22T01:37:54.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810359+0000", 2024-09-22T01:37:54.663 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.2199999999999992e-06 2024-09-22T01:37:54.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.663 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.663 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862587+0000", 2024-09-22T01:37:54.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0522286169999999 2024-09-22T01:37:54.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.664 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.664 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862659+0000", 2024-09-22T01:37:54.664 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1717000000000005e-05 2024-09-22T01:37:54.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.665 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.665 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862763+0000", 2024-09-22T01:37:54.665 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000103837 2024-09-22T01:37:54.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.665 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72755 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3549184~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.77968921600001, 2024-09-22T01:37:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0610013540000001, 2024-09-22T01:37:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.666 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72755 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801980+0000", 2024-09-22T01:37:54.667 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801981+0000", 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6199999999999997e-07 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801985+0000", 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1280000000000001e-06 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.668 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.801997+0000", 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2033e-05 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802006+0000", 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1020000000000003e-06 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802038+0000", 2024-09-22T01:37:54.669 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2147000000000002e-05 2024-09-22T01:37:54.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802043+0000", 2024-09-22T01:37:54.670 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2719999999999999e-06 2024-09-22T01:37:54.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.670 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.670 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810385+0000", 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0083421370000001 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810391+0000", 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9050000000000002e-06 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862790+0000", 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0523994290000001 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.671 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862887+0000", 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.6465000000000006e-05 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.862982+0000", 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5074000000000005e-05 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72756 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3561472~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:54.672 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.77964854999999, 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0611677749999999, 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72756 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.673 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802021+0000", 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9999999999999997e-07 2024-09-22T01:37:54.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802067+0000", 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.5216000000000002e-05 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802085+0000", 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7886000000000001e-05 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802094+0000", 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8609999999999993e-06 2024-09-22T01:37:54.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802131+0000", 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.6477999999999999e-05 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802135+0000", 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0280000000000002e-06 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810422+0000", 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082871529999999 2024-09-22T01:37:54.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810431+0000", 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4570000000000005e-06 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863008+0000", 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0525770640000001 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863084+0000", 2024-09-22T01:37:54.677 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6769999999999999e-05 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863189+0000", 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000104262 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72757 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3573760~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.77955368299999, 2024-09-22T01:37:54.678 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0612916750000001, 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72757 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:54.679 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802116+0000", 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802117+0000", 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7899999999999997e-07 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.680 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802121+0000", 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2019999999999997e-06 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802132+0000", 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1107000000000001e-05 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802141+0000", 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0520000000000007e-06 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.681 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802174+0000", 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.3210000000000002e-05 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802178+0000", 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810458+0000", 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082802689999999 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.682 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810467+0000", 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5189999999999992e-06 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863216+0000", 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.052749495 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863314+0000", 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7485999999999995e-05 2024-09-22T01:37:54.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863407+0000", 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3630999999999999e-05 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72758 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3586048~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.779512646, 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0614447070000002, 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.684 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72758 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802157+0000", 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9399999999999995e-07 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802161+0000", 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5470000000000001e-06 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802172+0000", 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0974e-05 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802180+0000", 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6260000000000001e-06 2024-09-22T01:37:54.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802221+0000", 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.0405999999999999e-05 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802231+0000", 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0519999999999999e-05 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810496+0000", 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008264184 2024-09-22T01:37:54.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810505+0000", 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.9709999999999993e-06 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863433+0000", 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0529282170000001 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.689 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863502+0000", 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9432999999999997e-05 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863601+0000", 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9334999999999997e-05 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.690 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72759 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3598336~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.779475155, 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061621777, 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72759 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.691 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802194+0000", 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802195+0000", 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.2900000000000004e-07 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.692 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802198+0000", 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.569e-06 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802209+0000", 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0559e-05 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802220+0000", 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0675e-05 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.693 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802284+0000", 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3991000000000004e-05 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802296+0000", 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2461e-05 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810530+0000", 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008233997 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810538+0000", 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3210000000000005e-06 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863629+0000", 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053090179 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863723+0000", 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4877000000000007e-05 2024-09-22T01:37:54.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863816+0000", 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2619000000000002e-05 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72760 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3610624~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.779435006, 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.0617889859999998, 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72760 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.697 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802234+0000", 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802235+0000", 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4899999999999995e-07 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802239+0000", 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.9319999999999998e-06 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802251+0000", 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2357999999999999e-05 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802260+0000", 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.7809999999999994e-06 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.699 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802333+0000", 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2711000000000002e-05 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802345+0000", 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2391999999999999e-05 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810565+0000", 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.008219985 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.700 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810573+0000", 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0739999999999993e-06 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863841+0000", 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0532682289999999 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.863912+0000", 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0708000000000001e-05 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.701 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864023+0000", 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000111267 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:72761 3.6 3:6370a313:::rbd_data.110f9cb308d1.0000000000000004:11 [read 3622912~1024] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 145.77939221099999, 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.061967992, 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:54.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 72761 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.703 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802277+0000", 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802278+0000", 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8100000000000003e-07 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802282+0000", 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7479999999999999e-06 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:54.704 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802293+0000", 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1e-05 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802301+0000", 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.276e-06 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802378+0000", 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6966999999999997e-05 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.705 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:28.802390+0000", 2024-09-22T01:37:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1841000000000001e-05 2024-09-22T01:37:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810597+0000", 2024-09-22T01:37:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0082069389999999 2024-09-22T01:37:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:54.706 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:29.810605+0000", 2024-09-22T01:37:54.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.3979999999999999e-06 2024-09-22T01:37:54.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:54.707 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864052+0000", 2024-09-22T01:37:54.707 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.053446565 2024-09-22T01:37:54.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.707 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:54.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864151+0000", 2024-09-22T01:37:54.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9176e-05 2024-09-22T01:37:54.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:54.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:54.708 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:54.708 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:30.864245+0000", 2024-09-22T01:37:54.708 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4500999999999995e-05 2024-09-22T01:37:54.708 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.709 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.709 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:54.709 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:54.709 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:54.711 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:54.711 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:54.707+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:54.743 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:54.744 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"2d4626ba-577e-46d9-ad53-8451e5733f43","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"nodeep-scrub flag(s) set","count":12},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 119/1106 objects degraded (10.759%), 2 pgs degraded","count":2},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":215,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":184,"num_osds":8,"num_up_osds":8,"osd_up_since":1726968871,"num_in_osds":8,"osd_in_since":1726969032,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":28},{"state_name":"peering","count":4},{"state_name":"unknown","count":3},{"state_name":"active+undersized+remapped","count":2},{"state_name":"remapped+peering","count":1},{"state_name":"active+recovering+undersized+degraded+remapped","count":1},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":1},{"state_name":"creating+peering","count":1}],"num_pgs":41,"num_pools":3,"num_objects":553,"data_bytes":416787842,"bytes_used":582905856,"bytes_avail":772511207424,"bytes_total":773094113280,"unknown_pgs_ratio":0.073170728981494904,"inactive_pgs_ratio":0.14634145796298981,"degraded_objects":119,"degraded_total":1106,"degraded_ratio":0.10759493670886076,"misplaced_objects":6,"misplaced_total":1106,"misplaced_ratio":0.0054249547920433997},"fsmap":{"epoch":1,"btime":"2024-09-22T01:34:18:722339+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-22T01:35:25.389415+0000","services":{"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-22T01:37:54.762 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-22T01:37:54.762 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:37:54.811 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:54.809+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:54.853 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:54.853 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:54.853 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:54.867 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:54.912 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:54.911+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:54.986 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:54.986 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:54.987 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:54.987 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:54.987 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:55.000 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:55.044 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:55.043+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:55.093 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:55.093 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:37:55.111 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-22T01:37:54.534998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":416787842,"num_objects":553,"num_object_clones":145,"num_object_copies":1106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":119,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":553,"num_whiteouts":195,"num_read":174508,"num_read_kb":935584,"num_write":17988,"num_write_kb":476875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5282,"num_bytes_recovered":326736674,"num_keys_recovered":831,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15878,"ondisk_log_size":15878,"up":82,"acting":77,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":569244,"kb_used_data":159892,"kb_used_omap":12,"kb_used_meta":408947,"kb_avail":754405476,"statfs":{"total":773094113280,"available":772511207424,"internally_reserved":0,"allocated":163729408,"data_stored":253763987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":418762288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-172782403,"num_objects":-97,"num_object_clones":-27,"num_object_copies":-194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":119,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":-97,"num_whiteouts":-36,"num_read":-20975,"num_read_kb":-97882,"num_write":-2812,"num_write_kb":-66887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-346,"num_bytes_recovered":-62994390,"num_keys_recovered":-161,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.997202"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":181,"state":"unknown","last_fresh":"2024-09-22T01:37:51.546219+0000","last_change":"2024-09-22T01:37:51.864886+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T01:37:51.546219+0000","last_undegraded":"2024-09-22T01:37:51.546219+0000","last_fullsized":"2024-09-22T01:37:51.546219+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"176'548","reported_seq":4617,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543298+0000","last_change":"2024-09-22T01:37:48.539173+0000","last_active":"2024-09-22T01:37:51.543298+0000","last_peered":"2024-09-22T01:37:51.543298+0000","last_clean":"2024-09-22T01:37:51.543298+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:37:51.543298+0000","last_undegraded":"2024-09-22T01:37:51.543298+0000","last_fullsized":"2024-09-22T01:37:51.543298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:36:06.748911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042030269999999998,"stat_sum":{"num_bytes":2695081,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":3,"num_read":6073,"num_read_kb":47761,"num_write":575,"num_write_kb":23740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.1d","version":"176'996","reported_seq":3371,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548982+0000","last_change":"2024-09-22T01:37:48.547322+0000","last_active":"2024-09-22T01:37:51.548982+0000","last_peered":"2024-09-22T01:37:51.548982+0000","last_clean":"2024-09-22T01:37:51.548982+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:37:51.548982+0000","last_undegraded":"2024-09-22T01:37:51.548982+0000","last_fullsized":"2024-09-22T01:37:51.548982+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":996,"log_dups_size":0,"ondisk_log_size":996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:29:55.069642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023410480000000001,"stat_sum":{"num_bytes":23588376,"num_objects":19,"num_object_clones":6,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":7,"num_read":5513,"num_read_kb":33890,"num_write":1512,"num_write_kb":16569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.1c","version":"180'282","reported_seq":2828,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548787+0000","last_change":"2024-09-22T01:37:48.546957+0000","last_active":"2024-09-22T01:37:51.548787+0000","last_peered":"2024-09-22T01:37:51.548787+0000","last_clean":"2024-09-22T01:37:51.548787+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:37:51.548787+0000","last_undegraded":"2024-09-22T01:37:51.548787+0000","last_fullsized":"2024-09-22T01:37:51.548787+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:13:55.690655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001977829,"stat_sum":{"num_bytes":7788443,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":2117,"num_read_kb":34965,"num_write":297,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":181,"state":"unknown","last_fresh":"2024-09-22T01:37:51.547497+0000","last_change":"2024-09-22T01:37:51.864826+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T01:37:51.547497+0000","last_undegraded":"2024-09-22T01:37:51.547497+0000","last_fullsized":"2024-09-22T01:37:51.547497+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"180'451","reported_seq":5197,"reported_epoch":181,"state":"creating+peering","last_fresh":"2024-09-22T01:37:51.410531+0000","last_change":"2024-09-22T01:37:51.864728+0000","last_active":"2024-09-22T01:37:51.864728+0000","last_peered":"2024-09-22T01:37:51.410531+0000","last_clean":"2024-09-22T01:37:47.755988+0000","last_became_active":"2024-09-22T01:37:50.588617+0000","last_became_peered":"2024-09-22T01:37:50.588617+0000","last_unstale":"2024-09-22T01:37:51.410531+0000","last_undegraded":"2024-09-22T01:37:51.410531+0000","last_fullsized":"2024-09-22T01:37:50.539805+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030239809999999998,"stat_sum":{"num_bytes":16542559,"num_objects":37,"num_object_clones":12,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":9,"num_read":4733,"num_read_kb":40067,"num_write":476,"num_write_kb":25283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.19","version":"177'830","reported_seq":9497,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.539444+0000","last_change":"2024-09-22T01:37:48.541765+0000","last_active":"2024-09-22T01:37:51.539444+0000","last_peered":"2024-09-22T01:37:51.539444+0000","last_clean":"2024-09-22T01:37:51.539444+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:37:51.539444+0000","last_undegraded":"2024-09-22T01:37:51.539444+0000","last_fullsized":"2024-09-22T01:37:51.539444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:08:24.449134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011518660000000001,"stat_sum":{"num_bytes":25029118,"num_objects":27,"num_object_clones":10,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":7,"num_read":10611,"num_read_kb":63679,"num_write":1125,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.18","version":"177'939","reported_seq":3381,"reported_epoch":180,"state":"peering","last_fresh":"2024-09-22T01:37:50.541406+0000","last_change":"2024-09-22T01:37:51.543031+0000","last_active":"2024-09-22T01:37:51.543031+0000","last_peered":"2024-09-22T01:37:50.541406+0000","last_clean":"2024-09-22T01:37:50.541406+0000","last_became_active":"2024-09-22T01:37:43.538323+0000","last_became_peered":"2024-09-22T01:37:43.538323+0000","last_unstale":"2024-09-22T01:37:50.541406+0000","last_undegraded":"2024-09-22T01:37:50.541406+0000","last_fullsized":"2024-09-22T01:37:50.541406+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022849300000000001,"stat_sum":{"num_bytes":15537572,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1482,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":1799854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.17","version":"176'467","reported_seq":6003,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.546628+0000","last_change":"2024-09-22T01:37:48.540847+0000","last_active":"2024-09-22T01:37:51.546628+0000","last_peered":"2024-09-22T01:37:51.546628+0000","last_clean":"2024-09-22T01:37:51.546628+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:37:51.546628+0000","last_undegraded":"2024-09-22T01:37:51.546628+0000","last_fullsized":"2024-09-22T01:37:51.546628+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:16:45.391396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017429240000000001,"stat_sum":{"num_bytes":11533255,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":10,"num_read":5811,"num_read_kb":32153,"num_write":472,"num_write_kb":34048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.16","version":"180'682","reported_seq":14802,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.549162+0000","last_change":"2024-09-22T01:37:48.546647+0000","last_active":"2024-09-22T01:37:51.549162+0000","last_peered":"2024-09-22T01:37:51.549162+0000","last_clean":"2024-09-22T01:37:51.549162+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:37:51.549162+0000","last_undegraded":"2024-09-22T01:37:51.549162+0000","last_fullsized":"2024-09-22T01:37:51.549162+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:20:34.250218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017740340000000001,"stat_sum":{"num_bytes":18734673,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":7,"num_read":14786,"num_read_kb":34405,"num_write":695,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.15","version":"176'285","reported_seq":5019,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543142+0000","last_change":"2024-09-22T01:37:48.535365+0000","last_active":"2024-09-22T01:37:51.543142+0000","last_peered":"2024-09-22T01:37:51.543142+0000","last_clean":"2024-09-22T01:37:51.543142+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:37:51.543142+0000","last_undegraded":"2024-09-22T01:37:51.543142+0000","last_fullsized":"2024-09-22T01:37:51.543142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:29:20.002795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001191374,"stat_sum":{"num_bytes":7954426,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":5,"num_read":4129,"num_read_kb":34295,"num_write":242,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.14","version":"176'372","reported_seq":6329,"reported_epoch":181,"state":"peering","last_fresh":"2024-09-22T01:37:50.766467+0000","last_change":"2024-09-22T01:37:51.864777+0000","last_active":"2024-09-22T01:37:51.864777+0000","last_peered":"2024-09-22T01:37:50.766467+0000","last_clean":"2024-09-22T01:37:46.583022+0000","last_became_active":"2024-09-22T01:37:50.577732+0000","last_became_peered":"2024-09-22T01:37:50.577732+0000","last_unstale":"2024-09-22T01:37:50.766467+0000","last_undegraded":"2024-09-22T01:37:50.766467+0000","last_fullsized":"2024-09-22T01:37:50.766467+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.010038729,"stat_sum":{"num_bytes":8838399,"num_objects":23,"num_object_clones":6,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":6086,"num_read_kb":53973,"num_write":334,"num_write_kb":20591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":362,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.552938+0000","last_change":"2024-09-22T01:37:51.552938+0000","last_active":"2024-09-22T01:37:51.552938+0000","last_peered":"2024-09-22T01:37:51.552938+0000","last_clean":"2024-09-22T01:37:51.552938+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:37:51.552938+0000","last_undegraded":"2024-09-22T01:37:51.552938+0000","last_fullsized":"2024-09-22T01:37:51.552938+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:20.798595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":181,"state":"unknown","last_fresh":"2024-09-22T01:37:51.544828+0000","last_change":"2024-09-22T01:37:51.864865+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T01:37:51.544828+0000","last_undegraded":"2024-09-22T01:37:51.544828+0000","last_fullsized":"2024-09-22T01:37:51.544828+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":342,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.541274+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:37:51.541274+0000","last_peered":"2024-09-22T01:37:51.541274+0000","last_clean":"2024-09-22T01:37:51.541274+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:37:51.541274+0000","last_undegraded":"2024-09-22T01:37:51.541274+0000","last_fullsized":"2024-09-22T01:37:51.541274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"180'344","reported_seq":3432,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542801+0000","last_change":"2024-09-22T01:37:48.538123+0000","last_active":"2024-09-22T01:37:51.542801+0000","last_peered":"2024-09-22T01:37:51.542801+0000","last_clean":"2024-09-22T01:37:51.542801+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:37:51.542801+0000","last_undegraded":"2024-09-22T01:37:51.542801+0000","last_fullsized":"2024-09-22T01:37:51.542801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:37:48.806904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035216710000000001,"stat_sum":{"num_bytes":12168092,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":3428,"num_read_kb":20696,"num_write":334,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":227,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542997+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:37:51.542997+0000","last_peered":"2024-09-22T01:37:51.542997+0000","last_clean":"2024-09-22T01:37:51.542997+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:37:51.542997+0000","last_undegraded":"2024-09-22T01:37:51.542997+0000","last_fullsized":"2024-09-22T01:37:51.542997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"180'580","reported_seq":4027,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542084+0000","last_change":"2024-09-22T01:37:48.535316+0000","last_active":"2024-09-22T01:37:51.542084+0000","last_peered":"2024-09-22T01:37:51.542084+0000","last_clean":"2024-09-22T01:37:51.542084+0000","last_became_active":"2024-09-22T01:36:12.660207+0000","last_became_peered":"2024-09-22T01:36:12.660207+0000","last_unstale":"2024-09-22T01:37:51.542084+0000","last_undegraded":"2024-09-22T01:37:51.542084+0000","last_fullsized":"2024-09-22T01:37:51.542084+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:42:06.525388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000657666,"stat_sum":{"num_bytes":18624456,"num_objects":21,"num_object_clones":6,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":5387,"num_read_kb":37627,"num_write":601,"num_write_kb":11226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":210,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.545366+0000","last_change":"2024-09-22T01:36:03.520390+0000","last_active":"2024-09-22T01:37:51.545366+0000","last_peered":"2024-09-22T01:37:51.545366+0000","last_clean":"2024-09-22T01:37:51.545366+0000","last_became_active":"2024-09-22T01:36:03.519493+0000","last_became_peered":"2024-09-22T01:36:03.519493+0000","last_unstale":"2024-09-22T01:37:51.545366+0000","last_undegraded":"2024-09-22T01:37:51.545366+0000","last_fullsized":"2024-09-22T01:37:51.545366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:25:49.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"177'499","reported_seq":8055,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.549372+0000","last_change":"2024-09-22T01:37:48.547887+0000","last_active":"2024-09-22T01:37:51.549372+0000","last_peered":"2024-09-22T01:37:51.549372+0000","last_clean":"2024-09-22T01:37:51.549372+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:37:51.549372+0000","last_undegraded":"2024-09-22T01:37:51.549372+0000","last_fullsized":"2024-09-22T01:37:51.549372+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:34:22.405721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002476813,"stat_sum":{"num_bytes":28212283,"num_objects":17,"num_object_clones":5,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":7,"num_read":8474,"num_read_kb":54218,"num_write":518,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.3","version":"180'354","reported_seq":1546,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.545558+0000","last_change":"2024-09-22T01:37:48.540415+0000","last_active":"2024-09-22T01:37:51.545558+0000","last_peered":"2024-09-22T01:37:51.545558+0000","last_clean":"2024-09-22T01:37:51.545558+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:37:51.545558+0000","last_undegraded":"2024-09-22T01:37:51.545558+0000","last_fullsized":"2024-09-22T01:37:51.545558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:16:39.950874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017922140000000001,"stat_sum":{"num_bytes":2969902,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":9,"num_read":1403,"num_read_kb":6358,"num_write":331,"num_write_kb":3538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.2","version":"20'2","reported_seq":90,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548547+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:37:51.548547+0000","last_peered":"2024-09-22T01:37:51.548547+0000","last_clean":"2024-09-22T01:37:51.548547+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:37:51.548547+0000","last_undegraded":"2024-09-22T01:37:51.548547+0000","last_fullsized":"2024-09-22T01:37:51.548547+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"177'501","reported_seq":3876,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.540491+0000","last_change":"2024-09-22T01:37:48.542715+0000","last_active":"2024-09-22T01:37:51.540491+0000","last_peered":"2024-09-22T01:37:51.540491+0000","last_clean":"2024-09-22T01:37:51.540491+0000","last_became_active":"2024-09-22T01:36:39.852969+0000","last_became_peered":"2024-09-22T01:36:39.852969+0000","last_unstale":"2024-09-22T01:37:51.540491+0000","last_undegraded":"2024-09-22T01:37:51.540491+0000","last_fullsized":"2024-09-22T01:37:51.540491+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:16:31.969186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018044070000000001,"stat_sum":{"num_bytes":524358,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":4,"num_read":4313,"num_read_kb":14844,"num_write":507,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":198,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.541782+0000","last_change":"2024-09-22T01:36:09.627096+0000","last_active":"2024-09-22T01:37:51.541782+0000","last_peered":"2024-09-22T01:37:51.541782+0000","last_clean":"2024-09-22T01:37:51.541782+0000","last_became_active":"2024-09-22T01:36:09.626669+0000","last_became_peered":"2024-09-22T01:36:09.626669+0000","last_unstale":"2024-09-22T01:37:51.541782+0000","last_undegraded":"2024-09-22T01:37:51.541782+0000","last_fullsized":"2024-09-22T01:37:51.541782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:35.787005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"176'530","reported_seq":5115,"reported_epoch":181,"state":"active+undersized+remapped","last_fresh":"2024-09-22T01:37:51.814198+0000","last_change":"2024-09-22T01:37:51.814509+0000","last_active":"2024-09-22T01:37:51.814198+0000","last_peered":"2024-09-22T01:37:51.814198+0000","last_clean":"2024-09-22T01:37:47.573048+0000","last_became_active":"2024-09-22T01:37:50.595228+0000","last_became_peered":"2024-09-22T01:37:50.595228+0000","last_unstale":"2024-09-22T01:37:51.814198+0000","last_undegraded":"2024-09-22T01:37:51.814198+0000","last_fullsized":"2024-09-22T01:37:50.538093+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069905800000000001,"stat_sum":{"num_bytes":18717319,"num_objects":26,"num_object_clones":5,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":12,"num_read":5023,"num_read_kb":25952,"num_write":559,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0","objects":26}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":222,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542801+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:37:51.542801+0000","last_peered":"2024-09-22T01:37:51.542801+0000","last_clean":"2024-09-22T01:37:51.542801+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:37:51.542801+0000","last_undegraded":"2024-09-22T01:37:51.542801+0000","last_fullsized":"2024-09-22T01:37:51.542801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"177'449","reported_seq":2621,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543147+0000","last_change":"2024-09-22T01:37:48.537694+0000","last_active":"2024-09-22T01:37:51.543147+0000","last_peered":"2024-09-22T01:37:51.543147+0000","last_clean":"2024-09-22T01:37:51.543147+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:37:51.543147+0000","last_undegraded":"2024-09-22T01:37:51.543147+0000","last_fullsized":"2024-09-22T01:37:51.543147+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:32:14.442267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003111436,"stat_sum":{"num_bytes":13796531,"num_objects":17,"num_object_clones":4,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":8,"num_read":2669,"num_read_kb":16189,"num_write":482,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"2.3","version":"18'1","reported_seq":90,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548685+0000","last_change":"2024-09-22T01:37:13.533524+0000","last_active":"2024-09-22T01:37:51.548685+0000","last_peered":"2024-09-22T01:37:51.548685+0000","last_clean":"2024-09-22T01:37:51.548685+0000","last_became_active":"2024-09-22T01:37:13.529493+0000","last_became_peered":"2024-09-22T01:37:13.529493+0000","last_unstale":"2024-09-22T01:37:51.548685+0000","last_undegraded":"2024-09-22T01:37:51.548685+0000","last_fullsized":"2024-09-22T01:37:51.548685+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:07.459369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":470,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542802+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:37:51.542802+0000","last_peered":"2024-09-22T01:37:51.542802+0000","last_clean":"2024-09-22T01:37:51.542802+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:37:51.542802+0000","last_undegraded":"2024-09-22T01:37:51.542802+0000","last_fullsized":"2024-09-22T01:37:51.542802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"176'697","reported_seq":2592,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542667+0000","last_change":"2024-09-22T01:37:48.535801+0000","last_active":"2024-09-22T01:37:51.542667+0000","last_peered":"2024-09-22T01:37:51.542667+0000","last_clean":"2024-09-22T01:37:51.542667+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:37:51.542667+0000","last_undegraded":"2024-09-22T01:37:51.542667+0000","last_fullsized":"2024-09-22T01:37:51.542667+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:43:26.049464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027203010000000001,"stat_sum":{"num_bytes":11225033,"num_objects":15,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":7,"num_read":7235,"num_read_kb":52541,"num_write":878,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.9","version":"177'437","reported_seq":5691,"reported_epoch":181,"state":"active+undersized+remapped","last_fresh":"2024-09-22T01:37:51.644251+0000","last_change":"2024-09-22T01:37:51.644728+0000","last_active":"2024-09-22T01:37:51.644251+0000","last_peered":"2024-09-22T01:37:51.644251+0000","last_clean":"2024-09-22T01:37:47.578664+0000","last_became_active":"2024-09-22T01:37:50.594489+0000","last_became_peered":"2024-09-22T01:37:50.594489+0000","last_unstale":"2024-09-22T01:37:51.644251+0000","last_undegraded":"2024-09-22T01:37:51.644251+0000","last_fullsized":"2024-09-22T01:37:50.536018+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0042522649999999999,"stat_sum":{"num_bytes":15069870,"num_objects":11,"num_object_clones":2,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":4359,"num_read_kb":53913,"num_write":442,"num_write_kb":17684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":396,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[2],"avail_no_missing":["2","4","7"],"object_location_counts":[{"shards":"2","objects":11}],"blocked_by":[],"up_primary":4,"acting_primary":2,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.a","version":"180'590","reported_seq":14369,"reported_epoch":181,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-09-22T01:37:51.859174+0000","last_change":"2024-09-22T01:37:51.815651+0000","last_active":"2024-09-22T01:37:51.859174+0000","last_peered":"2024-09-22T01:37:51.859174+0000","last_clean":"2024-09-22T01:37:47.723359+0000","last_became_active":"2024-09-22T01:37:50.590866+0000","last_became_peered":"2024-09-22T01:37:50.590866+0000","last_unstale":"2024-09-22T01:37:51.859174+0000","last_undegraded":"2024-09-22T01:37:50.545169+0000","last_fullsized":"2024-09-22T01:37:50.540427+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":590,"log_dups_size":0,"ondisk_log_size":590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0.0097751890000000001,"stat_sum":{"num_bytes":16882979,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":5,"num_read":15441,"num_read_kb":20475,"num_write":563,"num_write_kb":18763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":113,"num_bytes_recovered":2277723,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6],"avail_no_missing":["6","1"],"object_location_counts":[{"shards":"1,6","objects":6},{"shards":"6","objects":11}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.b","version":"176'406","reported_seq":3076,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543165+0000","last_change":"2024-09-22T01:37:48.536960+0000","last_active":"2024-09-22T01:37:51.543165+0000","last_peered":"2024-09-22T01:37:51.543165+0000","last_clean":"2024-09-22T01:37:51.543165+0000","last_became_active":"2024-09-22T01:36:49.518943+0000","last_became_peered":"2024-09-22T01:36:49.518943+0000","last_unstale":"2024-09-22T01:37:51.543165+0000","last_undegraded":"2024-09-22T01:37:51.543165+0000","last_fullsized":"2024-09-22T01:37:51.543165+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:00:41.579102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024692009999999999,"stat_sum":{"num_bytes":4099760,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":8,"num_read":2659,"num_read_kb":14205,"num_write":475,"num_write_kb":9044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":11703594,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.c","version":"180'533","reported_seq":5855,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.548829+0000","last_change":"2024-09-22T01:37:48.548321+0000","last_active":"2024-09-22T01:37:51.548829+0000","last_peered":"2024-09-22T01:37:51.548829+0000","last_clean":"2024-09-22T01:37:51.548829+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:37:51.548829+0000","last_undegraded":"2024-09-22T01:37:51.548829+0000","last_fullsized":"2024-09-22T01:37:51.548829+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:51:08.784019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027825319999999999,"stat_sum":{"num_bytes":56776707,"num_objects":26,"num_object_clones":8,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":11,"num_read":6959,"num_read_kb":34783,"num_write":506,"num_write_kb":16252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.d","version":"176'491","reported_seq":4861,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543233+0000","last_change":"2024-09-22T01:37:48.536859+0000","last_active":"2024-09-22T01:37:51.543233+0000","last_peered":"2024-09-22T01:37:51.543233+0000","last_clean":"2024-09-22T01:37:51.543233+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:37:51.543233+0000","last_undegraded":"2024-09-22T01:37:51.543233+0000","last_fullsized":"2024-09-22T01:37:51.543233+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:39.336341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002219642,"stat_sum":{"num_bytes":7690004,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":5,"num_read":5594,"num_read_kb":19915,"num_write":540,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.e","version":"176'692","reported_seq":4470,"reported_epoch":180,"state":"peering","last_fresh":"2024-09-22T01:37:51.032018+0000","last_change":"2024-09-22T01:37:51.544317+0000","last_active":"2024-09-22T01:37:51.544317+0000","last_peered":"2024-09-22T01:37:51.032018+0000","last_clean":"2024-09-22T01:37:47.585064+0000","last_became_active":"2024-09-22T01:37:50.584688+0000","last_became_peered":"2024-09-22T01:37:50.584688+0000","last_unstale":"2024-09-22T01:37:51.032018+0000","last_undegraded":"2024-09-22T01:37:51.032018+0000","last_fullsized":"2024-09-22T01:37:50.545894+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041511589999999998,"stat_sum":{"num_bytes":10453121,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":9,"num_read":4545,"num_read_kb":18606,"num_write":873,"num_write_kb":13177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"11","length":"1"}]},{"pgid":"3.f","version":"177'706","reported_seq":3513,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.543132+0000","last_change":"2024-09-22T01:37:48.536256+0000","last_active":"2024-09-22T01:37:51.543132+0000","last_peered":"2024-09-22T01:37:51.543132+0000","last_clean":"2024-09-22T01:37:51.543132+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:37:51.543132+0000","last_undegraded":"2024-09-22T01:37:51.543132+0000","last_fullsized":"2024-09-22T01:37:51.543132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:18:45.344182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014644250000000001,"stat_sum":{"num_bytes":11983340,"num_objects":13,"num_object_clones":2,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":5529,"num_read_kb":24698,"num_write":871,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.10","version":"176'658","reported_seq":2900,"reported_epoch":180,"state":"peering","last_fresh":"2024-09-22T01:37:50.722099+0000","last_change":"2024-09-22T01:37:51.546148+0000","last_active":"2024-09-22T01:37:51.546148+0000","last_peered":"2024-09-22T01:37:50.722099+0000","last_clean":"2024-09-22T01:37:50.722099+0000","last_became_active":"2024-09-22T01:37:44.543325+0000","last_became_peered":"2024-09-22T01:37:44.543325+0000","last_unstale":"2024-09-22T01:37:50.722099+0000","last_undegraded":"2024-09-22T01:37:50.722099+0000","last_fullsized":"2024-09-22T01:37:50.722099+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001021098,"stat_sum":{"num_bytes":3145933,"num_objects":17,"num_object_clones":3,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":7,"num_read":4252,"num_read_kb":14328,"num_write":755,"num_write_kb":16255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":5983349,"num_keys_recovered":82,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.11","version":"176'369","reported_seq":5693,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-22T01:37:51.542851+0000","last_change":"2024-09-22T01:37:48.533834+0000","last_active":"2024-09-22T01:37:51.542851+0000","last_peered":"2024-09-22T01:37:51.542851+0000","last_clean":"2024-09-22T01:37:51.542851+0000","last_became_active":"2024-09-22T01:36:01.562260+0000","last_became_peered":"2024-09-22T01:36:01.562260+0000","last_unstale":"2024-09-22T01:37:51.542851+0000","last_undegraded":"2024-09-22T01:37:51.542851+0000","last_fullsized":"2024-09-22T01:37:51.542851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:10:36.473124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094419899999999995,"stat_sum":{"num_bytes":17174553,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":10,"num_read":4797,"num_read_kb":46848,"num_write":325,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.12","version":"176'455","reported_seq":4853,"reported_epoch":180,"state":"remapped+peering","last_fresh":"2024-09-22T01:37:50.538963+0000","last_change":"2024-09-22T01:37:51.548785+0000","last_active":"2024-09-22T01:37:50.538963+0000","last_peered":"2024-09-22T01:37:49.539067+0000","last_clean":"2024-09-22T01:37:49.539067+0000","last_became_active":"2024-09-22T01:37:44.539460+0000","last_became_peered":"2024-09-22T01:37:44.539460+0000","last_unstale":"2024-09-22T01:37:50.538963+0000","last_undegraded":"2024-09-22T01:37:50.538963+0000","last_fullsized":"2024-09-22T01:37:50.538963+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00227261,"stat_sum":{"num_bytes":11141166,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":7,"num_read":4779,"num_read_kb":18742,"num_write":513,"num_write_kb":10270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":7299962,"num_keys_recovered":55,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"10","length":"2"}]},{"pgid":"3.13","version":"176'615","reported_seq":11103,"reported_epoch":181,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-09-22T01:37:51.543323+0000","last_change":"2024-09-22T01:37:50.595095+0000","last_active":"2024-09-22T01:37:51.543323+0000","last_peered":"2024-09-22T01:37:51.543323+0000","last_clean":"2024-09-22T01:37:47.581611+0000","last_became_active":"2024-09-22T01:37:50.593598+0000","last_became_peered":"2024-09-22T01:37:50.593598+0000","last_unstale":"2024-09-22T01:37:51.543323+0000","last_undegraded":"2024-09-22T01:37:50.551282+0000","last_fullsized":"2024-09-22T01:37:50.545774+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016052340000000001,"stat_sum":{"num_bytes":17300146,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":118,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":6,"num_read":12247,"num_read_kb":47208,"num_write":544,"num_write_kb":13751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":8676658,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7],"avail_no_missing":["7","2"],"object_location_counts":[{"shards":"2,7","objects":25}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"11","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":416197455,"num_objects":549,"num_object_clones":145,"num_object_copies":1098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":119,"num_objects_misplaced":6,"num_objects_unfound":0,"num_objects_dirty":549,"num_whiteouts":195,"num_read":174392,"num_read_kb":935484,"num_write":17827,"num_write_kb":474457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5271,"num_bytes_recovered":325555900,"num_keys_recovered":831,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146952192,"data_stored":247555160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15758,"ondisk_log_size":15758,"up":64,"acting":59,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78436,"kb_used_data":20872,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94293404,"statfs":{"total":96636764160,"available":96556445696,"internally_reserved":0,"allocated":21372928,"data_stored":33129846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38428,"kb_used_data":11396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333412,"statfs":{"total":96636764160,"available":96597413888,"internally_reserved":0,"allocated":11669504,"data_stored":15802974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78036,"kb_used_data":20476,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94293804,"statfs":{"total":96636764160,"available":96556855296,"internally_reserved":0,"allocated":20967424,"data_stored":32917864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95504,"kb_used_data":32380,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94276336,"statfs":{"total":96636764160,"available":96538968064,"internally_reserved":0,"allocated":33157120,"data_stored":53333606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80276,"kb_used_data":18560,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94291564,"statfs":{"total":96636764160,"available":96554561536,"internally_reserved":0,"allocated":19005440,"data_stored":29374333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47500,"kb_used_data":16308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324340,"statfs":{"total":96636764160,"available":96588124160,"internally_reserved":0,"allocated":16699392,"data_stored":26378383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81448,"kb_used_data":27844,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94290392,"statfs":{"total":96636764160,"available":96553361408,"internally_reserved":0,"allocated":28512256,"data_stored":45372202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69616,"kb_used_data":12056,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302224,"statfs":{"total":96636764160,"available":96565477376,"internally_reserved":0,"allocated":12345344,"data_stored":17454779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9580544,"data_stored":15813555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26337280,"data_stored":44321327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14528512,"data_stored":25327527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16822272,"data_stored":28317228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32784384,"data_stored":55667794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18792448,"data_stored":31866989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9498624,"data_stored":14752118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18608128,"data_stored":31488622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:37:55.115 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:55.111+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:55.157 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:55.157 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:55.157 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:55.157 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.739288105, 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.158 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:37:55.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.159 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:55.159 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.159 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.159 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.160 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.739257916, 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.163 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:37:55.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.164 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:55.164 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.164 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.164 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.165 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.739228822000001, 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.168 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.169 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:37:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:37:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:37:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.171 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.739199197000005, 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.173 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.174 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:37:55.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:37:55.176 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.739149303999994, 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:37:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.178 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.179 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:37:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:37:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:37:55.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:37:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:37:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:37:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:37:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.739117594000007, 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.183 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.184 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:37:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.185 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:37:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.187 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:37:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:37:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:37:55.188 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:37:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:37:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:37:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.190 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:37:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:37:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.191 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.739088155000005, 2024-09-22T01:37:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:37:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.192 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.193 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.194 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.195 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.739058698999997, 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.196 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:55.197 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:37:55.198 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:37:55.199 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.739028676000004, 2024-09-22T01:37:55.200 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.201 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.202 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:37:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:37:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.203 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:37:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:37:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.205 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.206 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738983262999994, 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.207 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:55.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:37:55.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:37:55.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738953694000003, 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.211 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.212 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.213 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:37:55.214 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738923884000002, 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.215 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.216 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:37:55.217 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:37:55.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738894598000002, 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:37:55.219 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.220 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.222 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.223 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738861291999996, 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:37:55.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:55.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:37:55.226 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:37:55.227 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738831386000001, 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.228 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.229 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:55.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:37:55.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738801602999999, 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.232 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:37:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:37:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:37:55.234 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:37:55.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.236 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738737787000005, 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:55.237 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:37:55.238 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:37:55.239 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.240 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738702850999999, 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.241 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:37:55.242 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:37:55.243 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.244 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738673110999997, 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.245 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:37:55.246 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:37:55.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.248 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 88.738642984999998, 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:55.249 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:37:55.250 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:37:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:37:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:37:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.251 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:37:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:37:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:37:55.252 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.253 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.254 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:55.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:55.255 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:55.251+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:55.356 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:55.355+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:55.420 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:55.420 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:55.420 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:55.434 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:55.476 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:55.475+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:55.558 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:55.555+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:55.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:37:55.619 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:55.620 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:55.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:55.658 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:55.657+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:55.759 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:55.757+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:55.800 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:55.800 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.671797637, 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.801 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.804 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.671771901, 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.805 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.806 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.807 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.808 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67174611900001, 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.809 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.811 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.812 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.6717012, 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.813 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.816 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.816 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:37:55.816 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:37:55.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.817 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.817 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:37:55.817 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:37:55.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.671669044, 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:37:55.818 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.821 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:37:55.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:37:55.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.822 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.822 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:37:55.822 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:37:55.822 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.822 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.823 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.823 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.823 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:55.823 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67164131199999, 2024-09-22T01:37:55.823 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:37:55.823 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.823 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.823 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.824 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.824 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.824 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.824 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:37:55.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.824 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.824 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.824 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:37:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:37:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:37:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.826 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:37:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:37:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:37:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:37:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:37:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:37:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:37:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:37:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.828 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67160548800001, 2024-09-22T01:37:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:37:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.829 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:37:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.830 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.831 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:37:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:37:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.832 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:37:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:37:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:37:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:37:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:37:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:37:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:37:55.834 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:37:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.835 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67156934400001, 2024-09-22T01:37:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:37:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.836 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:37:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.837 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.838 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:37:55.839 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.840 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67153313899999, 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.841 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.842 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.843 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:55.844 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.671505787, 2024-09-22T01:37:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:37:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:37:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.845 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.846 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.847 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.848 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67146870900001, 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.849 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.850 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.851 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.852 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67144517200001, 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:37:55.853 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.854 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.855 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:37:55.856 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67089797200001, 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.857 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.858 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.859 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.860 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67087021500001, 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.861 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:37:55.862 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.863 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.864 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67084814899999, 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.865 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.866 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.867 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.868 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.670817989, 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.869 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.870 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.871 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.872 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67039749899999, 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:37:55.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.876 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67037171800001, 2024-09-22T01:37:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:37:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.877 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.878 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:37:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.879 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:37:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:37:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:37:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:37:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.880 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.881 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 170.67035045, 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.882 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.883 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.884 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.885 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 67.259345054999997, 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:55.886 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.887 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:37:55.888 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.889 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:37:55.890 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:37:55.891 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:55.892 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:55.892 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:55.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:37:55.894 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:55.891+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:55.994 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:55.991+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:56.024 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:56.025 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:56.025 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:56.025 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:56.039 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:37:56.095 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:56.091+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:56.162 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:56.162 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:56.162 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:56.162 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:56.162 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:56.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:37:56.222 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:56.221+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:56.298 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:56.297+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:56.300 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:56.300 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 147.502740295, 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.301 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:37:56.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:37:56.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:56.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:37:56.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:37:56.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:37:56.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:37:56.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:37:56.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:37:56.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:37:56.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:37:56.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:37:56.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 118.790597577, 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:37:56.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:37:56.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:37:56.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:37:56.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:37:56.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105543 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 10911744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.189079351000004, 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064938994, 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.316 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105543 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110043+0000", 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110048+0000", 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6470000000000003e-06 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110066+0000", 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8306999999999999e-05 2024-09-22T01:37:56.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110081+0000", 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4362000000000001e-05 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174758+0000", 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064676685999999997 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174867+0000", 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109701 2024-09-22T01:37:56.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174980+0000", 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000113238 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188993670000002, 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:37:56.320 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:56.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.323 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188927987, 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:37:56.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:37:56.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.328 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188862239000002, 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188819640000006, 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:37:56.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188671932999995, 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:37:56.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.340 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188512544000005, 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.341 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.342 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:37:56.343 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:56.344 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188448742000006, 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.345 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.346 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.347 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:56.348 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188388552999996, 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.349 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.350 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.351 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:56.352 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188325110999997, 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.353 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.354 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.355 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.356 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188269856000005, 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.357 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:37:56.358 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:37:56.359 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:37:56.360 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188216057000005, 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.361 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.362 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.363 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:37:56.364 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188155105000007, 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.365 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.366 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.367 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:37:56.368 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188097405999997, 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:37:56.369 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:37:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:37:56.371 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:37:56.372 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.188008955000001, 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.373 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.374 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.375 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:37:56.376 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.187923060000003, 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.377 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.378 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.379 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:37:56.380 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 89.187838212000003, 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.381 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:37:56.382 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.383 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.384 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 62.067762921000003, 2024-09-22T01:37:56.385 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.386 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.387 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:37:56.388 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:37:56.389 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:37:56.390 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:37:56.390 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:37:56.390 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.390 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.390 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.390 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:37:56.390 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:37:56.390 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:56.391 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:37:56.399 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:56.395+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:56.499 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:56.497+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:56.561 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:56.561 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:56.562 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:37:56.562 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:56.574 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:37:56.575 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:37:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:37:56.613 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:56.611+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:56.700 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:56.697+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:56.749 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:37:56.750 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:37:56.750 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:37:56.750 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:37:56.750 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:37:56.750 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:56.750 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:56.765 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:37:56.767 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:56.767 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:56.785 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:56.785 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:56.801 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:56.802 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:56.806 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:56.805+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:56.821 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:56.821 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:56.839 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:56.839 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:56.857 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:56.858 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:56.877 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:56.877 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:56.902 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:56.901+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:56.929 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:56.930 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:56.944 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:37:57.003 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:56.999+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:57.104 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:57.103+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:57.108 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:57.108 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:57.123 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:37:57.205 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:57.203+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:57.243 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:57.243 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:57.258 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:37:57.305 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:57.303+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:57.378 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:57.379 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:57.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:37:57.406 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:37:57.403+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:37:57.507 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:57.505+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:57.518 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:57.518 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:57.532 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:37:57.622 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:57.621+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:57.702 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:57.703 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:57.709 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:57.707+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:57.718 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:37:57.810 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:37:57.807+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:37:57.890 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:57.891 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:57.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:37:57.910 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:57.909+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:58.011 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:58.007+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:58.039 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:58.040 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:58.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:37:58.112 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:58.109+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:58.114 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:37:58.213 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:58.209+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:58.223 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:58.223 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:58.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:37:58.314 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:37:58.313+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:37:58.361 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:58.362 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:58.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:37:58.415 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:58.413+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:37:58.453 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:37:58.472 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-22T01:37:57.630009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384369352,"num_objects":548,"num_object_clones":134,"num_object_copies":1096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":548,"num_whiteouts":198,"num_read":196558,"num_read_kb":1034386,"num_write":20968,"num_write_kb":543812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6990,"num_bytes_recovered":423823725,"num_keys_recovered":1090,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18313,"ondisk_log_size":18313,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":543824,"kb_used_data":141944,"kb_used_omap":12,"kb_used_meta":400627,"kb_avail":754430896,"statfs":{"total":773094113280,"available":772537237504,"internally_reserved":0,"allocated":145350656,"data_stored":222435360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":410242608},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-32418490,"num_objects":-5,"num_object_clones":-11,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-119,"num_objects_misplaced":-6,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":3,"num_read":22050,"num_read_kb":98802,"num_write":2980,"num_write_kb":66937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1708,"num_bytes_recovered":97087051,"num_keys_recovered":259,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.096916"},"pg_stats":[{"pgid":"3.1f","version":"186'717","reported_seq":6215,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.662068+0000","last_change":"2024-09-22T01:37:56.662531+0000","last_active":"2024-09-22T01:37:56.662068+0000","last_peered":"2024-09-22T01:37:56.662068+0000","last_clean":"2024-09-22T01:37:56.662068+0000","last_became_active":"2024-09-22T01:37:55.543472+0000","last_became_peered":"2024-09-22T01:37:55.543472+0000","last_unstale":"2024-09-22T01:37:56.662068+0000","last_undegraded":"2024-09-22T01:37:56.662068+0000","last_fullsized":"2024-09-22T01:37:56.662068+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:28:45.109587+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0071182049999999998,"stat_sum":{"num_bytes":1310736,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":6869,"num_read_kb":35443,"num_write":904,"num_write_kb":14992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":471,"num_bytes_recovered":26513955,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.1e","version":"186'561","reported_seq":4654,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.726492+0000","last_change":"2024-09-22T01:37:56.616853+0000","last_active":"2024-09-22T01:37:56.726492+0000","last_peered":"2024-09-22T01:37:56.726492+0000","last_clean":"2024-09-22T01:37:56.726492+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:37:56.726492+0000","last_undegraded":"2024-09-22T01:37:56.726492+0000","last_fullsized":"2024-09-22T01:37:56.726492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:16:59.422900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016951519999999999,"stat_sum":{"num_bytes":2312192,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":3,"num_read":6104,"num_read_kb":47785,"num_write":590,"num_write_kb":23745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.1d","version":"185'1013","reported_seq":3411,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.636500+0000","last_change":"2024-09-22T01:37:56.637733+0000","last_active":"2024-09-22T01:37:56.636500+0000","last_peered":"2024-09-22T01:37:56.636500+0000","last_clean":"2024-09-22T01:37:56.636500+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:37:56.636500+0000","last_undegraded":"2024-09-22T01:37:56.636500+0000","last_fullsized":"2024-09-22T01:37:56.636500+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:30:26.022684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002594949,"stat_sum":{"num_bytes":12776782,"num_objects":14,"num_object_clones":4,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":6,"num_read":5544,"num_read_kb":33914,"num_write":1526,"num_write_kb":16573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.1c","version":"186'285","reported_seq":2862,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.693887+0000","last_change":"2024-09-22T01:37:56.636309+0000","last_active":"2024-09-22T01:37:56.693887+0000","last_peered":"2024-09-22T01:37:56.693887+0000","last_clean":"2024-09-22T01:37:56.693887+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:37:56.693887+0000","last_undegraded":"2024-09-22T01:37:56.693887+0000","last_fullsized":"2024-09-22T01:37:56.693887+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:25:16.339693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013688070000000001,"stat_sum":{"num_bytes":7788382,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":2134,"num_read_kb":34980,"num_write":302,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.1b","version":"185'1114","reported_seq":5316,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.658042+0000","last_change":"2024-09-22T01:37:56.658636+0000","last_active":"2024-09-22T01:37:56.658042+0000","last_peered":"2024-09-22T01:37:56.658042+0000","last_clean":"2024-09-22T01:37:56.658042+0000","last_became_active":"2024-09-22T01:37:55.544664+0000","last_became_peered":"2024-09-22T01:37:55.544664+0000","last_unstale":"2024-09-22T01:37:56.658042+0000","last_undegraded":"2024-09-22T01:37:56.658042+0000","last_fullsized":"2024-09-22T01:37:56.658042+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:18:53.487357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033837960000000001,"stat_sum":{"num_bytes":9167518,"num_objects":19,"num_object_clones":3,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":8,"num_read":9549,"num_read_kb":24239,"num_write":1596,"num_write_kb":13733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":17295622,"num_keys_recovered":162,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.1a","version":"186'452","reported_seq":5247,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.761380+0000","last_change":"2024-09-22T01:37:56.617284+0000","last_active":"2024-09-22T01:37:56.761380+0000","last_peered":"2024-09-22T01:37:56.761380+0000","last_clean":"2024-09-22T01:37:56.761380+0000","last_became_active":"2024-09-22T01:37:52.551423+0000","last_became_peered":"2024-09-22T01:37:52.551423+0000","last_unstale":"2024-09-22T01:37:56.761380+0000","last_undegraded":"2024-09-22T01:37:56.761380+0000","last_fullsized":"2024-09-22T01:37:56.761380+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:49:38.951480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097127800000000001,"stat_sum":{"num_bytes":16542543,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":9,"num_read":4753,"num_read_kb":40085,"num_write":477,"num_write_kb":25283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.19","version":"177'830","reported_seq":9517,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.621283+0000","last_change":"2024-09-22T01:37:56.621860+0000","last_active":"2024-09-22T01:37:56.621283+0000","last_peered":"2024-09-22T01:37:56.621283+0000","last_clean":"2024-09-22T01:37:56.621283+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:37:56.621283+0000","last_undegraded":"2024-09-22T01:37:56.621283+0000","last_fullsized":"2024-09-22T01:37:56.621283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:42:58.274743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078951599999999998,"stat_sum":{"num_bytes":25029118,"num_objects":27,"num_object_clones":10,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":7,"num_read":10611,"num_read_kb":63679,"num_write":1125,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.18","version":"177'939","reported_seq":3582,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.618994+0000","last_change":"2024-09-22T01:37:56.620001+0000","last_active":"2024-09-22T01:37:56.618994+0000","last_peered":"2024-09-22T01:37:56.618994+0000","last_clean":"2024-09-22T01:37:56.618994+0000","last_became_active":"2024-09-22T01:37:55.541794+0000","last_became_peered":"2024-09-22T01:37:55.541794+0000","last_unstale":"2024-09-22T01:37:56.618994+0000","last_undegraded":"2024-09-22T01:37:56.618994+0000","last_fullsized":"2024-09-22T01:37:56.618994+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":939,"log_dups_size":0,"ondisk_log_size":939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:15:30.396408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045433820000000003,"stat_sum":{"num_bytes":15537572,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1482,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":2375363,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.17","version":"186'491","reported_seq":6108,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.662539+0000","last_change":"2024-09-22T01:37:56.662837+0000","last_active":"2024-09-22T01:37:56.662539+0000","last_peered":"2024-09-22T01:37:56.662539+0000","last_clean":"2024-09-22T01:37:56.662539+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:37:56.662539+0000","last_undegraded":"2024-09-22T01:37:56.662539+0000","last_fullsized":"2024-09-22T01:37:56.662539+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:32:56.966253+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0070540990000000003,"stat_sum":{"num_bytes":11402183,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":9,"num_read":5945,"num_read_kb":32270,"num_write":489,"num_write_kb":34054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.16","version":"186'687","reported_seq":14830,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.638860+0000","last_change":"2024-09-22T01:37:56.638860+0000","last_active":"2024-09-22T01:37:56.638860+0000","last_peered":"2024-09-22T01:37:56.638860+0000","last_clean":"2024-09-22T01:37:56.638860+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:37:56.638860+0000","last_undegraded":"2024-09-22T01:37:56.638860+0000","last_fullsized":"2024-09-22T01:37:56.638860+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:01:01.831305+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0038199919999999999,"stat_sum":{"num_bytes":10855172,"num_objects":18,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":6,"num_read":14792,"num_read_kb":34408,"num_write":696,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.15","version":"186'287","reported_seq":5041,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.631244+0000","last_change":"2024-09-22T01:37:56.631633+0000","last_active":"2024-09-22T01:37:56.631244+0000","last_peered":"2024-09-22T01:37:56.631244+0000","last_clean":"2024-09-22T01:37:56.631244+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:37:56.631244+0000","last_undegraded":"2024-09-22T01:37:56.631244+0000","last_fullsized":"2024-09-22T01:37:56.631244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:54:58.042343+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011509236000000001,"stat_sum":{"num_bytes":7823354,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":4129,"num_read_kb":34295,"num_write":242,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.14","version":"186'375","reported_seq":6362,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.621245+0000","last_change":"2024-09-22T01:37:56.621245+0000","last_active":"2024-09-22T01:37:56.621245+0000","last_peered":"2024-09-22T01:37:56.621245+0000","last_clean":"2024-09-22T01:37:56.621245+0000","last_became_active":"2024-09-22T01:37:52.550304+0000","last_became_peered":"2024-09-22T01:37:52.550304+0000","last_unstale":"2024-09-22T01:37:56.621245+0000","last_undegraded":"2024-09-22T01:37:56.621245+0000","last_fullsized":"2024-09-22T01:37:56.621245+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:06.022218+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0048784579999999996,"stat_sum":{"num_bytes":8651862,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":6086,"num_read_kb":53973,"num_write":335,"num_write_kb":20591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"2.7","version":"0'0","reported_seq":372,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.628920+0000","last_change":"2024-09-22T01:37:51.552938+0000","last_active":"2024-09-22T01:37:56.628920+0000","last_peered":"2024-09-22T01:37:56.628920+0000","last_clean":"2024-09-22T01:37:56.628920+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:37:56.628920+0000","last_undegraded":"2024-09-22T01:37:56.628920+0000","last_fullsized":"2024-09-22T01:37:56.628920+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:20.798595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"186'463","reported_seq":5974,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.660595+0000","last_change":"2024-09-22T01:37:56.660595+0000","last_active":"2024-09-22T01:37:56.660595+0000","last_peered":"2024-09-22T01:37:56.660595+0000","last_clean":"2024-09-22T01:37:56.660595+0000","last_became_active":"2024-09-22T01:37:55.544363+0000","last_became_peered":"2024-09-22T01:37:55.544363+0000","last_unstale":"2024-09-22T01:37:56.660595+0000","last_undegraded":"2024-09-22T01:37:56.660595+0000","last_fullsized":"2024-09-22T01:37:56.660595+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:19:02.012264+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0053938689999999999,"stat_sum":{"num_bytes":14360680,"num_objects":22,"num_object_clones":5,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":10,"num_read":4986,"num_read_kb":38573,"num_write":386,"num_write_kb":38180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":46874722,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"2.6","version":"0'0","reported_seq":352,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.621686+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:37:56.621686+0000","last_peered":"2024-09-22T01:37:56.621686+0000","last_clean":"2024-09-22T01:37:56.621686+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:37:56.621686+0000","last_undegraded":"2024-09-22T01:37:56.621686+0000","last_fullsized":"2024-09-22T01:37:56.621686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"180'344","reported_seq":3452,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.616618+0000","last_change":"2024-09-22T01:37:56.618918+0000","last_active":"2024-09-22T01:37:56.616618+0000","last_peered":"2024-09-22T01:37:56.616618+0000","last_clean":"2024-09-22T01:37:56.616618+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:37:56.616618+0000","last_undegraded":"2024-09-22T01:37:56.616618+0000","last_fullsized":"2024-09-22T01:37:56.616618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:17:59.661408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035054830000000002,"stat_sum":{"num_bytes":12168092,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":3428,"num_read_kb":20696,"num_write":334,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"2.5","version":"0'0","reported_seq":237,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.619728+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:37:56.619728+0000","last_peered":"2024-09-22T01:37:56.619728+0000","last_clean":"2024-09-22T01:37:56.619728+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:37:56.619728+0000","last_undegraded":"2024-09-22T01:37:56.619728+0000","last_fullsized":"2024-09-22T01:37:56.619728+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"186'584","reported_seq":4050,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.621957+0000","last_change":"2024-09-22T01:37:56.622450+0000","last_active":"2024-09-22T01:37:56.621957+0000","last_peered":"2024-09-22T01:37:56.621957+0000","last_clean":"2024-09-22T01:37:56.621957+0000","last_became_active":"2024-09-22T01:36:12.660207+0000","last_became_peered":"2024-09-22T01:36:12.660207+0000","last_unstale":"2024-09-22T01:37:56.621957+0000","last_undegraded":"2024-09-22T01:37:56.621957+0000","last_fullsized":"2024-09-22T01:37:56.621957+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:25:56.301440+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0074167110000000003,"stat_sum":{"num_bytes":18362312,"num_objects":17,"num_object_clones":4,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":6,"num_read":5387,"num_read_kb":37627,"num_write":601,"num_write_kb":11226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"2.4","version":"0'0","reported_seq":220,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.655089+0000","last_change":"2024-09-22T01:36:03.520390+0000","last_active":"2024-09-22T01:37:56.655089+0000","last_peered":"2024-09-22T01:37:56.655089+0000","last_clean":"2024-09-22T01:37:56.655089+0000","last_became_active":"2024-09-22T01:36:03.519493+0000","last_became_peered":"2024-09-22T01:36:03.519493+0000","last_unstale":"2024-09-22T01:37:56.655089+0000","last_undegraded":"2024-09-22T01:37:56.655089+0000","last_fullsized":"2024-09-22T01:37:56.655089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:25:49.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"184'501","reported_seq":8077,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.637897+0000","last_change":"2024-09-22T01:37:56.639347+0000","last_active":"2024-09-22T01:37:56.637897+0000","last_peered":"2024-09-22T01:37:56.637897+0000","last_clean":"2024-09-22T01:37:56.637897+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:37:56.637897+0000","last_undegraded":"2024-09-22T01:37:56.637897+0000","last_fullsized":"2024-09-22T01:37:56.637897+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:26:03.131652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041522160000000002,"stat_sum":{"num_bytes":25674117,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":6,"num_read":8474,"num_read_kb":54218,"num_write":518,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.3","version":"186'362","reported_seq":1582,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.740403+0000","last_change":"2024-09-22T01:37:56.630392+0000","last_active":"2024-09-22T01:37:56.740403+0000","last_peered":"2024-09-22T01:37:56.740403+0000","last_clean":"2024-09-22T01:37:56.740403+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:37:56.740403+0000","last_undegraded":"2024-09-22T01:37:56.740403+0000","last_fullsized":"2024-09-22T01:37:56.740403+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:46:14.946863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016882939999999999,"stat_sum":{"num_bytes":2969902,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":9,"num_read":1415,"num_read_kb":6370,"num_write":339,"num_write_kb":3544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"2.2","version":"20'2","reported_seq":100,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.635019+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:37:56.635019+0000","last_peered":"2024-09-22T01:37:56.635019+0000","last_clean":"2024-09-22T01:37:56.635019+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:37:56.635019+0000","last_undegraded":"2024-09-22T01:37:56.635019+0000","last_fullsized":"2024-09-22T01:37:56.635019+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"177'501","reported_seq":3896,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.621344+0000","last_change":"2024-09-22T01:37:56.623239+0000","last_active":"2024-09-22T01:37:56.621344+0000","last_peered":"2024-09-22T01:37:56.621344+0000","last_clean":"2024-09-22T01:37:56.621344+0000","last_became_active":"2024-09-22T01:36:39.852969+0000","last_became_peered":"2024-09-22T01:36:39.852969+0000","last_unstale":"2024-09-22T01:37:56.621344+0000","last_undegraded":"2024-09-22T01:37:56.621344+0000","last_fullsized":"2024-09-22T01:37:56.621344+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:25:52.284561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020977309999999998,"stat_sum":{"num_bytes":524358,"num_objects":9,"num_object_clones":1,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":4,"num_read":4313,"num_read_kb":14844,"num_write":507,"num_write_kb":23553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.615824+0000","last_change":"2024-09-22T01:36:09.627096+0000","last_active":"2024-09-22T01:37:56.615824+0000","last_peered":"2024-09-22T01:37:56.615824+0000","last_clean":"2024-09-22T01:37:56.615824+0000","last_became_active":"2024-09-22T01:36:09.626669+0000","last_became_peered":"2024-09-22T01:36:09.626669+0000","last_unstale":"2024-09-22T01:37:56.615824+0000","last_undegraded":"2024-09-22T01:37:56.615824+0000","last_fullsized":"2024-09-22T01:37:56.615824+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:46:35.787005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"186'537","reported_seq":5150,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.657451+0000","last_change":"2024-09-22T01:37:56.657809+0000","last_active":"2024-09-22T01:37:56.657451+0000","last_peered":"2024-09-22T01:37:56.657451+0000","last_clean":"2024-09-22T01:37:56.657451+0000","last_became_active":"2024-09-22T01:37:53.571926+0000","last_became_peered":"2024-09-22T01:37:53.571926+0000","last_unstale":"2024-09-22T01:37:56.657451+0000","last_undegraded":"2024-09-22T01:37:56.657451+0000","last_fullsized":"2024-09-22T01:37:56.657451+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:15:33.971616+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0027620489999999999,"stat_sum":{"num_bytes":8166023,"num_objects":20,"num_object_clones":2,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":10,"num_read":5023,"num_read_kb":25952,"num_write":560,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"2.0","version":"0'0","reported_seq":233,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.619786+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:37:56.619786+0000","last_peered":"2024-09-22T01:37:56.619786+0000","last_clean":"2024-09-22T01:37:56.619786+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:37:56.619786+0000","last_undegraded":"2024-09-22T01:37:56.619786+0000","last_fullsized":"2024-09-22T01:37:56.619786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"177'449","reported_seq":2641,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.614713+0000","last_change":"2024-09-22T01:37:56.616067+0000","last_active":"2024-09-22T01:37:56.614713+0000","last_peered":"2024-09-22T01:37:56.614713+0000","last_clean":"2024-09-22T01:37:56.614713+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:37:56.614713+0000","last_undegraded":"2024-09-22T01:37:56.614713+0000","last_fullsized":"2024-09-22T01:37:56.614713+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:34:28.001870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001602167,"stat_sum":{"num_bytes":13796531,"num_objects":17,"num_object_clones":4,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":8,"num_read":2669,"num_read_kb":16189,"num_write":482,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"2.3","version":"18'1","reported_seq":100,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.634756+0000","last_change":"2024-09-22T01:37:13.533524+0000","last_active":"2024-09-22T01:37:56.634756+0000","last_peered":"2024-09-22T01:37:56.634756+0000","last_clean":"2024-09-22T01:37:56.634756+0000","last_became_active":"2024-09-22T01:37:13.529493+0000","last_became_peered":"2024-09-22T01:37:13.529493+0000","last_unstale":"2024-09-22T01:37:56.634756+0000","last_undegraded":"2024-09-22T01:37:56.634756+0000","last_fullsized":"2024-09-22T01:37:56.634756+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:53:07.459369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":481,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.619527+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:37:56.619527+0000","last_peered":"2024-09-22T01:37:56.619527+0000","last_clean":"2024-09-22T01:37:56.619527+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:37:56.619527+0000","last_undegraded":"2024-09-22T01:37:56.619527+0000","last_fullsized":"2024-09-22T01:37:56.619527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"186'699","reported_seq":2614,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.620736+0000","last_change":"2024-09-22T01:37:56.621336+0000","last_active":"2024-09-22T01:37:56.620736+0000","last_peered":"2024-09-22T01:37:56.620736+0000","last_clean":"2024-09-22T01:37:56.620736+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:37:56.620736+0000","last_undegraded":"2024-09-22T01:37:56.620736+0000","last_fullsized":"2024-09-22T01:37:56.620736+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:13:13.715134+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0058884719999999996,"stat_sum":{"num_bytes":10438601,"num_objects":13,"num_object_clones":4,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":6,"num_read":7235,"num_read_kb":52541,"num_write":878,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.9","version":"177'437","reported_seq":5515,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.617845+0000","last_change":"2024-09-22T01:37:56.617845+0000","last_active":"2024-09-22T01:37:56.617845+0000","last_peered":"2024-09-22T01:37:56.617845+0000","last_clean":"2024-09-22T01:37:56.617845+0000","last_became_active":"2024-09-22T01:37:53.539151+0000","last_became_peered":"2024-09-22T01:37:53.539151+0000","last_unstale":"2024-09-22T01:37:56.617845+0000","last_undegraded":"2024-09-22T01:37:56.617845+0000","last_fullsized":"2024-09-22T01:37:56.617845+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:32:45.469355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015262170000000001,"stat_sum":{"num_bytes":15069870,"num_objects":11,"num_object_clones":2,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":2,"num_read":4359,"num_read_kb":53913,"num_write":442,"num_write_kb":17684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":396,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.a","version":"186'595","reported_seq":14574,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.629854+0000","last_change":"2024-09-22T01:37:56.629854+0000","last_active":"2024-09-22T01:37:56.629854+0000","last_peered":"2024-09-22T01:37:56.629854+0000","last_clean":"2024-09-22T01:37:56.629854+0000","last_became_active":"2024-09-22T01:37:53.540222+0000","last_became_peered":"2024-09-22T01:37:53.540222+0000","last_unstale":"2024-09-22T01:37:56.629854+0000","last_undegraded":"2024-09-22T01:37:56.629854+0000","last_fullsized":"2024-09-22T01:37:56.629854+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:25:04.487896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012450129999999999,"stat_sum":{"num_bytes":8996065,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":15443,"num_read_kb":20477,"num_write":566,"num_write_kb":18763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2278048,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.b","version":"186'429","reported_seq":3191,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.731683+0000","last_change":"2024-09-22T01:37:56.616498+0000","last_active":"2024-09-22T01:37:56.731683+0000","last_peered":"2024-09-22T01:37:56.731683+0000","last_clean":"2024-09-22T01:37:56.731683+0000","last_became_active":"2024-09-22T01:36:49.518943+0000","last_became_peered":"2024-09-22T01:36:49.518943+0000","last_unstale":"2024-09-22T01:37:56.731683+0000","last_undegraded":"2024-09-22T01:37:56.731683+0000","last_fullsized":"2024-09-22T01:37:56.731683+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:20:27.231197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019709329999999998,"stat_sum":{"num_bytes":4099744,"num_objects":18,"num_object_clones":4,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":8,"num_read":2828,"num_read_kb":14352,"num_write":493,"num_write_kb":9050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":11703594,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.c","version":"184'535","reported_seq":5877,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.635383+0000","last_change":"2024-09-22T01:37:56.635777+0000","last_active":"2024-09-22T01:37:56.635383+0000","last_peered":"2024-09-22T01:37:56.635383+0000","last_clean":"2024-09-22T01:37:56.635383+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:37:56.635383+0000","last_undegraded":"2024-09-22T01:37:56.635383+0000","last_fullsized":"2024-09-22T01:37:56.635383+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:49:53.271514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087506200000000002,"stat_sum":{"num_bytes":51235289,"num_objects":24,"num_object_clones":7,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":10,"num_read":6959,"num_read_kb":34783,"num_write":506,"num_write_kb":16252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.d","version":"186'494","reported_seq":4884,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.628137+0000","last_change":"2024-09-22T01:37:56.628137+0000","last_active":"2024-09-22T01:37:56.628137+0000","last_peered":"2024-09-22T01:37:56.628137+0000","last_clean":"2024-09-22T01:37:56.628137+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:37:56.628137+0000","last_undegraded":"2024-09-22T01:37:56.628137+0000","last_fullsized":"2024-09-22T01:37:56.628137+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:52:43.940021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080115129999999996,"stat_sum":{"num_bytes":4675348,"num_objects":11,"num_object_clones":3,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":4,"num_read":5594,"num_read_kb":19915,"num_write":541,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.e","version":"176'692","reported_seq":4500,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.625003+0000","last_change":"2024-09-22T01:37:56.626151+0000","last_active":"2024-09-22T01:37:56.625003+0000","last_peered":"2024-09-22T01:37:56.625003+0000","last_clean":"2024-09-22T01:37:56.625003+0000","last_became_active":"2024-09-22T01:37:52.551465+0000","last_became_peered":"2024-09-22T01:37:52.551465+0000","last_unstale":"2024-09-22T01:37:56.625003+0000","last_undegraded":"2024-09-22T01:37:56.625003+0000","last_fullsized":"2024-09-22T01:37:56.625003+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:34:44.483488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0061902930000000004,"stat_sum":{"num_bytes":10453121,"num_objects":20,"num_object_clones":5,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":9,"num_read":4545,"num_read_kb":18606,"num_write":873,"num_write_kb":13177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.f","version":"183'707","reported_seq":3535,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.625918+0000","last_change":"2024-09-22T01:37:56.626510+0000","last_active":"2024-09-22T01:37:56.625918+0000","last_peered":"2024-09-22T01:37:56.625918+0000","last_clean":"2024-09-22T01:37:56.625918+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:37:56.625918+0000","last_undegraded":"2024-09-22T01:37:56.625918+0000","last_fullsized":"2024-09-22T01:37:56.625918+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:04:05.651071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065769119999999999,"stat_sum":{"num_bytes":11983302,"num_objects":12,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":5531,"num_read_kb":24699,"num_write":872,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.10","version":"186'663","reported_seq":3170,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.780232+0000","last_change":"2024-09-22T01:37:56.629164+0000","last_active":"2024-09-22T01:37:56.780232+0000","last_peered":"2024-09-22T01:37:56.780232+0000","last_clean":"2024-09-22T01:37:56.780232+0000","last_became_active":"2024-09-22T01:37:55.549740+0000","last_became_peered":"2024-09-22T01:37:55.549740+0000","last_unstale":"2024-09-22T01:37:56.780232+0000","last_undegraded":"2024-09-22T01:37:56.780232+0000","last_fullsized":"2024-09-22T01:37:56.780232+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:32:22.003786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078596500000000001,"stat_sum":{"num_bytes":3145933,"num_objects":17,"num_object_clones":3,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":7,"num_read":4354,"num_read_kb":14414,"num_write":761,"num_write_kb":16260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":7558660,"num_keys_recovered":94,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.11","version":"186'373","reported_seq":5717,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.623908+0000","last_change":"2024-09-22T01:37:56.624827+0000","last_active":"2024-09-22T01:37:56.623908+0000","last_peered":"2024-09-22T01:37:56.623908+0000","last_clean":"2024-09-22T01:37:56.623908+0000","last_became_active":"2024-09-22T01:36:01.562260+0000","last_became_peered":"2024-09-22T01:36:01.562260+0000","last_unstale":"2024-09-22T01:37:56.623908+0000","last_undegraded":"2024-09-22T01:37:56.623908+0000","last_fullsized":"2024-09-22T01:37:56.623908+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:00:39.468173+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0052380380000000004,"stat_sum":{"num_bytes":10938492,"num_objects":21,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":4797,"num_read_kb":46848,"num_write":325,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.12","version":"186'457","reported_seq":5087,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.761242+0000","last_change":"2024-09-22T01:37:56.657983+0000","last_active":"2024-09-22T01:37:56.761242+0000","last_peered":"2024-09-22T01:37:56.761242+0000","last_clean":"2024-09-22T01:37:56.761242+0000","last_became_active":"2024-09-22T01:37:54.552738+0000","last_became_peered":"2024-09-22T01:37:54.552738+0000","last_unstale":"2024-09-22T01:37:56.761242+0000","last_undegraded":"2024-09-22T01:37:56.761242+0000","last_fullsized":"2024-09-22T01:37:56.761242+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:16:13.493341+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0029052169999999999,"stat_sum":{"num_bytes":11010094,"num_objects":13,"num_object_clones":3,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":6,"num_read":4884,"num_read_kb":18832,"num_write":513,"num_write_kb":10270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":8748779,"num_keys_recovered":66,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"4"}]},{"pgid":"3.13","version":"186'620","reported_seq":11381,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-22T01:37:56.782718+0000","last_change":"2024-09-22T01:37:56.625695+0000","last_active":"2024-09-22T01:37:56.782718+0000","last_peered":"2024-09-22T01:37:56.782718+0000","last_clean":"2024-09-22T01:37:56.782718+0000","last_became_active":"2024-09-22T01:37:53.541188+0000","last_became_peered":"2024-09-22T01:37:53.541188+0000","last_unstale":"2024-09-22T01:37:56.782718+0000","last_undegraded":"2024-09-22T01:37:56.782718+0000","last_fullsized":"2024-09-22T01:37:56.782718+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:37:34.385842+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0059248629999999998,"stat_sum":{"num_bytes":16513677,"num_objects":22,"num_object_clones":6,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":5,"num_read":12262,"num_read_kb":47216,"num_write":546,"num_write_kb":13751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":329,"num_bytes_recovered":11479448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"4"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":383778965,"num_objects":544,"num_object_clones":134,"num_object_copies":1088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":544,"num_whiteouts":198,"num_read":196442,"num_read_kb":1034286,"num_write":20807,"num_write_kb":541394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6979,"num_bytes_recovered":422642951,"num_keys_recovered":1090,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":124796928,"data_stored":211156106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18193,"ondisk_log_size":18193,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76724,"kb_used_data":19164,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94295116,"statfs":{"total":96636764160,"available":96558198784,"internally_reserved":0,"allocated":19623936,"data_stored":30076202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36020,"kb_used_data":8996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335820,"statfs":{"total":96636764160,"available":96599879680,"internally_reserved":0,"allocated":9211904,"data_stored":11730289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75528,"kb_used_data":17436,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94296312,"statfs":{"total":96636764160,"available":96559423488,"internally_reserved":0,"allocated":17854464,"data_stored":27163356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92304,"kb_used_data":24476,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94279536,"statfs":{"total":96636764160,"available":96542244864,"internally_reserved":0,"allocated":25063424,"data_stored":41765628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77008,"kb_used_data":15288,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94294832,"statfs":{"total":96636764160,"available":96557907968,"internally_reserved":0,"allocated":15654912,"data_stored":23940240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":63175111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37744,"kb_used_data":6556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334096,"statfs":{"total":96636764160,"available":96598114304,"internally_reserved":0,"allocated":6713344,"data_stored":8679888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76896,"kb_used_data":23504,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94294944,"statfs":{"total":96636764160,"available":96558022656,"internally_reserved":0,"allocated":24068096,"data_stored":37753613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71600,"kb_used_data":26524,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94300240,"statfs":{"total":96636764160,"available":96563445760,"internally_reserved":0,"allocated":27160576,"data_stored":41326144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23863296,"data_stored":39190581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21729280,"data_stored":36580477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4481024,"data_stored":7598011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13373440,"data_stored":22816436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22810624,"data_stored":40677413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15216640,"data_stored":25681010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6959104,"data_stored":10634841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16363520,"data_stored":27977337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:37:58.474 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T01:37:58.474 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:37:58.474 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-22T01:37:58.474 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.925277 2024-09-22T01:37:58.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 0.9252766641934416 2024-09-22T01:37:58.503 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:58.504 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:58.516 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:58.513+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:58.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:37:58.616 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:58.615+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:58.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:37:58.701 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:58.701 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:58.717 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:58.713+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:58.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:37:58.818 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:58.817+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:58.838 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:58.838 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:58.851 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:37:58.896 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:37:58.940 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:58.939+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:58.966 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:37:58.966 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:37:58.984 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:37:59.032 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:37:59.031+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:37:59.038 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:37:59.039 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:37:59.055 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:37:59.055 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:37:59.071 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:37:59.071 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:37:59.087 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:37:59.087 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:37:59.107 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:37:59.107 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:37:59.120 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:59.119+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:59.127 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:37:59.128 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:37:59.142 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:59.142 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:59.143 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:59.143 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:59.148 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:37:59.149 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:37:59.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:37:59.170 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:37:59.170 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:37:59.220 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:37:59.217+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:37:59.294 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.294 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102378 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17858560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.876264610999996, 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035218707000000002, 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102378 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.295 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.296 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416113+0000", 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416116+0000", 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.1e-06 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416126+0000", 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.7030000000000001e-06 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.297 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416134+0000", 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3599999999999998e-06 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451015+0000", 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.034881742 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451160+0000", 2024-09-22T01:37:59.298 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000144804 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451331+0000", 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017135800000000001 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102379 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 17989632~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.876234421999996, 2024-09-22T01:37:59.299 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035560981999999998, 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102379 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.300 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416143+0000", 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416144+0000", 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1399999999999996e-07 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.301 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416147+0000", 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7860000000000001e-06 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416156+0000", 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2269999999999999e-06 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416163+0000", 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.1729999999999998e-06 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451409+0000", 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035246060000000003 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451542+0000", 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013266800000000001 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451704+0000", 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162254 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.303 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102380 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18120704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.876205327999998, 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036007637000000002, 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.304 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102380 2024-09-22T01:37:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.305 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416172+0000", 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416173+0000", 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416176+0000", 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0929999999999999e-06 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.306 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416185+0000", 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4329999999999993e-06 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416193+0000", 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3930000000000002e-06 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451801+0000", 2024-09-22T01:37:59.307 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.035608586999999997 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.451932+0000", 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130865 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452180+0000", 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00024762599999999998 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.308 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102381 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18251776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.876175703000001, 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036391055999999998, 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.309 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102381 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416202+0000", 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.37e-07 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416212+0000", 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2830000000000007e-06 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.311 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416222+0000", 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0497e-05 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416230+0000", 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5170000000000002e-06 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452278+0000", 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036048243000000001 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452418+0000", 2024-09-22T01:37:59.312 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013968499999999999 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452593+0000", 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017519399999999999 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102382 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18382848~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:59.313 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.876125810000005, 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036858084999999999, 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102382 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416252+0000", 2024-09-22T01:37:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7999999999999995e-07 2024-09-22T01:37:59.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416255+0000", 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2559999999999998e-06 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416266+0000", 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0274e-05 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.316 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416273+0000", 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4259999999999997e-06 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452697+0000", 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036423992000000002 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.452936+0000", 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000238889 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.317 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453110+0000", 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000173568 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102383 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18513920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.876094100000003, 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037169861999999998, 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.318 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102383 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416283+0000", 2024-09-22T01:37:59.319 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416284+0000", 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416287+0000", 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.773e-06 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416296+0000", 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4539999999999996e-06 2024-09-22T01:37:59.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416303+0000", 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2690000000000002e-06 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453165+0000", 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.036861285000000001 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453295+0000", 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000130178 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453453+0000", 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015825999999999999 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102384 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18644992~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.876064661000001, 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037515417000000002, 2024-09-22T01:37:59.322 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102384 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.323 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416313+0000", 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416316+0000", 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416326+0000", 2024-09-22T01:37:59.324 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3959999999999995e-06 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416333+0000", 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3529999999999997e-06 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453537+0000", 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037204213 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.325 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453670+0000", 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000133258 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453828+0000", 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015767 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102385 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18776064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.326 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.876035204999994, 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037810499999999997, 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102385 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416342+0000", 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416343+0000", 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7700000000000004e-07 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416346+0000", 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8700000000000001e-06 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416355+0000", 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4099999999999997e-06 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416362+0000", 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3799999999999996e-06 2024-09-22T01:37:59.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.453884+0000", 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037521217000000003 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454006+0000", 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122361 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454153+0000", 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014658499999999999 2024-09-22T01:37:59.330 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102386 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 18907136~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.876005182, 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038088774999999998, 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102386 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.331 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416372+0000", 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416373+0000", 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4700000000000001e-07 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416389+0000", 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.6106000000000001e-05 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416400+0000", 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0657e-05 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416407+0000", 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7300000000000005e-06 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454202+0000", 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.037794702999999999 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454321+0000", 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000118764 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454461+0000", 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000140168 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102387 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19038208~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875959769000005, 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.03840445, 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102387 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.336 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416418+0000", 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6300000000000005e-07 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416421+0000", 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0240000000000002e-06 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416431+0000", 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5130000000000002e-06 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.337 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416438+0000", 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.2130000000000002e-06 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454527+0000", 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038089061 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454658+0000", 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013071799999999999 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.338 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454822+0000", 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000164258 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102388 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19169280~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875930199999999, 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038767065000000003, 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.339 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102388 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416447+0000", 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416448+0000", 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1999999999999999e-07 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416451+0000", 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.88e-06 2024-09-22T01:37:59.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416460+0000", 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5670000000000001e-06 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416468+0000", 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.396e-06 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.342 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.454887+0000", 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038419580000000002 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455058+0000", 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00017107099999999999 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455214+0000", 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015595100000000001 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102389 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19300352~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875900389999998, 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039059543000000002, 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.344 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102389 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416477+0000", 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416478+0000", 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2300000000000001e-07 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416480+0000", 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7539999999999998e-06 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.346 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416490+0000", 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.3659999999999998e-06 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416497+0000", 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3200000000000002e-06 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455269+0000", 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.038771948000000001 2024-09-22T01:37:59.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455394+0000", 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000125418 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455537+0000", 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014211399999999999 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.348 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102390 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19431424~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875871103999998, 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039338288999999999, 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102390 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.349 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416506+0000", 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416507+0000", 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4300000000000003e-07 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416510+0000", 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7669999999999999e-06 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416519+0000", 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.1160000000000005e-06 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416530+0000", 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.095e-05 2024-09-22T01:37:59.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455587+0000", 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039057123999999999 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455704+0000", 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000117235 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455845+0000", 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014045400000000001 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102391 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19562496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875837798000006, 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039686253999999997, 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102391 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416540+0000", 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4000000000000001e-07 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416543+0000", 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8370000000000001e-06 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416552+0000", 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.38e-06 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416560+0000", 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5599999999999996e-06 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.355 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.455908+0000", 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039348004999999998 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456070+0000", 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000162051 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456226+0000", 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015578099999999999 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.356 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102392 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19693568~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875807891999997, 2024-09-22T01:37:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039966045999999998, 2024-09-22T01:37:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102392 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416569+0000", 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416570+0000", 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7400000000000003e-07 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416573+0000", 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8660000000000002e-06 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416583+0000", 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416590+0000", 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3130000000000001e-06 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456277+0000", 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039687663999999997 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.360 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456397+0000", 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00011928499999999999 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456536+0000", 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013872400000000001 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102393 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19824640~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875778108999995, 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040250095, 2024-09-22T01:37:59.361 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102393 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416599+0000", 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416600+0000", 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.6000000000000003e-07 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416631+0000", 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0766000000000003e-05 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416643+0000", 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2e-05 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416651+0000", 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4400000000000005e-06 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456588+0000", 2024-09-22T01:37:59.364 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.039936595999999998 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456710+0000", 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000122612 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456849+0000", 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000139021 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.365 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102394 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 19955712~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875714293000001, 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040539095999999997, 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102394 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.366 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416663+0000", 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416664+0000", 2024-09-22T01:37:59.367 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0299999999999997e-07 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416667+0000", 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2140000000000001e-06 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416680+0000", 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3263e-05 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416688+0000", 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8359999999999992e-06 2024-09-22T01:37:59.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.456898+0000", 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040209702 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457040+0000", 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014182499999999999 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457202+0000", 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00016235300000000001 2024-09-22T01:37:59.369 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102395 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20086784~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875679356999996, 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040842982, 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102395 2024-09-22T01:37:59.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416698+0000", 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416699+0000", 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7000000000000004e-07 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416702+0000", 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9160000000000001e-06 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416711+0000", 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5200000000000003e-06 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416718+0000", 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3499999999999999e-06 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.372 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457264+0000", 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040545856999999998 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457393+0000", 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00012881399999999999 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457541+0000", 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014785500000000001 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102396 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20217856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875649616999993, 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041190065999999997, 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102396 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.374 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416728+0000", 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416729+0000", 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0999999999999997e-07 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.375 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416731+0000", 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8399999999999999e-06 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416741+0000", 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.5030000000000003e-06 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416748+0000", 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.3860000000000001e-06 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457607+0000", 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.040858242000000003 2024-09-22T01:37:59.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457757+0000", 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015092799999999999 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457918+0000", 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000160357 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:102397 3.4 3:210026df:::rbd_data.110f30119aba.0000000000000000:22 [read 20348928~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-09-22T01:37:59.377 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 92.875619490999995, 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041525293999999997, 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 102397 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.378 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416758+0000", 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416759+0000", 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.5600000000000005e-07 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416772+0000", 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3502999999999999e-05 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416783+0000", 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0844e-05 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.416790+0000", 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.4660000000000002e-06 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.457982+0000", 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.041191973 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458131+0000", 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00014881200000000001 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:26.458283+0000", 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00015203999999999999 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.382 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.382 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:59.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:37:59.384 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:59.379+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:59.484 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:59.483+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:59.552 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:59.552 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:37:59.552 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:59.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:37:59.609 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:37:59.607+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:37:59.633 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.7 primary-affinity to 0.925277 (8606382) 2024-09-22T01:37:59.639 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:37:59.686 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:59.685+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:59.745 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:37:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:37:59.745 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:37:59.745 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:37:59.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:37:59.787 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:37:59.785+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:37:59.888 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:37:59.885+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:37:59.929 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:37:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:37:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:37:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:37:59.929 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.80044467900001, 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.930 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.931 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.932 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.933 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.80041894300001, 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.934 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.935 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.936 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.937 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.80039316099999, 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.938 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.939 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.940 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:59.941 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.80034824200001, 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:59.942 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:37:59.943 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:37:59.944 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.80031608600001, 2024-09-22T01:37:59.945 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:37:59.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:37:59.948 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.800288354, 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:37:59.949 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.950 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.951 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.80025252999999, 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:59.954 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:37:59.955 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:37:59.956 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.80021638599999, 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.957 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:37:59.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:37:59.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.800180181, 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.961 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.962 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.963 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.80015282900001, 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:37:59.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:37:59.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.968 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.80011575099999, 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:59.969 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.970 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.971 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.80009221399999, 2024-09-22T01:37:59.972 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:37:59.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.79954501399999, 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.976 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:37:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.979 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.79951725699999, 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.980 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.981 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:37:59.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:37:59.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.79949519100001, 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.984 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.985 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.986 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.79946503100001, 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.989 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:37:59.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.991 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.799044541, 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.992 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.993 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.79901876, 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:37:59.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:37:59.997 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.998 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:37:59.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 174.79899749200001, 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.000 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:38:00.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:38:00.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.003 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 71.387992096999994, 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:00.004 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:00.005 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:00.006 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:38:00.007 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.008 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:00.009 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:00.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:00.010 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:00.010 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:00.011 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:38:00.011 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:38:00.007+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:38:00.112 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:00.109+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:00.140 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:153336 3.11 3.1df07111 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e189)", 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:59.775228+0000", 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 0.36564240199999998, 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.36568744800000003, 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "waiting for peered", 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.141 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 153336 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775228+0000", 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775228+0000", 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.142 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775231+0000", 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.653e-06 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775244+0000", 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2306999999999999e-05 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775278+0000", 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4295999999999998e-05 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.143 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775299+0000", 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0803000000000001e-05 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775611+0000", 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00031184600000000001 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775639+0000", 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8920000000000001e-05 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.144 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.145 INFO:teuthology.orchestra.run.smithi179.stdout: ], 2024-09-22T01:38:00.145 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 1 2024-09-22T01:38:00.145 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:00.155 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:38:00.242 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:00.241+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:00.314 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:00.311+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:00.316 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:00.316 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:00.316 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:38:00.316 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:38:00.316 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:00.330 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:38:00.415 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:00.411+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 151.705571314, 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.505 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.506 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.507 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:38:00.508 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.509 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:38:00.510 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.511 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 122.993428596, 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.512 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.513 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.514 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.515 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.516 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.517 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.518 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.518 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:38:00.518 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:38:00.518 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.518 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.518 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.518 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.518 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.518 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105543 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 10911744~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.518 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:38:00.519 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391910370000005, 2024-09-22T01:38:00.519 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064938994, 2024-09-22T01:38:00.519 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.519 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.519 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105543 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110041+0000", 2024-09-22T01:38:00.520 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110043+0000", 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110048+0000", 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6470000000000003e-06 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110066+0000", 2024-09-22T01:38:00.521 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8306999999999999e-05 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110081+0000", 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4362000000000001e-05 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174758+0000", 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064676685999999997 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174867+0000", 2024-09-22T01:38:00.522 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109701 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.174980+0000", 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000113238 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391824689000003, 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:38:00.523 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.524 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.525 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.526 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:38:00.527 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391759006000001, 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.529 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.530 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.531 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391693258000004, 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.532 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.533 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.534 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.535 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391650659000007, 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.536 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.537 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.537 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:38:00.537 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.537 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.537 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.538 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:38:00.539 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.540 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391502951999996, 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:38:00.541 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:38:00.542 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.543 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:38:00.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:38:00.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.544 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.544 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.544 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:38:00.544 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:38:00.544 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.545 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391343563000007, 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:38:00.546 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.547 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:38:00.548 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.549 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.550 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391279761000007, 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:38:00.551 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:38:00.552 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:38:00.553 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.554 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391219571999997, 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.555 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:38:00.556 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:38:00.557 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:38:00.558 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391156129999999, 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.559 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.560 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.561 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.562 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391100875000006, 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.563 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:38:00.564 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.565 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:38:00.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.391047076000007, 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.567 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:38:00.568 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:38:00.569 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:38:00.570 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.390986123999994, 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.571 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:38:00.572 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:38:00.573 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:38:00.574 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.390928424999998, 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:38:00.575 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.576 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.577 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.578 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.390839974000002, 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:38:00.579 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.580 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.581 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.582 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.390754079000004, 2024-09-22T01:38:00.583 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.584 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.585 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.586 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:00.587 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 93.390669231000004, 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.588 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.589 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:38:00.590 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:38:00.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 66.270593939999998, 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:00.592 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:38:00.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:38:00.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:38:00.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.597 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.597 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.597 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:00.597 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:00.597 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:00.598 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:38:00.599 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:00.595+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:00.699 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:00.697+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:00.732 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:00.732 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:00.732 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:38:00.732 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:00.747 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:38:00.800 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:00.799+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:00.901 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:00.899+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:00.911 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:00.911 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:00.911 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:38:00.911 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:38:00.911 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:00.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:38:01.002 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:00.999+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:01.050 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 140.60081269599999, 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 140.59684447000001, 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:38:01.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:38:01.058 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 140.59682541000001, 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.059 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 140.59659954700001, 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.063 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:01.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:38:01.067 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 140.589069204, 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:01.071 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 140.58508790900001, 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:38:01.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:38:01.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:38:01.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.075 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 140.580869826, 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:38:01.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:38:01.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111086 3.c 3:35fd2b6c:::rbd_data.110fb46d971e.0000000000000006:24 [read 835584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.363035316999998, 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094586389000000007, 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111086 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8699999999999995e-07 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684828+0000", 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6847e-05 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684836+0000", 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6539999999999999e-06 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684841+0000", 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.896e-06 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776879+0000", 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.092037657999999994 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776960+0000", 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0653000000000002e-05 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779397+0000", 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024371940000000002 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111087 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.362982385999999, 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094592211999999995, 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111087 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684864+0000", 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0500000000000003e-07 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684867+0000", 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2820000000000001e-06 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684887+0000", 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9834e-05 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684892+0000", 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3220000000000003e-06 2024-09-22T01:38:01.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779442+0000", 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094550318999999994 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779456+0000", 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.385e-05 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111088 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.087 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.362945663000005, 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094599416000000006, 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111088 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:38:01.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684901+0000", 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3300000000000003e-07 2024-09-22T01:38:01.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684906+0000", 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684912+0000", 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8819999999999998e-06 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684919+0000", 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0330000000000003e-06 2024-09-22T01:38:01.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779492+0000", 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094573333999999995 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779500+0000", 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7360000000000001e-06 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.091 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111089 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.362918758999996, 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094616622999999997, 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111089 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684928+0000", 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7399999999999998e-07 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684930+0000", 2024-09-22T01:38:01.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.881e-06 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684938+0000", 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5689999999999999e-06 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684944+0000", 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.665e-06 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779538+0000", 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094594370999999997 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779544+0000", 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6629999999999998e-06 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111090 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.362882708000001, 2024-09-22T01:38:01.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094605844999999994, 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111090 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684964+0000", 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8999999999999997e-07 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684967+0000", 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4460000000000001e-06 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684975+0000", 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.943e-06 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684990+0000", 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4482e-05 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779561+0000", 2024-09-22T01:38:01.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094571526000000003 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779569+0000", 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9580000000000007e-06 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111091 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.362838085999996, 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094588915999999995, 2024-09-22T01:38:01.099 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111091 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685012+0000", 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.602e-06 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.101 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685020+0000", 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2300000000000008e-06 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685030+0000", 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5719999999999992e-06 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779591+0000", 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094560898000000004 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.102 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779597+0000", 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9569999999999999e-06 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111092 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.362806355000004, 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094585007999999998, 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.103 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111092 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.104 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685043+0000", 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7269999999999999e-06 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685051+0000", 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3140000000000004e-06 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.105 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685057+0000", 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9739999999999999e-06 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779618+0000", 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094561289000000007 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779625+0000", 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.195e-06 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.106 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111093 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.362781041000005, 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094587735000000006, 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.107 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111093 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.108 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685537+0000", 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00047185400000000001 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685543+0000", 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9410000000000004e-06 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685555+0000", 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2449999999999999e-05 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.109 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685563+0000", 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6279999999999996e-06 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779648+0000", 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094084962999999994 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779653+0000", 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.899e-06 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.110 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111094 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.362258026999996, 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091857000000001, 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111094 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.111 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685589+0000", 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5300000000000004e-07 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.112 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685595+0000", 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8229999999999997e-06 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685602+0000", 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8730000000000001e-06 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685607+0000", 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5279999999999997e-06 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.113 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779675+0000", 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094068054999999998 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779680+0000", 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9250000000000003e-06 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111095 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:38:01.114 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.362232469000006, 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091049999999996, 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111095 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.115 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685614+0000", 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5600000000000001e-07 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685615+0000", 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.593e-06 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.116 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685619+0000", 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1150000000000004e-06 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685623+0000", 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3529999999999999e-06 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779700+0000", 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094076749000000001 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.117 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779704+0000", 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8840000000000002e-06 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111096 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 90.362218630000001, 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094106891999999998, 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.118 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111096 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:38:01.119 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685756+0000", 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012857600000000001 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685761+0000", 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.118e-06 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685770+0000", 2024-09-22T01:38:01.120 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0650000000000005e-06 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685794+0000", 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4202999999999998e-05 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779729+0000", 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093934985999999998 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779734+0000", 2024-09-22T01:38:01.121 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9439999999999996e-06 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148273 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 48.404483401999997, 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.88034022700000003, 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.122 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148273 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.123 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643365+0000", 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8260000000000001e-06 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643378+0000", 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2397e-05 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643411+0000", 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3704999999999997e-05 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.124 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643428+0000", 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6793999999999999e-05 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643573+0000", 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014461199999999999 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643590+0000", 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7652999999999999e-05 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.125 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523688+0000", 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.880097766 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523703+0000", 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4474000000000001e-05 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148611 3.5 3:a5368988:::rbd_header.110fa04a93b5:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e146)", 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 44.199305467999999, 2024-09-22T01:38:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.82734200400000002, 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148611 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.127 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848542+0000", 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6899999999999999e-06 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848551+0000", 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7499999999999992e-06 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.128 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848571+0000", 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0645999999999999e-05 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848582+0000", 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0773e-05 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848660+0000", 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7389000000000001e-05 2024-09-22T01:38:01.129 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848673+0000", 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3222e-05 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675069+0000", 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.82639581699999998 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675421+0000", 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035278499999999999 2024-09-22T01:38:01.130 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:01.131 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:01.131 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:01.131 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675882+0000", 2024-09-22T01:38:01.131 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000460932 2024-09-22T01:38:01.131 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.131 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.131 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.131 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:01.131 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:01.131 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:01.132 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:38:01.133 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:01.131+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:01.188 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:38:01.236 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:01.235+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:01.259 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:01.259 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:01.259 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:38:01.259 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:01.274 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:38:01.335 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:01.333+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:01.345 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:38:01.345 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:38:01.362 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:38:01.362 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:38:01.378 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:38:01.378 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:38:01.393 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:01.393 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:01.393 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:38:01.393 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:38:01.393 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:01.395 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:38:01.395 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:38:01.408 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:38:01.415 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:38:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:38:01.436 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:38:01.436 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:38:01.450 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:38:01.449+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:38:01.457 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:38:01.457 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:38:01.479 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:38:01.479 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:38:01.536 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:38:01.533+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:38:01.569 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:01.570 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:01.584 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:38:01.670 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:01.669+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:01.673 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-22T01:38:01.738 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:01.737+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:01.770 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:01.770 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:01.785 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:38:01.870 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:01.869+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:01.940 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:01.937+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:01.949 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:01.949 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:01.965 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:38:02.054 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:02.053+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:02.134 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:02.135 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:02.141 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:02.137+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:02.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:38:02.242 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:38:02.239+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:38:02.279 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:02.279 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:02.294 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:38:02.342 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:38:02.339+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:38:02.443 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:38:02.441+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:38:02.467 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:02.467 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:02.482 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:38:02.543 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:02.541+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:02.614 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:02.614 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:02.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:38:02.644 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:02.641+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:02.646 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is set 2024-09-22T01:38:02.745 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:02.743+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:02.773 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:02.774 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:02.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:38:02.846 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:02.845+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:02.948 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:02.945+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:02.963 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:02.963 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:02.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:38:03.049 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:03.045+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:03.105 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:03.105 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:03.119 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:38:03.168 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:03.167+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:03.245 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:03.245 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:03.250 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:38:03.249+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:38:03.260 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:38:03.351 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:38:03.349+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:38:03.423 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:03.423 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:03.437 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:38:03.484 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:03.483+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:03.499 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:38:03.552 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:03.551+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:03.557 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:03.557 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:03.574 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:38:03.646 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:38:03.646 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:38:03.652 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:03.651+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:03.668 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:38:03.669 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:38:03.693 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:38:03.693 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:38:03.713 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:38:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:38:03.735 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:38:03.735 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:38:03.753 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:03.753+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:03.759 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:03.759 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:38:03.760 INFO:teuthology.orchestra.run.smithi018.stdout: "num_ops": 0 2024-09-22T01:38:03.760 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:03.771 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:38:03.771 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:38:03.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:38:03.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:38:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:38:03.822 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:38:03.822 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:38:03.854 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:03.853+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:03.923 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [], 2024-09-22T01:38:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "complaint_time": 30, 2024-09-22T01:38:03.924 INFO:teuthology.orchestra.run.smithi018.stdout: "num_blocked_ops": 0 2024-09-22T01:38:03.924 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:03.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:38:03.955 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:03.953+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:04.056 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:04.053+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:04.067 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:04.067 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 20, 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 600, 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "ops": [ 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12638 3.8 3:11a4ad55:::rbd_data.110f880def8d.0000000000000005:7 [read 761856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.938781189, 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058824538000000003, 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "started", 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.068 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12638 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.069 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125715+0000", 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3000000000000001e-07 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125718+0000", 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.8439999999999998e-06 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125726+0000", 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0320000000000003e-06 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.070 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125732+0000", 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.896e-06 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184336+0000", 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058604008999999999 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184429+0000", 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.2734999999999999e-05 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184539+0000", 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.000110592 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12639 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.938755453, 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868589999999998, 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.072 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12639 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.073 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125741+0000", 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9999999999999998e-07 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125744+0000", 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.5770000000000001e-06 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.074 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125752+0000", 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0369999999999995e-06 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125758+0000", 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.3940000000000001e-06 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184598+0000", 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058839713000000002 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184609+0000", 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1369000000000001e-05 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12640 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.938729671, 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058907965999999999, 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12640 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125766+0000", 2024-09-22T01:38:04.077 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125767+0000", 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.3599999999999999e-07 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125769+0000", 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.7209999999999999e-06 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.078 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125778+0000", 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.4120000000000001e-06 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125784+0000", 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1e-06 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184664+0000", 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058879505999999998 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184674+0000", 2024-09-22T01:38:04.079 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0791000000000001e-05 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12655 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.938684752, 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058899643000000002, 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.080 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12655 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125811+0000", 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125812+0000", 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.99e-07 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125815+0000", 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.45e-06 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125826+0000", 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0564000000000001e-05 2024-09-22T01:38:04.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125833+0000", 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.9020000000000002e-06 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184701+0000", 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058868165 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184711+0000", 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8630000000000003e-06 2024-09-22T01:38:04.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12656 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.938652596, 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058925159999999997, 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.084 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12656 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125843+0000", 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.085 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125844+0000", 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.1199999999999998e-07 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125847+0000", 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.208e-06 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125856+0000", 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5339999999999999e-06 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.086 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125862+0000", 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2940000000000002e-06 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184756+0000", 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058893823999999997 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184769+0000", 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2887999999999999e-05 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.087 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12657 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.93862486399999, 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947557999999997, 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12657 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.088 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125871+0000", 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125872+0000", 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.2100000000000002e-07 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.089 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125881+0000", 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125890+0000", 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.157e-06 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125898+0000", 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.1939999999999998e-06 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.090 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184809+0000", 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058910949999999997 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184819+0000", 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9650000000000003e-06 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12658 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.93858904000001, 2024-09-22T01:38:04.091 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058968452999999997, 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12658 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125907+0000", 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.58e-07 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125911+0000", 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125918+0000", 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.7440000000000007e-06 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125933+0000", 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4671000000000001e-05 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184864+0000", 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058930802999999997 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184875+0000", 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1701e-05 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12659 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.938552896, 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058983721000000003, 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12659 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125943+0000", 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125944+0000", 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7599999999999997e-07 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125947+0000", 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0570000000000001e-06 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125955+0000", 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.6540000000000005e-06 2024-09-22T01:38:04.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125969+0000", 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.4195999999999999e-05 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184917+0000", 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058947389000000003 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184927+0000", 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.9490000000000008e-06 2024-09-22T01:38:04.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12660 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.93851669099999, 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059008572000000002, 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12660 2024-09-22T01:38:04.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125979+0000", 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125981+0000", 2024-09-22T01:38:04.100 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.8479999999999999e-06 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125984+0000", 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9069999999999999e-06 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125992+0000", 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0660000000000004e-06 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.125998+0000", 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8939999999999998e-06 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184979+0000", 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058980768000000003 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.184988+0000", 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.0890000000000006e-06 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12661 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:38:04.102 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.938489339, 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059020179999999998, 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12661 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.103 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126007+0000", 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1900000000000003e-07 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126016+0000", 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.8140000000000007e-06 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126027+0000", 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0581000000000001e-05 2024-09-22T01:38:04.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126034+0000", 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5630000000000003e-06 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185019+0000", 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058985170000000003 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185027+0000", 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.5329999999999997e-06 2024-09-22T01:38:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12662 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.93845226100001, 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059021108000000003, 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12662 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126044+0000", 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:38:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126047+0000", 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.903e-06 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126056+0000", 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.5019999999999992e-06 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126062+0000", 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.9830000000000001e-06 2024-09-22T01:38:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185058+0000", 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058996801000000001 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185065+0000", 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.4099999999999996e-06 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12663 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:38:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.938428724, 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059048928000000001, 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12663 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126067+0000", 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126068+0000", 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.9700000000000003e-07 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126069+0000", 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.654e-06 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126073+0000", 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.245e-06 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126077+0000", 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.0759999999999999e-06 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185105+0000", 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.059028158999999997 2024-09-22T01:38:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185116+0000", 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1497e-05 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12685 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.93788152400001, 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.0587822, 2024-09-22T01:38:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12685 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126614+0000", 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126615+0000", 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.0699999999999997e-07 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126618+0000", 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.565e-06 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126628+0000", 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0036e-05 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126633+0000", 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4519999999999996e-06 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185387+0000", 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058754104000000001 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185397+0000", 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 9.4360000000000008e-06 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12686 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.93785376700001, 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058783479999999999, 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12686 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126642+0000", 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126643+0000", 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.5400000000000002e-07 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126645+0000", 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.153e-06 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126652+0000", 2024-09-22T01:38:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.7850000000000003e-06 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126658+0000", 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.2500000000000003e-06 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185421+0000", 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058763216 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185426+0000", 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7219999999999999e-06 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12687 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.93783170099999, 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058788623999999998, 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12687 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126664+0000", 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126665+0000", 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.2800000000000003e-07 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126675+0000", 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0589e-05 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126682+0000", 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.0790000000000003e-06 2024-09-22T01:38:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126687+0000", 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.1209999999999998e-06 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185448+0000", 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058760729999999997 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185453+0000", 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.7770000000000002e-06 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12688 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.937801541, 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058785665000000001, 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12688 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126694+0000", 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126695+0000", 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.96e-07 2024-09-22T01:38:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126697+0000", 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.103e-06 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126714+0000", 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7147999999999999e-05 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.126725+0000", 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0451e-05 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185475+0000", 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058750689000000002 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185480+0000", 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.8779999999999997e-06 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12729 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:38:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.93738105099999, 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058779927000000003, 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12729 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127115+0000", 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.89e-07 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127117+0000", 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.7680000000000001e-06 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127123+0000", 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8470000000000001e-06 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127134+0000", 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1379999999999999e-05 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185884+0000", 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058749612999999999 2024-09-22T01:38:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185895+0000", 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.093e-05 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12730 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.93735527000001, 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058795501, 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12730 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:38:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127141+0000", 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 3.7300000000000002e-07 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127143+0000", 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 2.03e-06 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127151+0000", 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 8.0690000000000002e-06 2024-09-22T01:38:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127156+0000", 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.904e-06 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185926+0000", 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058769789000000003 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185936+0000", 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0336000000000001e-05 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:12731 3.8 3.aab52588 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 178.937334002, 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058813694, 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "reached pg", 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 12731 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127162+0000", 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127800+0000", 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00063782599999999997 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127811+0000", 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.1177e-05 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127824+0000", 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.2604e-05 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.127831+0000", 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.8310000000000001e-06 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185968+0000", 2024-09-22T01:38:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.058136588000000003 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:35:05.185976+0000", 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6680000000000001e-06 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "description": "osd_op(client.4367.0:132485 3.b 3:d7dddcb2:::rbd_data.110fc5678388.0000000000000069:head [set-alloc-hint object_size 2097152 write_size 2097152,write 647108~60] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "initiated_at": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "age": 75.526328606999996, 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98346091599999996, 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "continuous": false, 2024-09-22T01:38:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "type_data": { 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "client_info": { 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "client": "client.4367", 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "tid": 132485 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "events": [ 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "initiated", 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "header_read", 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538167+0000", 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "throttled", 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538168+0000", 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.0389999999999999e-06 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "all_read", 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538173+0000", 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 4.9540000000000003e-06 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "dispatched", 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538186+0000", 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 1.3063e-05 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538193+0000", 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 6.1909999999999997e-06 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538251+0000", 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.8551000000000002e-05 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for peered", 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:48.538257+0000", 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 5.4559999999999999e-06 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "reached_pg", 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519609+0000", 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.98135271400000001 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "started", 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519745+0000", 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013585499999999999 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "waiting for subops from 2", 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.519877+0000", 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00013196200000000001 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "op_commit", 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521095+0000", 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.001218245 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521446+0000", 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00035039199999999999 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "commit_sent", 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521551+0000", 2024-09-22T01:38:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 0.00010549500000000001 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: "event": "done", 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: "time": "2024-09-22T01:36:49.521628+0000", 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: "duration": 7.6998999999999999e-05 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:04.145 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:04.146 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:38:04.158 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:04.155+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:04.259 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:38:04.257+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:38:04.276 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:04.276 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:04.276 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:38:04.276 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:04.290 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:38:04.378 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:04.377+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:04.458 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:04.459 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:04.459 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:38:04.459 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:38:04.459 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:04.461 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:04.457+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:04.472 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:38:04.562 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:04.561+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:04.643 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:04.643 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 155.84562241699999, 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.644 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.645 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:38:04.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:38:04.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:38:04.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.650 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 127.13347969900001, 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.651 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:38:04.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:38:04.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:38:04.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:38:04.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:38:04.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:38:04.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:38:04.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:38:04.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:38:04.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.657 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531875791999994, 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.658 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:38:04.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:38:04.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531810109000006, 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.662 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:38:04.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:38:04.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531744360999994, 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:38:04.666 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.669 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:38:04.670 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531701761999997, 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:38:04.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:38:04.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531554055000001, 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.678 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531394665999997, 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.679 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:38:04.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:38:04.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.682 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531330863999997, 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:38:04.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:38:04.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.686 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531270675000002, 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.687 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.688 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.689 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.690 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531207233000003, 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:38:04.691 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.692 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.693 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:38:04.694 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531151977999997, 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:38:04.695 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.696 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:38:04.697 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.698 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531098178999997, 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:38:04.699 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.700 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:38:04.701 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:38:04.702 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.531037226999999, 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:38:04.703 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.704 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.705 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:38:04.706 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.707 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.530979528000003, 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.708 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.709 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:38:04.710 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:38:04.711 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.530891077000007, 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.712 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.713 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.714 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:38:04.715 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.530805181999995, 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:38:04.716 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:38:04.717 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:38:04.718 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:38:04.719 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 97.530720333999994, 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.720 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.721 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:38:04.722 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:38:04.723 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 70.410645043000002, 2024-09-22T01:38:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.725 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.726 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:38:04.727 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:38:04.728 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:153336 3.11 3:888e0fb8:::rbd_data.110f82bc530a.0000000000000062:head [delete] snapc b=[] ondisk+write+known_if_redirected+supports_pool_eio e189)", 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:59.775228+0000", 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 4.8667752899999996, 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.87633903300000004, 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:04.729 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 153336 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775228+0000", 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.730 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775228+0000", 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775231+0000", 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.653e-06 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775244+0000", 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2306999999999999e-05 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.731 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775278+0000", 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4295999999999998e-05 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775299+0000", 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0803000000000001e-05 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775611+0000", 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00031184600000000001 2024-09-22T01:38:04.732 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775639+0000", 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8920000000000001e-05 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.649419+0000", 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.87377911500000005 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.649678+0000", 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00025939399999999998 2024-09-22T01:38:04.733 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.649784+0000", 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000105633 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.650757+0000", 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00097375599999999999 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.651437+0000", 2024-09-22T01:38:04.734 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068000000000000005 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.651506+0000", 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8813999999999995e-05 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.651567+0000", 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0495999999999998e-05 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.735 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:04.736 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:04.736 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:04.736 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 6, 7, 0, 2, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:38:04.736 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:38:04.736 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-22T01:38:04.737 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-22T01:38:04.737 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:38:04.739 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:38:04.739 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:04.733+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:04.837 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:04.835+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:04.922 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:04.922 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:04.922 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:38:04.922 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:04.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:38:04.938 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:04.935+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:05.039 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:05.035+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:05.058 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:05.058 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:05.058 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:38:05.058 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:38:05.058 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:05.062 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 194, 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "2d4626ba-577e-46d9-ad53-8451e5733f43", 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-22T01:34:18.722829+0000", 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-22T01:38:04.663794+0000", 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-22T01:34:31.284224+0000", 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-22T01:37:12.597706+0000", 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5806080, 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "nodeep-scrub", 2024-09-22T01:38:05.063 INFO:teuthology.orchestra.run.smithi018.stdout: "noscrub", 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.94999998807907104, 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 3, 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-09-22T01:38:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:31.452919+0000", 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:38:05.065 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:38:05.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "16", 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:38:05.067 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:38:05.068 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-22T01:38:05.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.89232063293457031, 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.070 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 2, 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "rbd", 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:36.960578+0000", 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:38:05.071 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 8, 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 8, 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 8, 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 8, 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 8, 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:38:05.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "20", 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 2, 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 20, 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:38:05.073 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:38:05.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.9900000095367432, 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.9900000095367432, 2024-09-22T01:38:05.075 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.87999999523162842, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.89232063293457031, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "pool_client.0", 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-22T01:34:46.686791+0000", 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 8193, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-22T01:38:05.076 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-22T01:38:05.077 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "194", 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 47, 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 194, 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-22T01:38:05.078 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.079 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "options": {}, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "rbd": {} 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-22T01:38:05.080 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 0.89232063293457031, 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.081 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "8de621b1-0a3b-4b8b-b982-70e8db073085", 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 184, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.082 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-22T01:38:05.083 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.084 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1213730345 2024-09-22T01:38:05.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/1213730345", 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/1213730345", 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/1213730345", 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/1213730345", 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "798cbd57-ebd4-461a-9bbf-68e683d1049e", 2024-09-22T01:38:05.086 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.4805145263671875, 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 183, 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:38:05.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.088 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:38:05.089 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3361514324 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3361514324", 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3361514324", 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3361514324", 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3361514324", 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9294585f-3dc9-4b04-8cae-f8d78c92791e", 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:38:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.7327880859375, 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 183, 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:38:05.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-22T01:38:05.093 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-22T01:38:05.094 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-22T01:38:05.095 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4002178714 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/4002178714", 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/4002178714", 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/4002178714", 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/4002178714", 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:38:05.096 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "1ff1abf7-fdbb-4f8a-85e5-90f102abcec2", 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 184, 2024-09-22T01:38:05.097 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:38:05.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.099 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.100 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2610959301 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/2610959301", 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/2610959301", 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/2610959301", 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/2610959301", 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "9aa2579a-ada1-45f3-9341-f46697c28212", 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:38:05.102 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 189, 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6824", 2024-09-22T01:38:05.103 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6825", 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6826", 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6827", 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6830", 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6831", 2024-09-22T01:38:05.105 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6828", 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6829", 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 482886379 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.106 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6825/482886379", 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6827/482886379", 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6831/482886379", 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6829/482886379", 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "4a6678eb-28ca-4b05-96ae-e9deeb60ca96", 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:38:05.107 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 172, 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6816", 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6817", 2024-09-22T01:38:05.108 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6818", 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6819", 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6822", 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6823", 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.110 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6820", 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6821", 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2695689817 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6817/2695689817", 2024-09-22T01:38:05.111 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6819/2695689817", 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6823/2695689817", 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6821/2695689817", 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "775b01e8-5705-4b98-a3ab-f15a78271355", 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:38:05.112 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 184, 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6808", 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6809", 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:38:05.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6810", 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6811", 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:38:05.114 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6814", 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6815", 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6812", 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6813", 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1840779137 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.116 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6809/1840779137", 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6811/1840779137", 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6815/1840779137", 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6813/1840779137", 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "15f6d6c1-8a16-42c6-9e43-f3a92e511735", 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-22T01:38:05.117 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 0.925262451171875, 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 182, 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6800", 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.118 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6801", 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6802", 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6803", 2024-09-22T01:38:05.119 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6806", 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6807", 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.120 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6804", 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.179:6805", 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4222842386 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.179:6801/4222842386", 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.179:6803/4222842386", 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.179:6807/4222842386", 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.179:6805/4222842386", 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:38:05.122 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.339566+0000", 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.065958+0000", 2024-09-22T01:38:05.123 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.261750+0000", 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:38:05.124 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.463117+0000", 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.557372+0000", 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:38:05.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.195553+0000", 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:38:05.126 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:28.008891+0000", 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-22T01:34:27.839466+0000", 2024-09-22T01:38:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [ 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "3.b", 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: 3, 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: 2 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "3.3", 2024-09-22T01:38:05.128 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 4, 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 6 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-22T01:38:05.129 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [ 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: "snaps": [ 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: "begin": 7, 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: "length": 7 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.130 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [ 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 3, 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: "snaps": [ 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: "begin": 7, 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: "length": 1 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-22T01:38:05.131 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-22T01:38:05.132 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-22T01:38:05.132 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-22T01:38:05.132 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-22T01:38:05.132 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-22T01:38:05.132 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-22T01:38:05.132 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-22T01:38:05.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-22T01:38:05.132 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:05.133 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:38:05.134 INFO:tasks.thrashosds.thrasher:j is {'epoch': 194, 'fsid': '2d4626ba-577e-46d9-ad53-8451e5733f43', 'created': '2024-09-22T01:34:18.722829+0000', 'modified': '2024-09-22T01:38:04.663794+0000', 'last_up_change': '2024-09-22T01:34:31.284224+0000', 'last_in_change': '2024-09-22T01:37:12.597706+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-22T01:34:31.452919+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8923206329345703, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-22T01:34:36.960578+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8923206329345703, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-22T01:34:46.686791+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '194', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 47, 'snap_epoch': 194, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8923206329345703, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}], 'osds': [{'osd': 0, 'uuid': '8de621b1-0a3b-4b8b-b982-70e8db073085', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 184, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6824', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6825', 'nonce': 1213730345}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6826', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6827', 'nonce': 1213730345}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6830', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6831', 'nonce': 1213730345}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6828', 'nonce': 1213730345}, {'type': 'v1', 'addr': '172.21.15.18:6829', 'nonce': 1213730345}]}, 'public_addr': '172.21.15.18:6825/1213730345', 'cluster_addr': '172.21.15.18:6827/1213730345', 'heartbeat_back_addr': '172.21.15.18:6831/1213730345', 'heartbeat_front_addr': '172.21.15.18:6829/1213730345', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '798cbd57-ebd4-461a-9bbf-68e683d1049e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.4805145263671875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 183, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6800', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6801', 'nonce': 3361514324}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6802', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6803', 'nonce': 3361514324}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6806', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6807', 'nonce': 3361514324}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6804', 'nonce': 3361514324}, {'type': 'v1', 'addr': '172.21.15.18:6805', 'nonce': 3361514324}]}, 'public_addr': '172.21.15.18:6801/3361514324', 'cluster_addr': '172.21.15.18:6803/3361514324', 'heartbeat_back_addr': '172.21.15.18:6807/3361514324', 'heartbeat_front_addr': '172.21.15.18:6805/3361514324', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '9294585f-3dc9-4b04-8cae-f8d78c92791e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.7327880859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 183, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6816', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6817', 'nonce': 4002178714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6818', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6819', 'nonce': 4002178714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6822', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6823', 'nonce': 4002178714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6820', 'nonce': 4002178714}, {'type': 'v1', 'addr': '172.21.15.18:6821', 'nonce': 4002178714}]}, 'public_addr': '172.21.15.18:6817/4002178714', 'cluster_addr': '172.21.15.18:6819/4002178714', 'heartbeat_back_addr': '172.21.15.18:6823/4002178714', 'heartbeat_front_addr': '172.21.15.18:6821/4002178714', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '1ff1abf7-fdbb-4f8a-85e5-90f102abcec2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 184, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6808', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6809', 'nonce': 2610959301}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6810', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6811', 'nonce': 2610959301}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6814', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6815', 'nonce': 2610959301}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6812', 'nonce': 2610959301}, {'type': 'v1', 'addr': '172.21.15.18:6813', 'nonce': 2610959301}]}, 'public_addr': '172.21.15.18:6809/2610959301', 'cluster_addr': '172.21.15.18:6811/2610959301', 'heartbeat_back_addr': '172.21.15.18:6815/2610959301', 'heartbeat_front_addr': '172.21.15.18:6813/2610959301', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '9aa2579a-ada1-45f3-9341-f46697c28212', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 189, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6824', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6825', 'nonce': 482886379}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6826', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6827', 'nonce': 482886379}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6830', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6831', 'nonce': 482886379}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6828', 'nonce': 482886379}, {'type': 'v1', 'addr': '172.21.15.179:6829', 'nonce': 482886379}]}, 'public_addr': '172.21.15.179:6825/482886379', 'cluster_addr': '172.21.15.179:6827/482886379', 'heartbeat_back_addr': '172.21.15.179:6831/482886379', 'heartbeat_front_addr': '172.21.15.179:6829/482886379', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '4a6678eb-28ca-4b05-96ae-e9deeb60ca96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 172, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6816', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6817', 'nonce': 2695689817}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6818', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6819', 'nonce': 2695689817}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6822', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6823', 'nonce': 2695689817}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6820', 'nonce': 2695689817}, {'type': 'v1', 'addr': '172.21.15.179:6821', 'nonce': 2695689817}]}, 'public_addr': '172.21.15.179:6817/2695689817', 'cluster_addr': '172.21.15.179:6819/2695689817', 'heartbeat_back_addr': '172.21.15.179:6823/2695689817', 'heartbeat_front_addr': '172.21.15.179:6821/2695689817', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '775b01e8-5705-4b98-a3ab-f15a78271355', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 184, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6808', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6809', 'nonce': 1840779137}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6810', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6811', 'nonce': 1840779137}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6814', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6815', 'nonce': 1840779137}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6812', 'nonce': 1840779137}, {'type': 'v1', 'addr': '172.21.15.179:6813', 'nonce': 1840779137}]}, 'public_addr': '172.21.15.179:6809/1840779137', 'cluster_addr': '172.21.15.179:6811/1840779137', 'heartbeat_back_addr': '172.21.15.179:6815/1840779137', 'heartbeat_front_addr': '172.21.15.179:6813/1840779137', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '15f6d6c1-8a16-42c6-9e43-f3a92e511735', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.925262451171875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 182, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6800', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6801', 'nonce': 4222842386}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6802', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6803', 'nonce': 4222842386}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6806', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6807', 'nonce': 4222842386}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6804', 'nonce': 4222842386}, {'type': 'v1', 'addr': '172.21.15.179:6805', 'nonce': 4222842386}]}, 'public_addr': '172.21.15.179:6801/4222842386', 'cluster_addr': '172.21.15.179:6803/4222842386', 'heartbeat_back_addr': '172.21.15.179:6807/4222842386', 'heartbeat_front_addr': '172.21.15.179:6805/4222842386', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.339566+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.065958+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.261750+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.463117+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.557372+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.195553+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:28.008891+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-22T01:34:27.839466+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.b', 'osds': [3, 2]}], 'pg_upmap_items': [{'pgid': '3.3', 'mappings': [{'from': 4, 'to': 6}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 7, 'length': 7}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 7, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-22T01:38:05.135 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.b 2024-09-22T01:38:05.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.b 2024-09-22T01:38:05.182 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:05.181+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:05.241 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:05.239+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:05.260 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:05.260 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:38:05.260 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:38:05.260 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:38:05.260 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.260 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 144.81083720800001, 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.261 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:38:05.262 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:38:05.263 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:05.264 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 144.806868982, 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.265 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:38:05.266 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.267 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.268 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 144.806849922, 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.269 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:38:05.270 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.271 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 144.806624059, 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.273 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:38:05.274 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.275 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 144.79909371599999, 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:38:05.276 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.277 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:38:05.278 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.279 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 144.795112421, 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.280 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.281 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:38:05.282 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:38:05.283 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 144.79089433799999, 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:38:05.284 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.285 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:38:05.286 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.287 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.288 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111086 3.c 3:35fd2b6c:::rbd_data.110fb46d971e.0000000000000006:24 [read 835584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.573059829000002, 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094586389000000007, 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111086 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.289 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8699999999999995e-07 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.290 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684828+0000", 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6847e-05 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684836+0000", 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6539999999999999e-06 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684841+0000", 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.896e-06 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.291 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776879+0000", 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.092037657999999994 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776960+0000", 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0653000000000002e-05 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779397+0000", 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024371940000000002 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111087 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.573006898000003, 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094592211999999995, 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111087 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.293 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684864+0000", 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0500000000000003e-07 2024-09-22T01:38:05.294 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684867+0000", 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2820000000000001e-06 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684887+0000", 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9834e-05 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684892+0000", 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3220000000000003e-06 2024-09-22T01:38:05.295 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779442+0000", 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094550318999999994 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779456+0000", 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.385e-05 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111088 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.572970174999995, 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094599416000000006, 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111088 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684901+0000", 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3300000000000003e-07 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.298 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684906+0000", 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684912+0000", 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8819999999999998e-06 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684919+0000", 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0330000000000003e-06 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779492+0000", 2024-09-22T01:38:05.299 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094573333999999995 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779500+0000", 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7360000000000001e-06 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111089 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.572943271, 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094616622999999997, 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.300 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111089 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.301 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684928+0000", 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7399999999999998e-07 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.302 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684930+0000", 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.881e-06 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684938+0000", 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5689999999999999e-06 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684944+0000", 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.665e-06 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779538+0000", 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094594370999999997 2024-09-22T01:38:05.303 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779544+0000", 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6629999999999998e-06 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111090 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.572907220000005, 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094605844999999994, 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.304 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111090 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:38:05.305 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684964+0000", 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8999999999999997e-07 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684967+0000", 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4460000000000001e-06 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684975+0000", 2024-09-22T01:38:05.306 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.943e-06 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684990+0000", 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4482e-05 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779561+0000", 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094571526000000003 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779569+0000", 2024-09-22T01:38:05.307 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9580000000000007e-06 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111091 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.572862598, 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094588915999999995, 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.308 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111091 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.309 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685012+0000", 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.602e-06 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685020+0000", 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2300000000000008e-06 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.310 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685030+0000", 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5719999999999992e-06 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779591+0000", 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094560898000000004 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779597+0000", 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9569999999999999e-06 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.311 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111092 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.572830866999993, 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094585007999999998, 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111092 2024-09-22T01:38:05.312 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:05.313 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685043+0000", 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7269999999999999e-06 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685051+0000", 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3140000000000004e-06 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685057+0000", 2024-09-22T01:38:05.314 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9739999999999999e-06 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779618+0000", 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094561289000000007 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779625+0000", 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.195e-06 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.315 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111093 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.572805552999995, 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094587735000000006, 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111093 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.316 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685537+0000", 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00047185400000000001 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685543+0000", 2024-09-22T01:38:05.317 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9410000000000004e-06 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685555+0000", 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2449999999999999e-05 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685563+0000", 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6279999999999996e-06 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779648+0000", 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094084962999999994 2024-09-22T01:38:05.318 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779653+0000", 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.899e-06 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111094 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.572282539, 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091857000000001, 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.319 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111094 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.320 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685589+0000", 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5300000000000004e-07 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685595+0000", 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8229999999999997e-06 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685602+0000", 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8730000000000001e-06 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.321 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685607+0000", 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5279999999999997e-06 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779675+0000", 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094068054999999998 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779680+0000", 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9250000000000003e-06 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.322 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111095 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.572256980999995, 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091049999999996, 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111095 2024-09-22T01:38:05.323 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685614+0000", 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5600000000000001e-07 2024-09-22T01:38:05.324 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685615+0000", 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.593e-06 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685619+0000", 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1150000000000004e-06 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685623+0000", 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3529999999999999e-06 2024-09-22T01:38:05.325 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779700+0000", 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094076749000000001 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779704+0000", 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8840000000000002e-06 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.326 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111096 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 94.572243142000005, 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094106891999999998, 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111096 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.327 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685756+0000", 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012857600000000001 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.328 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685761+0000", 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.118e-06 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685770+0000", 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0650000000000005e-06 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685794+0000", 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4202999999999998e-05 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.329 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779729+0000", 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093934985999999998 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779734+0000", 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9439999999999996e-06 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148273 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:38:05.330 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 52.614507914000001, 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.88034022700000003, 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148273 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:38:05.331 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643365+0000", 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8260000000000001e-06 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643378+0000", 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2397e-05 2024-09-22T01:38:05.332 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643411+0000", 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3704999999999997e-05 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643428+0000", 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6793999999999999e-05 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643573+0000", 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014461199999999999 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:05.333 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643590+0000", 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7652999999999999e-05 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523688+0000", 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.880097766 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523703+0000", 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4474000000000001e-05 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.334 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148611 3.5 3:a5368988:::rbd_header.110fa04a93b5:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e146)", 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 48.409329980000003, 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.82734200400000002, 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148611 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.335 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848542+0000", 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6899999999999999e-06 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848551+0000", 2024-09-22T01:38:05.336 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7499999999999992e-06 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848571+0000", 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0645999999999999e-05 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848582+0000", 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0773e-05 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848660+0000", 2024-09-22T01:38:05.337 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7389000000000001e-05 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848673+0000", 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3222e-05 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675069+0000", 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.82639581699999998 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675421+0000", 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035278499999999999 2024-09-22T01:38:05.338 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.339 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.339 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.339 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675882+0000", 2024-09-22T01:38:05.339 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000460932 2024-09-22T01:38:05.339 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.339 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.339 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.339 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.339 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.339 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:05.340 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:38:05.382 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:05.381+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:05.443 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:05.439+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:05.509 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:05.509 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:05.509 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:38:05.509 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:05.524 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:38:05.544 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:05.543+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:05.645 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:05.643+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:05.648 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:05.648 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:05.648 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:38:05.649 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:38:05.649 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:05.663 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:38:05.681 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:38:05.681 INFO:teuthology.orchestra.run.smithi018.stderr:clear 3.b pg_upmap mapping 2024-09-22T01:38:05.760 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:05.759+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:05.800 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.72227806399999, 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.801 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.802 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:38:05.803 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.804 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.72224103600001, 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.805 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.806 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:38:05.807 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:38:05.808 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.71069057599999, 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.809 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.810 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.811 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:38:05.812 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.71065656900001, 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:38:05.813 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.814 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.815 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.816 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.817 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.706743671, 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:38:05.818 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.819 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.820 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.821 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.70669846300001, 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.822 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:38:05.823 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:38:05.824 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:38:05.825 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.70666387099999, 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.826 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.827 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.828 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.70663022299999, 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.830 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.831 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.832 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.833 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.70290073300001, 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:38:05.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.70286422999999, 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.838 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.841 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.70281959100001, 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.70276936499999, 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.846 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:38:05.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:38:05.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:38:05.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.70273092299999, 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:38:05.850 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.854 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.70268692799999, 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:38:05.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:38:05.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:38:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.858 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.702647778, 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:38:05.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.69880461, 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.866 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 157.69872428400001, 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.867 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 156.99417098800001, 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.871 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.874 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 156.00002942, 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:38:05.876 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.877 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:38:05.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:38:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.881 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:151844 3.a 3:535385f0:::rbd_children:head [call rbd.remove_child in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e171)", 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:41.570519+0000", 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 24.227179224, 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0043292669999999, 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 151844 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570519+0000", 2024-09-22T01:38:05.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570519+0000", 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570522+0000", 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5900000000000002e-06 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570534+0000", 2024-09-22T01:38:05.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2082999999999999e-05 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570565+0000", 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1380000000000001e-05 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570591+0000", 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5592000000000002e-05 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570734+0000", 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014292800000000001 2024-09-22T01:38:05.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570757+0000", 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2739999999999999e-05 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.571524+0000", 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.000766845 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.571924+0000", 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00040003 2024-09-22T01:38:05.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 1", 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.572560+0000", 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00063603800000000001 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.574387+0000", 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0018272659999999999 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.574518+0000", 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0001314 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.574672+0000", 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015336899999999999 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.574849+0000", 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017700600000000001 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:05.887 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:05.888 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:38:05.889 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:38:05.890 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:05.885+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:05.990 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:05.989+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:06.045 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:38:06.045 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:38:06.062 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:38:06.062 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:38:06.062 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:06.062 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:06.062 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:38:06.062 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:06.076 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:38:06.078 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:38:06.079 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:38:06.091 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:06.087+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:06.098 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:38:06.098 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:38:06.115 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:38:06.116 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:38:06.135 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:38:06.135 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:38:06.153 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:38:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:38:06.172 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:38:06.173 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:38:06.232 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:38:06.231+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:38:06.248 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:06.248 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:06.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:38:06.306 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:06.305+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:06.381 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:06.381 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:06.393 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:06.389+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:06.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:38:06.494 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:38:06.493+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:38:06.526 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:06.526 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:06.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:38:06.595 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:06.593+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:06.659 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:06.660 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:06.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:38:06.724 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:06.723+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:06.797 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:06.795+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:06.800 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:06.800 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:06.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:38:06.898 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:06.897+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:06.981 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:06.982 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:06.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:38:06.998 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:06.995+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:07.100 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:07.097+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:07.128 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:07.128 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:07.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:38:07.201 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:07.199+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:07.261 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:07.261 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:07.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:38:07.316 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:07.315+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:07.403 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:07.399+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:07.445 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:07.445 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:07.460 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:38:07.505 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:07.503+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:07.604 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:07.603+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:07.629 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:07.630 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:07.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:38:07.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:38:07.732 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:07.731+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:07.806 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:07.805+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:07.813 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:07.813 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:07.828 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:38:07.906 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:07.903+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:07.957 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:07.957 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:07.972 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:38:08.007 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:08.005+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:08.108 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:08.107+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:08.165 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:08.165 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:08.181 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:38:08.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T01:38:08.209 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:38:08.205+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:38:08.310 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:08.307+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:08.349 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:08.368 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:38:08.380 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:38:08.381 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:38:08.398 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:38:08.398 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:38:08.414 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:08.413+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:08.414 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:38:08.414 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:38:08.430 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:38:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:38:08.448 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:38:08.449 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:38:08.468 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:38:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:38:08.488 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:38:08.488 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:38:08.504 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:08.504 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:38:08.504 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:08.508 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:38:08.509 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:38:08.511 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:08.509+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:08.519 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:38:08.542 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:38:08.612 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:38:08.611+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:38:08.688 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:08.688 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:08.688 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:38:08.688 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:38:08.688 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:08.703 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:38:08.712 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:08.711+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:08.813 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:08.809+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:08.833 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:08.833 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:38:08.833 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:38:08.833 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:38:08.833 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.833 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73492 3.1b 3:d8b4b648:::rbd_object_map.110faa444308:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:38:08.833 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:38:08.833 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 160.03376724899999, 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0442166670000002, 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73492 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:38:08.834 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796381+0000", 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796384+0000", 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.993e-06 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.835 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796397+0000", 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3856000000000001e-05 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796432+0000", 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4181999999999999e-05 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796456+0000", 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4893e-05 2024-09-22T01:38:08.836 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796670+0000", 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000213482 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.796725+0000", 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5004999999999999e-05 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.837 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798674+0000", 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.001948711 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.798690+0000", 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5882000000000001e-05 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.834787+0000", 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.036097504 2024-09-22T01:38:08.838 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.835361+0000", 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00057443000000000001 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.836042+0000", 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068059399999999997 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.839930+0000", 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0038874479999999999 2024-09-22T01:38:08.839 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840069+0000", 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013898200000000001 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840287+0000", 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021899199999999999 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.840597+0000", 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00030971299999999998 2024-09-22T01:38:08.840 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:92738 3.1b 3:da684090:::rbd_header.110f9f06451e:head [watch reconnect cookie 140215315082912 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 131.321624531, 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1945477419999999, 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.841 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 92738 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.842 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508523+0000", 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508527+0000", 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.8829999999999999e-06 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508543+0000", 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5420000000000001e-05 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.843 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508591+0000", 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8248999999999998e-05 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508620+0000", 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9196e-05 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508802+0000", 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018153700000000001 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.844 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.508825+0000", 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3736000000000001e-05 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520726+0000", 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.011900311 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:57.520748+0000", 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2126000000000001e-05 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.845 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.698987+0000", 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.178239617 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for rw locks", 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.699120+0000", 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133046 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700393+0000", 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001272563 2024-09-22T01:38:08.846 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.700480+0000", 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7239999999999998e-05 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:58.703071+0000", 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025908179999999999 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.847 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105544 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11042816~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.720020624, 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065163615999999994, 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105544 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110127+0000", 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110128+0000", 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.297e-06 2024-09-22T01:38:08.849 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110135+0000", 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5100000000000004e-06 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110156+0000", 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0933000000000001e-05 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110171+0000", 2024-09-22T01:38:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4899000000000001e-05 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175041+0000", 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.064869947999999997 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175157+0000", 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011627 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.851 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175291+0000", 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000133759 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105545 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11173888~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.719954941, 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065390608000000003, 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.852 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105545 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110193+0000", 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.853 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110194+0000", 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3799999999999999e-06 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110200+0000", 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0360000000000003e-06 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110220+0000", 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9582999999999999e-05 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.854 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110234+0000", 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.411e-05 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175346+0000", 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065112060999999999 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175457+0000", 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000110908 2024-09-22T01:38:08.855 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175583+0000", 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012653 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105546 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11304960~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.719889193, 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065529630000000005, 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.856 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105546 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.857 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110259+0000", 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110260+0000", 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0529999999999999e-06 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110265+0000", 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6999999999999996e-06 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.858 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110280+0000", 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4562999999999999e-05 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110288+0000", 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2339999999999994e-06 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175643+0000", 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065355328000000004 2024-09-22T01:38:08.859 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175710+0000", 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6505000000000001e-05 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175788+0000", 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.8246999999999998e-05 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.860 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105547 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11436032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.719846594, 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065879166000000003, 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105547 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.861 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110301+0000", 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.862 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110302+0000", 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.296e-06 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110366+0000", 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3818999999999993e-05 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110387+0000", 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1140000000000001e-05 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.863 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110423+0000", 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5781999999999997e-05 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.175895+0000", 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065472163 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176037+0000", 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000141531 2024-09-22T01:38:08.864 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176180+0000", 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143435 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105548 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11567104~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.71969888700001, 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065928157000000001, 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.865 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105548 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110449+0000", 2024-09-22T01:38:08.866 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110450+0000", 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3060000000000001e-06 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110473+0000", 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2745999999999999e-05 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.867 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110492+0000", 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9293e-05 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110507+0000", 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5054e-05 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176236+0000", 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065729007000000006 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176295+0000", 2024-09-22T01:38:08.868 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9181000000000001e-05 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176377+0000", 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.1570000000000007e-05 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105549 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11698176~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.719539498, 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066117250000000002, 2024-09-22T01:38:08.869 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105549 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.870 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110608+0000", 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110610+0000", 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.37e-06 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110617+0000", 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9630000000000001e-06 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.871 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110636+0000", 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9377000000000001e-05 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110651+0000", 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5268999999999999e-05 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176434+0000", 2024-09-22T01:38:08.872 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.065782781999999998 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176578+0000", 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000143843 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176726+0000", 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000147646 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.873 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105550 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11829248~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.719475696, 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066504489999999999, 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105550 2024-09-22T01:38:08.874 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110672+0000", 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.875 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110674+0000", 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4139999999999999e-06 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110679+0000", 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4e-06 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110697+0000", 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7751999999999999e-05 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.876 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110715+0000", 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8377e-05 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176778+0000", 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066062630999999997 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.176833+0000", 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5742999999999998e-05 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.877 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177177+0000", 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000343173 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105551 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 11960320~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.71941550699999, 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066712858999999999, 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.878 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105551 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.879 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110732+0000", 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110733+0000", 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.04e-06 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110739+0000", 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3859999999999998e-06 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.880 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110760+0000", 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1622999999999999e-05 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110777+0000", 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6416999999999999e-05 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177235+0000", 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066458132000000003 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.881 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177342+0000", 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000106722 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177445+0000", 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000103539 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105552 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12091392~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:38:08.882 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.719352065, 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066953622000000004, 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105552 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.883 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110796+0000", 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110797+0000", 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.156e-06 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110803+0000", 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6239999999999999e-06 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.884 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110821+0000", 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8065999999999999e-05 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110834+0000", 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3399e-05 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177481+0000", 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066647005999999995 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.885 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177601+0000", 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012029200000000001 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177749+0000", 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014807899999999999 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105553 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.886 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.71929681, 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067153851000000001, 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105553 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:38:08.887 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110851+0000", 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110852+0000", 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.19e-06 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110858+0000", 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4469999999999997e-06 2024-09-22T01:38:08.888 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110875+0000", 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7215999999999999e-05 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110887+0000", 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2303000000000001e-05 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177799+0000", 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.066911736999999999 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.889 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.177893+0000", 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3993000000000006e-05 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178005+0000", 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000111965 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105554 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12353536~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.890 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.719243011, 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067273455999999995, 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105554 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.891 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110905+0000", 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110906+0000", 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.167e-06 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110911+0000", 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0930000000000002e-06 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.892 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110929+0000", 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7813e-05 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110943+0000", 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3756e-05 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178025+0000", 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067081958999999997 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.893 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178080+0000", 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5451000000000002e-05 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178178+0000", 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8216999999999998e-05 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105555 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12484608~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:38:08.894 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.719182059, 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067384685, 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105555 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.895 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110966+0000", 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110967+0000", 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.173e-06 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110973+0000", 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.003e-06 2024-09-22T01:38:08.896 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.110993+0000", 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0129999999999999e-05 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111007+0000", 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4185999999999999e-05 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178236+0000", 2024-09-22T01:38:08.897 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067228607999999995 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178287+0000", 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1307999999999997e-05 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178350+0000", 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3276999999999997e-05 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.898 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105556 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12615680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.71912436, 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067511768, 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.899 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105556 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111023+0000", 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.900 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111025+0000", 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2300000000000001e-06 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111030+0000", 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.3700000000000003e-06 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111047+0000", 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7008999999999999e-05 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.901 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111090+0000", 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3022999999999998e-05 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178381+0000", 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067291381999999997 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178468+0000", 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6092000000000002e-05 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.902 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178535+0000", 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7662000000000004e-05 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105557 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12746752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.719035909, 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067659638999999994, 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.903 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105557 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111112+0000", 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.904 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111113+0000", 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1069999999999999e-06 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111120+0000", 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8959999999999997e-06 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111162+0000", 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.2048999999999997e-05 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.905 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111177+0000", 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5217e-05 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178573+0000", 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067396128 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178662+0000", 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8917000000000003e-05 2024-09-22T01:38:08.906 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178772+0000", 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000109325 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105558 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 12877824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.718950014, 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067843220999999995, 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.907 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105558 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.908 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111198+0000", 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111199+0000", 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.246e-06 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111206+0000", 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9199999999999998e-06 2024-09-22T01:38:08.909 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111247+0000", 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1449000000000002e-05 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111262+0000", 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4797000000000001e-05 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178810+0000", 2024-09-22T01:38:08.910 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067547515000000002 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.178924+0000", 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114011 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179041+0000", 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117283 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.911 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.912 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:105559 3.9 3:94e86ae8:::rbd_data.110f30119aba.0000000000000004:22 [read 13008896~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-09-22T01:38:08.912 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:38:08.912 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 101.718865166, 2024-09-22T01:38:08.912 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067990422999999994, 2024-09-22T01:38:08.912 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.912 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.912 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.912 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.912 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.912 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 105559 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111283+0000", 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.913 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111284+0000", 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.643e-06 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111344+0000", 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0109000000000003e-05 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111366+0000", 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1668999999999999e-05 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.111382+0000", 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5817000000000001e-05 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179066+0000", 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.067684194000000003 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.915 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179158+0000", 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.2303e-05 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:27.179273+0000", 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000114688 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:133817 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124)", 2024-09-22T01:38:08.916 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 74.598789874999994, 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.150302567, 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 133817 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.917 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231358+0000", 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231360+0000", 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.1890000000000001e-06 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.918 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231371+0000", 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0713999999999999e-05 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231400+0000", 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.9036000000000001e-05 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231415+0000", 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.503e-05 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.919 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231538+0000", 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012339800000000001 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.231555+0000", 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6492999999999999e-05 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.380960+0000", 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.14940552500000001 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.920 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381234+0000", 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00027324599999999999 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:54.381660+0000", 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00042693599999999999 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:153336 3.11 3:888e0fb8:::rbd_data.110f82bc530a.0000000000000062:head [delete] snapc b=[] ondisk+write+known_if_redirected+supports_pool_eio e189)", 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:59.775228+0000", 2024-09-22T01:38:08.921 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 9.0549201220000004, 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.87633903300000004, 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 153336 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775228+0000", 2024-09-22T01:38:08.922 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775228+0000", 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775231+0000", 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.653e-06 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775244+0000", 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2306999999999999e-05 2024-09-22T01:38:08.923 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775278+0000", 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4295999999999998e-05 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775299+0000", 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0803000000000001e-05 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775611+0000", 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00031184600000000001 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.924 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:59.775639+0000", 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8920000000000001e-05 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.649419+0000", 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.87377911500000005 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.649678+0000", 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00025939399999999998 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.925 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 7", 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.649784+0000", 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000105633 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.650757+0000", 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00097375599999999999 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.651437+0000", 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00068000000000000005 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:38:08.926 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.651506+0000", 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8813999999999995e-05 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:38:00.651567+0000", 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0495999999999998e-05 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:08.927 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:08.929 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:38:08.929 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-09-22T01:38:08.925+0000 7f9582116640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26631) UID: 0 2024-09-22T01:38:09.030 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:09.027+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:09.095 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:09.096 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:09.096 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:38:09.096 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:09.110 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:38:09.158 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:38:09.157+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:38:09.231 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:38:09.227+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:38:09.232 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:38:09.232 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:38:09.232 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:09.246 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:38:09.332 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:09.331+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:09.419 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:09.419 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:38:09.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:38:09.419 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:38:09.419 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.419 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85505 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1753088~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:09.419 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:38:09.419 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 148.96952694500001, 2024-09-22T01:38:09.419 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094232483000000006, 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85505 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.420 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.447033+0000", 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450734+0000", 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037010070000000001 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.421 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450740+0000", 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6130000000000003e-06 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450758+0000", 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7878000000000001e-05 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.450771+0000", 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3379e-05 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.422 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.540967+0000", 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090195630999999998 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541087+0000", 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000120331 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.541266+0000", 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017864399999999999 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.423 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85515 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2633728~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 148.965558719, 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094038631999999997, 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.424 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85515 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451001+0000", 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.425 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451002+0000", 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4700000000000002e-07 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451004+0000", 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9429999999999999e-06 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451009+0000", 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.1619999999999999e-06 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.426 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451013+0000", 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5070000000000002e-06 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544630+0000", 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093616729999999995 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.544741+0000", 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011044699999999999 2024-09-22T01:38:09.427 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545040+0000", 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029949600000000001 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85516 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2646016~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 148.965539659, 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094342375000000006, 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.428 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85516 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.429 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451020+0000", 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451217+0000", 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000196403 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451221+0000", 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.155e-06 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.430 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451230+0000", 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6950000000000006e-06 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451236+0000", 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0680000000000002e-06 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545086+0000", 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093849844000000002 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.431 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545160+0000", 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4093999999999999e-05 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545363+0000", 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020311600000000001 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85517 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1802240~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:38:09.432 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 148.965313796, 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094335510999999997, 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85517 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.433 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.451246+0000", 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454804+0000", 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0035577909999999998 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454810+0000", 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7509999999999997e-06 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.434 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454823+0000", 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.454830+0000", 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.6440000000000003e-06 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545391+0000", 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090560666999999997 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.435 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545480+0000", 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9365999999999998e-05 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.545582+0000", 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101853 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85537 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 1875968~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:09.436 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 148.95778345299999, 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094019585000000003, 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85537 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.437 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.458777+0000", 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462521+0000", 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0037440170000000001 2024-09-22T01:38:09.438 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462526+0000", 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.575e-06 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462536+0000", 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3160000000000003e-06 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462542+0000", 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1689999999999997e-06 2024-09-22T01:38:09.439 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552477+0000", 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089934952999999998 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552620+0000", 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014326599999999999 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.552796+0000", 2024-09-22T01:38:09.440 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017628899999999999 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85548 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 2916352~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 148.953802158, 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094262086999999994, 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.441 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85548 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.442 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.462758+0000", 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466719+0000", 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003960692 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466728+0000", 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9959999999999999e-06 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.443 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466740+0000", 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1895e-05 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466746+0000", 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3670000000000002e-06 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556734+0000", 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089987643000000006 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.444 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.556854+0000", 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012079 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.557020+0000", 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165704 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:85560 3.16 3:6e823d90:::rbd_data.110f9cb308d1.0000000000000000:11 [read 3014656~1024] snapc 0=[] RETRY=7 ondisk+retry+read+known_if_redirected+supports_pool_eio e60)", 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 148.94958407499999, 2024-09-22T01:38:09.445 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094294666999999999, 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 85560 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.446 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.466976+0000", 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470609+0000", 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003632555 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470625+0000", 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6143000000000001e-05 2024-09-22T01:38:09.447 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470638+0000", 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3416e-05 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.470644+0000", 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.1850000000000001e-06 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560860+0000", 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090216115999999999 2024-09-22T01:38:09.448 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.560979+0000", 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000119023 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:40.561271+0000", 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000291229 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.449 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111086 3.c 3:35fd2b6c:::rbd_data.110fb46d971e.0000000000000006:24 [read 835584~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.731749566000005, 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094586389000000007, 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111086 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684811+0000", 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8699999999999995e-07 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.451 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684828+0000", 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6847e-05 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684836+0000", 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6539999999999999e-06 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684841+0000", 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.896e-06 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.452 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776879+0000", 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.092037657999999994 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.776960+0000", 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.0653000000000002e-05 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779397+0000", 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0024371940000000002 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.453 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111087 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.731696635000006, 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094592211999999995, 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111087 2024-09-22T01:38:09.454 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684863+0000", 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.455 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684864+0000", 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.0500000000000003e-07 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684867+0000", 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2820000000000001e-06 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684887+0000", 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9834e-05 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.456 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684892+0000", 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3220000000000003e-06 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779442+0000", 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094550318999999994 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779456+0000", 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.385e-05 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.457 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111088 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.731659911999998, 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094599416000000006, 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111088 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.458 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684900+0000", 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684901+0000", 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3300000000000003e-07 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.459 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684906+0000", 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9980000000000003e-06 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684912+0000", 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.8819999999999998e-06 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684919+0000", 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.0330000000000003e-06 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.460 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779492+0000", 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094573333999999995 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779500+0000", 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7360000000000001e-06 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111089 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:38:09.461 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.731633008000003, 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094616622999999997, 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111089 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.462 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684927+0000", 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684928+0000", 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7399999999999998e-07 2024-09-22T01:38:09.463 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684930+0000", 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.881e-06 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684938+0000", 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.5689999999999999e-06 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684944+0000", 2024-09-22T01:38:09.464 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.665e-06 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779538+0000", 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094594370999999997 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779544+0000", 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6629999999999998e-06 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.465 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111090 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.731596956999994, 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094605844999999994, 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111090 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.466 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684963+0000", 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684964+0000", 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8999999999999997e-07 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.467 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684967+0000", 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4460000000000001e-06 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684975+0000", 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.943e-06 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.684990+0000", 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4482e-05 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.468 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779561+0000", 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094571526000000003 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779569+0000", 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9580000000000007e-06 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111091 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.469 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.731552335000003, 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094588915999999995, 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111091 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.470 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685008+0000", 2024-09-22T01:38:09.471 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685012+0000", 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.602e-06 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685020+0000", 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.2300000000000008e-06 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.472 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685030+0000", 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.5719999999999992e-06 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779591+0000", 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094560898000000004 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779597+0000", 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9569999999999999e-06 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.473 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111092 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.731520603999996, 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094585007999999998, 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111092 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.474 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685040+0000", 2024-09-22T01:38:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0900000000000002e-07 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685043+0000", 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7269999999999999e-06 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685051+0000", 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3140000000000004e-06 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685057+0000", 2024-09-22T01:38:09.476 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9739999999999999e-06 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779618+0000", 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094561289000000007 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779625+0000", 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.195e-06 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.477 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111093 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.731495289999998, 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094587735000000006, 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111093 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.478 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685065+0000", 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685537+0000", 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00047185400000000001 2024-09-22T01:38:09.479 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685543+0000", 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.9410000000000004e-06 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685555+0000", 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2449999999999999e-05 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685563+0000", 2024-09-22T01:38:09.480 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6279999999999996e-06 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779648+0000", 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094084962999999994 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779653+0000", 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.899e-06 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.481 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111094 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.730972276000003, 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091857000000001, 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111094 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.482 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685588+0000", 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685589+0000", 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5300000000000004e-07 2024-09-22T01:38:09.483 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685595+0000", 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8229999999999997e-06 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685602+0000", 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.8730000000000001e-06 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685607+0000", 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5279999999999997e-06 2024-09-22T01:38:09.484 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779675+0000", 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094068054999999998 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779680+0000", 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9250000000000003e-06 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.485 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111095 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.730946717999998, 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094091049999999996, 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111095 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.486 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685613+0000", 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685614+0000", 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5600000000000001e-07 2024-09-22T01:38:09.487 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685615+0000", 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.593e-06 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685619+0000", 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.1150000000000004e-06 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685623+0000", 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3529999999999999e-06 2024-09-22T01:38:09.488 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779700+0000", 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094076749000000001 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779704+0000", 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8840000000000002e-06 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.489 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:111096 3.c 3.36d4bfac (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 98.730932878999994, 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.094106891999999998, 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 111096 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.490 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685627+0000", 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685756+0000", 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012857600000000001 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.491 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685761+0000", 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.118e-06 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685770+0000", 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.0650000000000005e-06 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.685794+0000", 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.4202999999999998e-05 2024-09-22T01:38:09.492 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779729+0000", 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.093934985999999998 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:36:30.779734+0000", 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9439999999999996e-06 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.493 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148273 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 56.773197650999997, 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.88034022700000003, 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148273 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.494 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643362+0000", 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643365+0000", 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8260000000000001e-06 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.495 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643378+0000", 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2397e-05 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643411+0000", 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.3704999999999997e-05 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643428+0000", 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6793999999999999e-05 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.496 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643573+0000", 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014461199999999999 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:12.643590+0000", 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7652999999999999e-05 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523688+0000", 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.880097766 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:13.523703+0000", 2024-09-22T01:38:09.497 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4474000000000001e-05 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:148611 3.5 3:a5368988:::rbd_header.110fa04a93b5:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e146)", 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 52.568019716999999, 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.82734200400000002, 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:09.498 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 148611 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848540+0000", 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:09.499 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848542+0000", 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6899999999999999e-06 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848551+0000", 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.7499999999999992e-06 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848571+0000", 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0645999999999999e-05 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:09.500 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848582+0000", 2024-09-22T01:38:09.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0773e-05 2024-09-22T01:38:09.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848660+0000", 2024-09-22T01:38:09.501 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7389000000000001e-05 2024-09-22T01:38:09.501 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.501 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.501 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:09.501 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:16.848673+0000", 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3222e-05 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675069+0000", 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.82639581699999998 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675421+0000", 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00035278499999999999 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:09.502 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:09.503 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:09.503 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:17.675882+0000", 2024-09-22T01:38:09.503 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000460932 2024-09-22T01:38:09.503 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.503 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.503 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.503 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:09.503 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:09.503 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:09.504 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:38:09.505 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:09.503+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:09.605 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:09.605+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:09.640 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:09.641 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:09.641 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:38:09.641 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:09.657 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:38:09.706 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-22T01:38:09.703+0000 7f983cae8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26391) UID: 0 2024-09-22T01:38:09.807 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:09.805+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:09.831 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:09.832 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:09.832 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:38:09.832 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:38:09.832 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:09.845 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:38:09.907 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:09.903+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:10.008 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:10.005+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:10.012 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:10.012 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:38:10.012 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71862 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4381696~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.93479412900001, 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089905109999999996, 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71862 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.013 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.014 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075421+0000", 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3300000000000002e-07 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075425+0000", 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5439999999999999e-06 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075435+0000", 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0594999999999999e-05 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.015 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075445+0000", 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0111e-05 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165027+0000", 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089581180999999996 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165182+0000", 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015494099999999999 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.016 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165326+0000", 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144105 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71863 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4393984~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.934757101, 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090008309999999994, 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.017 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71863 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.075458+0000", 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.018 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078568+0000", 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031107499999999998 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078582+0000", 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4031e-05 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078600+0000", 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7416999999999999e-05 2024-09-22T01:38:10.019 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.078611+0000", 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1576999999999999e-05 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165352+0000", 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086740950999999997 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165409+0000", 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7095999999999997e-05 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.020 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.165466+0000", 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.6487999999999999e-05 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71900 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4848640~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.92320664100001, 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089976793999999999, 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.021 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71900 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.022 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087008+0000", 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087009+0000", 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5199999999999996e-07 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087012+0000", 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.023 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087023+0000", 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0662000000000001e-05 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087031+0000", 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.4870000000000002e-06 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176719+0000", 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089687886999999994 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176859+0000", 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013971799999999999 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.176985+0000", 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012583000000000001 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71901 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4860928~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.923172634, 2024-09-22T01:38:10.025 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090307653000000002, 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71901 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.026 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.087042+0000", 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090551+0000", 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.003508766 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090559+0000", 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3080000000000008e-06 2024-09-22T01:38:10.027 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090576+0000", 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090587+0000", 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1567e-05 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177084+0000", 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.086496455999999999 2024-09-22T01:38:10.028 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177222+0000", 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000138002 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.177350+0000", 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000127892 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.029 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71911 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4983808~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.91925973599999, 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090031537999999994, 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71911 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.030 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090955+0000", 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090956+0000", 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.031 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090967+0000", 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1634000000000001e-05 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090979+0000", 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1967000000000001e-05 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.090988+0000", 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8969999999999997e-06 2024-09-22T01:38:10.032 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180718+0000", 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089729610000000001 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180858+0000", 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014001500000000001 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.180986+0000", 2024-09-22T01:38:10.033 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128758 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71912 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 4996096~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.919214528, 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090334754000000003, 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.034 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71912 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091000+0000", 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.035 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091001+0000", 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.7299999999999995e-07 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091004+0000", 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4170000000000001e-06 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091015+0000", 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0441999999999999e-05 2024-09-22T01:38:10.036 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091023+0000", 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.636e-06 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181068+0000", 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090044943000000002 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181208+0000", 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000139901 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.037 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181335+0000", 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000126742 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71913 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5008384~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.91917993600001, 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090666989000000003, 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.038 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71913 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.039 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091035+0000", 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5700000000000002e-07 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091039+0000", 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.393e-06 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091050+0000", 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0831e-05 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091058+0000", 2024-09-22T01:38:10.040 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.3059999999999998e-06 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181434+0000", 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090376012000000006 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181572+0000", 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013856099999999999 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.041 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181702+0000", 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012922899999999999 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71914 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5020672~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.91914628800001, 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090981334999999997, 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.042 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71914 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.091068+0000", 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.043 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094487+0000", 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0034184459999999999 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094494+0000", 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4499999999999998e-06 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094511+0000", 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6498999999999999e-05 2024-09-22T01:38:10.044 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094523+0000", 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.185e-05 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181782+0000", 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087259576000000005 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.181919+0000", 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013693900000000001 2024-09-22T01:38:10.045 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.182050+0000", 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013057499999999999 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71921 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5106688~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.915416798, 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089825684000000003, 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.046 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71921 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094798+0000", 2024-09-22T01:38:10.047 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094799+0000", 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.5400000000000001e-07 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094802+0000", 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.9249999999999997e-06 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094813+0000", 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0715e-05 2024-09-22T01:38:10.048 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094824+0000", 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0631e-05 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184329+0000", 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089505359000000007 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184492+0000", 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016324800000000001 2024-09-22T01:38:10.049 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184624+0000", 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013115199999999999 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71922 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5118976~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.91538029500001, 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090135050999999994, 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.050 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71922 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.051 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094834+0000", 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094835+0000", 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.5199999999999997e-07 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094838+0000", 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.5580000000000001e-06 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.052 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094850+0000", 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1216999999999999e-05 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094858+0000", 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.585e-06 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184700+0000", 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089841683000000006 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.053 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184844+0000", 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000144451 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.184969+0000", 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000125005 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71923 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5131264~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.054 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.915335656, 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457672000000003, 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71923 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:38:10.055 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094879+0000", 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094881+0000", 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.53e-06 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094885+0000", 2024-09-22T01:38:10.056 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.0559999999999998e-06 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094903+0000", 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8777999999999999e-05 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094915+0000", 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2014000000000001e-05 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.057 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185044+0000", 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090128527999999999 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185209+0000", 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016537100000000001 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185337+0000", 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012739500000000001 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.058 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71924 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5143552~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.91528543000001, 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090756503000000002, 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71924 2024-09-22T01:38:10.059 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094929+0000", 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.060 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094930+0000", 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.2500000000000005e-07 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094934+0000", 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.16e-06 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094945+0000", 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1071e-05 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.061 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094956+0000", 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0392e-05 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185413+0000", 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090457612000000007 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185558+0000", 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014462399999999999 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.062 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185686+0000", 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012791899999999999 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71925 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5155840~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.91524698800001, 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091091417999999993, 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.063 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71925 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094968+0000", 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.064 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094969+0000", 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.181e-06 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094973+0000", 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3440000000000003e-06 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.065 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.094992+0000", 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.8664999999999998e-05 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095001+0000", 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9700000000000005e-06 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185760+0000", 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.090758941999999995 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.066 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.185930+0000", 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000169877 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186059+0000", 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012943899999999999 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71926 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5168128~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:38:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.91520299300001, 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091400335999999999, 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71926 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.068 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095012+0000", 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3600000000000003e-07 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095016+0000", 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4539999999999999e-06 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.069 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095026+0000", 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0584000000000001e-05 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095036+0000", 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9729999999999992e-06 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186137+0000", 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091100713 2024-09-22T01:38:10.070 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186284+0000", 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014667400000000001 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186412+0000", 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012830200000000001 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.071 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71927 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5180416~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.91516384299999, 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091752294999999998, 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71927 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:38:10.072 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.095051+0000", 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098664+0000", 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0036130279999999999 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098674+0000", 2024-09-22T01:38:10.073 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0591000000000001e-05 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098702+0000", 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.7144999999999998e-05 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098717+0000", 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4956e-05 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186535+0000", 2024-09-22T01:38:10.074 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.087818171 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186676+0000", 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014159900000000001 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.186803+0000", 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012680499999999999 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.075 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71932 3.0 3:0134a9fa:::rbd_data.110f9cb308d1.0000000000000003:11 [read 5241856~0] snapc 0=[] RETRY=3 ondisk+retry+read+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.91132067500001, 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089946472, 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71932 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.076 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098894+0000", 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098895+0000", 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6299999999999993e-07 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.077 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098900+0000", 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.0170000000000004e-06 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098918+0000", 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7574000000000001e-05 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098952+0000", 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.4826999999999997e-05 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.078 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188381+0000", 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089429008000000004 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188629+0000", 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00024790100000000002 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188840+0000", 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000211182 2024-09-22T01:38:10.079 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:71942 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.911240349, 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.091320192999999994, 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.080 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 71942 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098974+0000", 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.081 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098976+0000", 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.24e-06 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.098982+0000", 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.3199999999999996e-06 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099028+0000", 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6601000000000003e-05 2024-09-22T01:38:10.082 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.099044+0000", 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5628e-05 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188361+0000", 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.089316967999999997 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.188574+0000", 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00021326900000000001 2024-09-22T01:38:10.083 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.190294+0000", 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0017201670000000001 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73650 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 29] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 161.206687053, 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0270493329999999, 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.084 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73650 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803528+0000", 2024-09-22T01:38:10.085 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803530+0000", 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.306e-06 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803540+0000", 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.6989999999999998e-06 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.086 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803566+0000", 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.6205999999999999e-05 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803590+0000", 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.3819e-05 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803683+0000", 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.3398000000000003e-05 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:28.803695+0000", 2024-09-22T01:38:10.087 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2143999999999999e-05 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800359+0000", 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.996663682 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800374+0000", 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5102999999999999e-05 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826008+0000", 2024-09-22T01:38:10.088 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0256339649999999 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.826635+0000", 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00062728399999999998 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.830577+0000", 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0039417269999999999 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.089 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:73651 3.10 3:0dc69afc:::rbd_header.110faa444308:head [watch reconnect cookie 140215382479808 gen 30] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 160.21254548499999, 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0339212900000001, 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 73651 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.090 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797669+0000", 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797672+0000", 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.712e-06 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.091 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797684+0000", 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2132e-05 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797717+0000", 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.2848999999999997e-05 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797733+0000", 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6096e-05 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.092 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797851+0000", 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000117683 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op must wait for map", 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.797867+0000", 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6307000000000002e-05 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800418+0000", 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0025513440000000001 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:29.800429+0000", 2024-09-22T01:38:10.093 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1076e-05 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828416+0000", 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0279869580000001 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.828804+0000", 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00038765300000000001 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:30.831590+0000", 2024-09-22T01:38:10.094 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00278648 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:151844 3.a 3:535385f0:::rbd_children:head [call rbd.remove_child in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e171)", 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:37:41.570519+0000", 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 28.439695288999999, 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0043292669999999, 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 151844 2024-09-22T01:38:10.095 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570519+0000", 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570519+0000", 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570522+0000", 2024-09-22T01:38:10.096 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5900000000000002e-06 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570534+0000", 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2082999999999999e-05 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570565+0000", 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.1380000000000001e-05 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570591+0000", 2024-09-22T01:38:10.097 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5592000000000002e-05 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570734+0000", 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014292800000000001 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:41.570757+0000", 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.2739999999999999e-05 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.571524+0000", 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.000766845 2024-09-22T01:38:10.098 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.571924+0000", 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00040003 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 1", 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.572560+0000", 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00063603800000000001 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.574387+0000", 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0018272659999999999 2024-09-22T01:38:10.099 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.574518+0000", 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0001314 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.574672+0000", 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015336899999999999 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:37:42.574849+0000", 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017700600000000001 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.100 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.101 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.101 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.101 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.101 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:10.102 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:38:10.146 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:10.145+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:10.210 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:10.209+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:10.272 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:10.272 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:10.272 INFO:teuthology.orchestra.run.smithi179.stdout: "num_ops": 0 2024-09-22T01:38:10.272 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:10.287 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:38:10.312 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-22T01:38:10.311+0000 7fc37fff7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26393) UID: 0 2024-09-22T01:38:10.413 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-22T01:38:10.411+0000 7f29443ec640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26389) UID: 0 2024-09-22T01:38:10.446 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:10.446 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [], 2024-09-22T01:38:10.447 INFO:teuthology.orchestra.run.smithi179.stdout: "complaint_time": 30, 2024-09-22T01:38:10.447 INFO:teuthology.orchestra.run.smithi179.stdout: "num_blocked_ops": 0 2024-09-22T01:38:10.447 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:10.461 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:38:10.513 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-09-22T01:38:10.509+0000 7f8dd5680640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26633) UID: 0 2024-09-22T01:38:10.526 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T01:38:10.567 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-22T01:38:10.590 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-22T01:38:10.590 INFO:teuthology.orchestra.run.smithi179.stdout: "size": 20, 2024-09-22T01:38:10.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 600, 2024-09-22T01:38:10.590 INFO:teuthology.orchestra.run.smithi179.stdout: "ops": [ 2024-09-22T01:38:10.590 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.590 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4207.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-22T01:38:10.590 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:38:10.590 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 217.27813135, 2024-09-22T01:38:10.590 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.85115455100000004, 2024-09-22T01:38:10.590 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4207", 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.179:0/3980030444", 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 1 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.591 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309039+0000", 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309041+0000", 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.384e-06 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309056+0000", 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4836e-05 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.592 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309081+0000", 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.514e-05 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309099+0000", 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.736e-05 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309216+0000", 2024-09-22T01:38:10.593 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011723299999999999 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for peered", 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:33.309247+0000", 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 3.0825999999999999e-05 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.156935+0000", 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.84768868799999997 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.594 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157438+0000", 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00050228600000000001 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "waiting for subops from 0", 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.157776+0000", 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00033871999999999998 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "op_commit", 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.159217+0000", 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.001441033 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "sub_op_commit_rec", 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160028+0000", 2024-09-22T01:38:10.595 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00081058699999999998 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "commit_sent", 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160129+0000", 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000101199 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:34:34.160193+0000", 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.4258999999999996e-05 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.596 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10591 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 290816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.74735865400001, 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100694777, 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10591 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.597 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839812+0000", 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839983+0000", 2024-09-22T01:38:10.598 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000171206 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.839990+0000", 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 6.9820000000000002e-06 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840007+0000", 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.7572e-05 2024-09-22T01:38:10.599 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840020+0000", 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2768999999999999e-05 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940154+0000", 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10013372600000001 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.600 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940301+0000", 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014751599999999999 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940506+0000", 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00020500600000000001 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.601 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10592 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 464896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.74713137399999, 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100976128, 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10592 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.602 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.840039+0000", 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842574+0000", 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.002535345 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842583+0000", 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.9679999999999995e-06 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842608+0000", 2024-09-22T01:38:10.604 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.5202e-05 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.842622+0000", 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3295000000000001e-05 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940660+0000", 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098038369 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.605 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.940845+0000", 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000184804 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.941015+0000", 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00017014499999999999 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10613 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 126976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.606 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.74396308999999, 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10083228399999999, 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10613 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.607 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843207+0000", 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843208+0000", 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.6700000000000003e-07 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.608 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843213+0000", 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7679999999999999e-06 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843228+0000", 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5549e-05 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843238+0000", 2024-09-22T01:38:10.609 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0207000000000001e-05 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943681+0000", 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100442514 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.943865+0000", 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00018445700000000001 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.610 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944039+0000", 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000174022 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10614 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 475136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.74387882600001, 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10121527299999999, 2024-09-22T01:38:10.611 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10614 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.612 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843291+0000", 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843293+0000", 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3349999999999999e-06 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843298+0000", 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.4369999999999998e-06 2024-09-22T01:38:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843314+0000", 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5381999999999999e-05 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843325+0000", 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1379000000000001e-05 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.614 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944195+0000", 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10086998899999999 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944338+0000", 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00014331000000000001 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944507+0000", 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000168441 2024-09-22T01:38:10.615 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10615 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 301056~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.74382732999999, 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101533581, 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.616 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10615 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843343+0000", 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.617 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843344+0000", 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2699999999999999e-06 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843349+0000", 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.9069999999999998e-06 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.618 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843363+0000", 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4287000000000001e-05 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843374+0000", 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0366999999999999e-05 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944575+0000", 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101201478 2024-09-22T01:38:10.619 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944710+0000", 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013527100000000001 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944876+0000", 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016600100000000001 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.620 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10616 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 485376~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.74378200999999, 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10186121200000001, 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10616 2024-09-22T01:38:10.621 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.843388+0000", 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.622 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846576+0000", 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0031879299999999998 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846586+0000", 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0147e-05 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846615+0000", 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.8323e-05 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.623 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846629+0000", 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4829e-05 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.944951+0000", 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.098321877000000002 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945083+0000", 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000131691 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.624 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.945249+0000", 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000166415 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10621 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1028096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.74030175300001, 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100659373, 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.625 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10621 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.626 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846868+0000", 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846869+0000", 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.7300000000000005e-07 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846874+0000", 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.437e-06 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.627 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846888+0000", 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4331000000000001e-05 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.846899+0000", 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0727000000000001e-05 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.628 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.946974+0000", 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10007545399999999 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947230+0000", 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000255822 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947528+0000", 2024-09-22T01:38:10.629 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000297829 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10636 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.73999694099999, 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101002826, 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.630 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10636 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.631 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847173+0000", 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847174+0000", 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.124e-06 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.632 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847182+0000", 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.4800000000000004e-06 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847198+0000", 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6158e-05 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847208+0000", 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0156999999999999e-05 2024-09-22T01:38:10.633 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947618+0000", 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10040969900000001 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.947883+0000", 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00026522500000000001 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.634 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948176+0000", 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00029298300000000002 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10637 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.739947497, 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101326187, 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.635 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10637 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.636 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847223+0000", 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847224+0000", 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.6400000000000001e-07 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.637 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847228+0000", 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.578e-06 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847242+0000", 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3539e-05 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847252+0000", 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8709999999999992e-06 2024-09-22T01:38:10.638 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948256+0000", 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10100440500000001 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948384+0000", 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000128501 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.639 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948549+0000", 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016442900000000001 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10638 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 321536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.739902943, 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173623699999999, 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.640 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10638 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.641 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847267+0000", 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847269+0000", 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2929999999999999e-06 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.642 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847273+0000", 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.6720000000000003e-06 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847287+0000", 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3733e-05 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847297+0000", 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0453e-05 2024-09-22T01:38:10.643 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948620+0000", 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101322206 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.948776+0000", 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000156849 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.644 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949003+0000", 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00022703099999999999 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10639 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 495616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.73985929299999, 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102033969, 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.645 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10639 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.646 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847311+0000", 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847312+0000", 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.004e-06 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.647 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847316+0000", 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.3900000000000003e-06 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847329+0000", 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3104e-05 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847344+0000", 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4204e-05 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.648 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949075+0000", 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10173185899999999 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949203+0000", 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012720400000000001 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949345+0000", 2024-09-22T01:38:10.649 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000142204 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10640 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 505856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.73981207200001, 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102385431, 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.650 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10640 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.651 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847358+0000", 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847470+0000", 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00011207199999999999 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847485+0000", 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4501000000000001e-05 2024-09-22T01:38:10.652 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847501+0000", 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6285000000000001e-05 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847513+0000", 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.2191000000000001e-05 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.653 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949413+0000", 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.101899975 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949578+0000", 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00016486800000000001 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949744+0000", 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000165539 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.654 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10641 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 679936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.73961706599999, 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.102525619, 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.655 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10641 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847553+0000", 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.656 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847555+0000", 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.378e-06 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847560+0000", 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 5.7219999999999996e-06 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847576+0000", 2024-09-22T01:38:10.657 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5814000000000001e-05 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847587+0000", 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.0852e-05 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949817+0000", 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10222993800000001 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.658 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.949940+0000", 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.000123423 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950079+0000", 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00013849199999999999 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.659 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10642 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 854016~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.73956757900001, 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10282047699999999, 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10642 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.660 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.847603+0000", 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850639+0000", 2024-09-22T01:38:10.661 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0030361910000000002 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850649+0000", 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.7790000000000007e-06 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850669+0000", 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9956999999999999e-05 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.662 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850683+0000", 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.4029000000000001e-05 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950146+0000", 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099463801000000004 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950269+0000", 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00012218400000000001 2024-09-22T01:38:10.663 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950423+0000", 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00015453600000000001 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10644 3.13 3:c88ddb85:::rbd_data.110f880def8d.0000000000000001:7 [read 1038336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.73641652000001, 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100523715, 2024-09-22T01:38:10.664 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "started", 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10644 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.665 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850754+0000", 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850755+0000", 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1170000000000001e-06 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.666 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850760+0000", 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.7870000000000001e-06 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850776+0000", 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6662000000000001e-05 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.850787+0000", 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1046000000000001e-05 2024-09-22T01:38:10.667 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950758+0000", 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.099970366000000005 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "started", 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.950990+0000", 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00023265100000000001 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.668 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951277+0000", 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.00028708599999999998 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10659 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.73607089199999, 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048778899999999, 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.669 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10659 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.670 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851099+0000", 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851100+0000", 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8700000000000004e-07 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851105+0000", 2024-09-22T01:38:10.671 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.8620000000000002e-06 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851124+0000", 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.9187000000000001e-05 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851135+0000", 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.1201e-05 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.672 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951571+0000", 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435803 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951587+0000", 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5849e-05 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.673 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10661 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.73597546900001, 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10048109, 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.674 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10661 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851195+0000", 2024-09-22T01:38:10.675 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851196+0000", 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8999999999999995e-07 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851209+0000", 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3648999999999999e-05 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.676 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851223+0000", 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3439e-05 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851233+0000", 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8169999999999994e-06 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951660+0000", 2024-09-22T01:38:10.677 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100427712 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951676+0000", 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.5583e-05 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10662 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.678 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.73592289000001, 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.10047415799999999, 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10662 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.679 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851247+0000", 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.680 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851248+0000", 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 8.8299999999999995e-07 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851253+0000", 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 4.5390000000000001e-06 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851266+0000", 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3576e-05 2024-09-22T01:38:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851276+0000", 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.9429999999999995e-06 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951712+0000", 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100435413 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951721+0000", 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 9.8039999999999996e-06 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: "description": "osd_op(client.4367.0:10663 3.13 3.a1dbb113 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: "initiated_at": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: "age": 185.73588112300001, 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.100498959, 2024-09-22T01:38:10.683 INFO:teuthology.orchestra.run.smithi179.stdout: "continuous": false, 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: "type_data": { 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: "flag_point": "reached pg", 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: "client_info": { 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: "client": "client.4367", 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: "client_addr": "172.21.15.18:0/2155978658", 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: "tid": 10663 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: "events": [ 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "initiated", 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:38:10.684 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "header_read", 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.851289+0000", 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "throttled", 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854497+0000", 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.0032078010000000001 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "all_read", 2024-09-22T01:38:10.685 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854505+0000", 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 7.9219999999999997e-06 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "dispatched", 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854525+0000", 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 2.0358999999999999e-05 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "queued_for_pg", 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.854539+0000", 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.3923999999999999e-05 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.686 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "reached_pg", 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951772+0000", 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 0.097232473999999999 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: "event": "done", 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: "time": "2024-09-22T01:35:04.951788+0000", 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: "duration": 1.6478999999999999e-05 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-22T01:38:10.687 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-22T01:38:10.688 INFO:teuthology.orchestra.run.smithi018.stdout:osd.0: {} 2024-09-22T01:38:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-22T01:38:10.689 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-09-22T01:38:10.685+0000 7f2df0afb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26629) UID: 0 2024-09-22T01:38:10.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-22T01:38:10.708 INFO:teuthology.orchestra.run.smithi018.stdout:osd.1: {} 2024-09-22T01:38:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-22T01:38:10.716 INFO:tasks.thrashosds.thrasher:in_osds: [1, 3, 4, 6, 7, 0, 2, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-22T01:38:10.716 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-22T01:38:10.716 INFO:tasks.thrashosds.thrasher:Removing osd 2, in_osds are: [1, 3, 4, 6, 7, 0, 2, 5] 2024-09-22T01:38:10.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 2 2024-09-22T01:38:10.733 INFO:teuthology.orchestra.run.smithi018.stdout:osd.2: {} 2024-09-22T01:38:10.733 INFO:teuthology.orchestra.run.smithi018.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-22T01:38:10.753 INFO:teuthology.orchestra.run.smithi018.stdout:osd.3: {} 2024-09-22T01:38:10.753 INFO:teuthology.orchestra.run.smithi018.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-22T01:38:10.775 INFO:teuthology.orchestra.run.smithi018.stdout:osd.4: {} 2024-09-22T01:38:10.775 INFO:teuthology.orchestra.run.smithi018.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-22T01:38:10.790 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-09-22T01:38:10.789+0000 7fc6bfdaf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26635) UID: 0 2024-09-22T01:38:10.798 INFO:teuthology.orchestra.run.smithi018.stdout:osd.5: {} 2024-09-22T01:38:10.799 INFO:teuthology.orchestra.run.smithi018.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-22T01:38:10.823 INFO:teuthology.orchestra.run.smithi018.stdout:osd.6: {} 2024-09-22T01:38:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-22T01:38:10.842 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:10.842 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:10.847 INFO:teuthology.orchestra.run.smithi018.stdout:osd.7: {} 2024-09-22T01:38:10.847 INFO:teuthology.orchestra.run.smithi018.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-22T01:38:10.872 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-22T01:38:10.882 INFO:teuthology.orchestra.run.smithi018.stdout:All operations completed A-OK! 2024-09-22T01:38:10.921 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-22T01:38:10.919+0000 7fc1ba889640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26395) UID: 0 2024-09-22T01:38:10.921 DEBUG:teuthology.parallel:result is None 2024-09-22T01:38:10.921 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-22T01:38:10.930 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-22T01:38:10.957 INFO:tasks.thrashosds:joining thrashosds 2024-09-22T01:38:10.998 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:10.998 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:11.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-22T01:38:11.047 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-22T01:38:11.043+0000 7fb667fae640 -1 mon.a@0(leader).osd e200 definitely_dead 0 2024-09-22T01:38:11.135 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:11.135 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:11.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-22T01:38:11.317 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:11.317 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:11.332 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-22T01:38:11.460 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:11.461 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:11.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-22T01:38:11.596 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:11.596 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:11.610 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-22T01:38:11.727 INFO:teuthology.orchestra.run.smithi018.stderr:marked out osd.2. 2024-09-22T01:38:11.730 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is set 2024-09-22T01:38:11.754 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:11.754 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:11.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-22T01:38:11.938 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:11.938 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:11.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-22T01:38:12.080 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:12.080 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:12.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-22T01:38:12.213 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:12.213 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:12.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-22T01:38:12.348 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:12.348 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:12.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-22T01:38:12.482 INFO:teuthology.orchestra.run.smithi018.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:12.482 INFO:teuthology.orchestra.run.smithi018.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:12.497 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-22T01:38:12.630 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:12.631 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:12.645 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-22T01:38:12.771 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:12.772 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:12.786 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-22T01:38:12.908 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:12.908 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:12.922 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-22T01:38:13.041 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:13.041 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:13.055 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-22T01:38:13.172 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:13.172 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:13.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-22T01:38:13.303 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:13.303 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:13.318 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-22T01:38:13.436 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:13.436 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:13.451 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-22T01:38:13.571 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:13.571 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:13.585 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-22T01:38:13.709 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:13.710 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:13.724 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-22T01:38:13.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-22T01:38:13.869 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:13.869 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:13.886 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-22T01:38:14.020 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:14.020 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:14.035 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-22T01:38:14.165 INFO:teuthology.orchestra.run.smithi179.stdout:ERROR: (22) Invalid argument 2024-09-22T01:38:14.166 INFO:teuthology.orchestra.run.smithi179.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-22T01:38:14.741 INFO:teuthology.orchestra.run.smithi018.stderr:noscrub is unset 2024-09-22T01:38:14.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-22T01:38:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:nodeep-scrub is unset 2024-09-22T01:38:16.761 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-22T01:38:16.762 INFO:tasks.thrashosds.thrasher:Adding osd 2 2024-09-22T01:38:16.762 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 2 2024-09-22T01:38:17.089 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-22T01:38:17.087+0000 7fb667fae640 -1 mon.a@0(leader).osd e205 definitely_dead 0 2024-09-22T01:38:17.768 INFO:teuthology.orchestra.run.smithi018.stderr:marked in osd.2. 2024-09-22T01:38:17.799 INFO:tasks.thrashosds.thrasher:Added osd 2 2024-09-22T01:38:17.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-22T01:38:17.942 INFO:teuthology.orchestra.run.smithi018.stdout:mon.a: {} 2024-09-22T01:38:17.942 INFO:teuthology.orchestra.run.smithi018.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T01:38:17.955 INFO:teuthology.orchestra.run.smithi018.stdout:mon.b: {} 2024-09-22T01:38:17.956 INFO:teuthology.orchestra.run.smithi018.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T01:38:17.965 INFO:teuthology.orchestra.run.smithi018.stdout:mon.c: {} 2024-09-22T01:38:17.965 INFO:teuthology.orchestra.run.smithi018.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T01:38:17.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T01:38:18.550 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T01:38:18.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-22T01:38:19.542 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-22T01:38:19.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T01:38:20.545 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T01:38:20.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-22T01:38:21.557 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-22T01:38:21.584 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T01:38:22.549 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T01:38:22.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-22T01:38:23.791 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-22T01:38:23.818 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T01:38:24.796 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T01:38:24.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-22T01:38:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-22T01:38:25.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-22T01:38:26.816 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.4 to 1 (10000) 2024-09-22T01:38:26.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-22T01:38:27.833 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-22T01:38:27.858 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-22T01:38:28.837 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.5 to 1 (10000) 2024-09-22T01:38:28.865 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-22T01:38:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-22T01:38:29.873 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-22T01:38:30.863 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.6 to 1 (10000) 2024-09-22T01:38:30.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-22T01:38:31.867 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-22T01:38:31.896 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-22T01:38:32.888 INFO:teuthology.orchestra.run.smithi018.stderr:reweighted osd.7 to 1 (10000) 2024-09-22T01:38:32.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-22T01:38:33.885 INFO:teuthology.orchestra.run.smithi018.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-22T01:38:33.915 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-22T01:38:33.915 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-22T01:38:33.915 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-22T01:38:33.916 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-22T01:38:33.916 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T01:38:33.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T01:38:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:38:34.211 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":222,"fsid":"2d4626ba-577e-46d9-ad53-8451e5733f43","created":"2024-09-22T01:34:18.722829+0000","modified":"2024-09-22T01:38:33.882306+0000","last_up_change":"2024-09-22T01:34:31.284224+0000","last_in_change":"2024-09-22T01:38:17.759354+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T01:34:31.452919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T01:34:36.960578+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-22T01:34:46.686791+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":47,"snap_epoch":200,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8de621b1-0a3b-4b8b-b982-70e8db073085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6825","nonce":1213730345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6827","nonce":1213730345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6831","nonce":1213730345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6829","nonce":1213730345}]},"public_addr":"172.21.15.18:6825/1213730345","cluster_addr":"172.21.15.18:6827/1213730345","heartbeat_back_addr":"172.21.15.18:6831/1213730345","heartbeat_front_addr":"172.21.15.18:6829/1213730345","state":["exists","up"]},{"osd":1,"uuid":"798cbd57-ebd4-461a-9bbf-68e683d1049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6801","nonce":3361514324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6803","nonce":3361514324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6807","nonce":3361514324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6805","nonce":3361514324}]},"public_addr":"172.21.15.18:6801/3361514324","cluster_addr":"172.21.15.18:6803/3361514324","heartbeat_back_addr":"172.21.15.18:6807/3361514324","heartbeat_front_addr":"172.21.15.18:6805/3361514324","state":["exists","up"]},{"osd":2,"uuid":"9294585f-3dc9-4b04-8cae-f8d78c92791e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":209,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6817","nonce":4002178714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6819","nonce":4002178714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6823","nonce":4002178714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6821","nonce":4002178714}]},"public_addr":"172.21.15.18:6817/4002178714","cluster_addr":"172.21.15.18:6819/4002178714","heartbeat_back_addr":"172.21.15.18:6823/4002178714","heartbeat_front_addr":"172.21.15.18:6821/4002178714","state":["exists","up"]},{"osd":3,"uuid":"1ff1abf7-fdbb-4f8a-85e5-90f102abcec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6809","nonce":2610959301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6811","nonce":2610959301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6815","nonce":2610959301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6813","nonce":2610959301}]},"public_addr":"172.21.15.18:6809/2610959301","cluster_addr":"172.21.15.18:6811/2610959301","heartbeat_back_addr":"172.21.15.18:6815/2610959301","heartbeat_front_addr":"172.21.15.18:6813/2610959301","state":["exists","up"]},{"osd":4,"uuid":"9aa2579a-ada1-45f3-9341-f46697c28212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":209,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6825","nonce":482886379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6827","nonce":482886379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6831","nonce":482886379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6829","nonce":482886379}]},"public_addr":"172.21.15.179:6825/482886379","cluster_addr":"172.21.15.179:6827/482886379","heartbeat_back_addr":"172.21.15.179:6831/482886379","heartbeat_front_addr":"172.21.15.179:6829/482886379","state":["exists","up"]},{"osd":5,"uuid":"4a6678eb-28ca-4b05-96ae-e9deeb60ca96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6817","nonce":2695689817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6819","nonce":2695689817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6823","nonce":2695689817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6821","nonce":2695689817}]},"public_addr":"172.21.15.179:6817/2695689817","cluster_addr":"172.21.15.179:6819/2695689817","heartbeat_back_addr":"172.21.15.179:6823/2695689817","heartbeat_front_addr":"172.21.15.179:6821/2695689817","state":["exists","up"]},{"osd":6,"uuid":"775b01e8-5705-4b98-a3ab-f15a78271355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6809","nonce":1840779137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6811","nonce":1840779137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6815","nonce":1840779137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6813","nonce":1840779137}]},"public_addr":"172.21.15.179:6809/1840779137","cluster_addr":"172.21.15.179:6811/1840779137","heartbeat_back_addr":"172.21.15.179:6815/1840779137","heartbeat_front_addr":"172.21.15.179:6813/1840779137","state":["exists","up"]},{"osd":7,"uuid":"15f6d6c1-8a16-42c6-9e43-f3a92e511735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6801","nonce":4222842386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6803","nonce":4222842386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6807","nonce":4222842386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6805","nonce":4222842386}]},"public_addr":"172.21.15.179:6801/4222842386","cluster_addr":"172.21.15.179:6803/4222842386","heartbeat_back_addr":"172.21.15.179:6807/4222842386","heartbeat_front_addr":"172.21.15.179:6805/4222842386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.339566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.065958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.261750+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.463117+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.557372+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.195553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.008891+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:27.839466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T01:38:34.229 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T01:38:34.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T01:38:34.515 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:38:34.515 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":222,"fsid":"2d4626ba-577e-46d9-ad53-8451e5733f43","created":"2024-09-22T01:34:18.722829+0000","modified":"2024-09-22T01:38:33.882306+0000","last_up_change":"2024-09-22T01:34:31.284224+0000","last_in_change":"2024-09-22T01:38:17.759354+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T01:34:31.452919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T01:34:36.960578+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-22T01:34:46.686791+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":47,"snap_epoch":200,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8de621b1-0a3b-4b8b-b982-70e8db073085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6825","nonce":1213730345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6827","nonce":1213730345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6831","nonce":1213730345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6829","nonce":1213730345}]},"public_addr":"172.21.15.18:6825/1213730345","cluster_addr":"172.21.15.18:6827/1213730345","heartbeat_back_addr":"172.21.15.18:6831/1213730345","heartbeat_front_addr":"172.21.15.18:6829/1213730345","state":["exists","up"]},{"osd":1,"uuid":"798cbd57-ebd4-461a-9bbf-68e683d1049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6801","nonce":3361514324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6803","nonce":3361514324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6807","nonce":3361514324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6805","nonce":3361514324}]},"public_addr":"172.21.15.18:6801/3361514324","cluster_addr":"172.21.15.18:6803/3361514324","heartbeat_back_addr":"172.21.15.18:6807/3361514324","heartbeat_front_addr":"172.21.15.18:6805/3361514324","state":["exists","up"]},{"osd":2,"uuid":"9294585f-3dc9-4b04-8cae-f8d78c92791e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":209,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6817","nonce":4002178714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6819","nonce":4002178714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6823","nonce":4002178714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6821","nonce":4002178714}]},"public_addr":"172.21.15.18:6817/4002178714","cluster_addr":"172.21.15.18:6819/4002178714","heartbeat_back_addr":"172.21.15.18:6823/4002178714","heartbeat_front_addr":"172.21.15.18:6821/4002178714","state":["exists","up"]},{"osd":3,"uuid":"1ff1abf7-fdbb-4f8a-85e5-90f102abcec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6809","nonce":2610959301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6811","nonce":2610959301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6815","nonce":2610959301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6813","nonce":2610959301}]},"public_addr":"172.21.15.18:6809/2610959301","cluster_addr":"172.21.15.18:6811/2610959301","heartbeat_back_addr":"172.21.15.18:6815/2610959301","heartbeat_front_addr":"172.21.15.18:6813/2610959301","state":["exists","up"]},{"osd":4,"uuid":"9aa2579a-ada1-45f3-9341-f46697c28212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":209,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6825","nonce":482886379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6827","nonce":482886379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6831","nonce":482886379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6829","nonce":482886379}]},"public_addr":"172.21.15.179:6825/482886379","cluster_addr":"172.21.15.179:6827/482886379","heartbeat_back_addr":"172.21.15.179:6831/482886379","heartbeat_front_addr":"172.21.15.179:6829/482886379","state":["exists","up"]},{"osd":5,"uuid":"4a6678eb-28ca-4b05-96ae-e9deeb60ca96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6817","nonce":2695689817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6819","nonce":2695689817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6823","nonce":2695689817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6821","nonce":2695689817}]},"public_addr":"172.21.15.179:6817/2695689817","cluster_addr":"172.21.15.179:6819/2695689817","heartbeat_back_addr":"172.21.15.179:6823/2695689817","heartbeat_front_addr":"172.21.15.179:6821/2695689817","state":["exists","up"]},{"osd":6,"uuid":"775b01e8-5705-4b98-a3ab-f15a78271355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6809","nonce":1840779137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6811","nonce":1840779137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6815","nonce":1840779137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6813","nonce":1840779137}]},"public_addr":"172.21.15.179:6809/1840779137","cluster_addr":"172.21.15.179:6811/1840779137","heartbeat_back_addr":"172.21.15.179:6815/1840779137","heartbeat_front_addr":"172.21.15.179:6813/1840779137","state":["exists","up"]},{"osd":7,"uuid":"15f6d6c1-8a16-42c6-9e43-f3a92e511735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6801","nonce":4222842386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6803","nonce":4222842386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6807","nonce":4222842386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6805","nonce":4222842386}]},"public_addr":"172.21.15.179:6801/4222842386","cluster_addr":"172.21.15.179:6803/4222842386","heartbeat_back_addr":"172.21.15.179:6807/4222842386","heartbeat_front_addr":"172.21.15.179:6805/4222842386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.339566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.065958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.261750+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.463117+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.557372+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.195553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.008891+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:27.839466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T01:38:34.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T01:38:34.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T01:38:34.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T01:38:34.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T01:38:34.536 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-22T01:38:34.536 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-22T01:38:34.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-22T01:38:34.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-22T01:38:34.793 INFO:teuthology.orchestra.run.smithi018.stdout:55834574900 2024-09-22T01:38:34.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T01:38:34.797 INFO:teuthology.orchestra.run.smithi018.stdout:55834574900 2024-09-22T01:38:34.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-22T01:38:34.810 INFO:teuthology.orchestra.run.smithi018.stdout:55834574901 2024-09-22T01:38:34.811 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T01:38:34.812 INFO:teuthology.orchestra.run.smithi018.stdout:55834574899 2024-09-22T01:38:34.812 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T01:38:34.814 INFO:teuthology.orchestra.run.smithi018.stdout:55834574900 2024-09-22T01:38:34.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-22T01:38:34.821 INFO:teuthology.orchestra.run.smithi018.stdout:55834574900 2024-09-22T01:38:34.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-22T01:38:34.826 INFO:teuthology.orchestra.run.smithi018.stdout:55834574901 2024-09-22T01:38:34.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T01:38:34.827 INFO:teuthology.orchestra.run.smithi018.stdout:55834574899 2024-09-22T01:38:34.828 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-22T01:38:35.324 INFO:teuthology.orchestra.run.smithi018.stdout:55834574900 2024-09-22T01:38:35.350 INFO:teuthology.orchestra.run.smithi018.stdout:55834574899 2024-09-22T01:38:35.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574900 for osd.0 2024-09-22T01:38:35.354 INFO:teuthology.orchestra.run.smithi018.stdout:55834574899 2024-09-22T01:38:35.375 INFO:teuthology.orchestra.run.smithi018.stdout:55834574898 2024-09-22T01:38:35.375 INFO:teuthology.orchestra.run.smithi018.stdout:55834574899 2024-09-22T01:38:35.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574899 for osd.1 2024-09-22T01:38:35.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574899 for osd.4 2024-09-22T01:38:35.386 INFO:teuthology.orchestra.run.smithi018.stdout:55834574898 2024-09-22T01:38:35.390 INFO:teuthology.orchestra.run.smithi018.stdout:55834574900 2024-09-22T01:38:35.395 INFO:teuthology.orchestra.run.smithi018.stdout:55834574899 2024-09-22T01:38:35.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574898 for osd.7 2024-09-22T01:38:35.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574899 for osd.5 2024-09-22T01:38:35.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574900 for osd.3 2024-09-22T01:38:35.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574898 for osd.2 2024-09-22T01:38:35.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574899 for osd.6 2024-09-22T01:38:36.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T01:38:36.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T01:38:36.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-22T01:38:36.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-22T01:38:36.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-22T01:38:36.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T01:38:36.419 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T01:38:36.423 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-22T01:38:36.860 INFO:teuthology.orchestra.run.smithi018.stdout:55834574901 2024-09-22T01:38:36.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574901 for osd.0 2024-09-22T01:38:36.885 DEBUG:teuthology.parallel:result is None 2024-09-22T01:38:36.924 INFO:teuthology.orchestra.run.smithi018.stdout:55834574900 2024-09-22T01:38:36.933 INFO:teuthology.orchestra.run.smithi018.stdout:55834574900 2024-09-22T01:38:36.935 INFO:teuthology.orchestra.run.smithi018.stdout:55834574900 2024-09-22T01:38:36.948 INFO:teuthology.orchestra.run.smithi018.stdout:55834574899 2024-09-22T01:38:36.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574900 for osd.4 2024-09-22T01:38:36.954 DEBUG:teuthology.parallel:result is None 2024-09-22T01:38:36.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574900 for osd.5 2024-09-22T01:38:36.957 DEBUG:teuthology.parallel:result is None 2024-09-22T01:38:36.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574900 for osd.1 2024-09-22T01:38:36.968 DEBUG:teuthology.parallel:result is None 2024-09-22T01:38:36.971 INFO:teuthology.orchestra.run.smithi018.stdout:55834574899 2024-09-22T01:38:36.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574899 for osd.7 2024-09-22T01:38:36.979 DEBUG:teuthology.parallel:result is None 2024-09-22T01:38:36.985 INFO:teuthology.orchestra.run.smithi018.stdout:55834574900 2024-09-22T01:38:36.987 INFO:teuthology.orchestra.run.smithi018.stdout:55834574901 2024-09-22T01:38:36.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574899 for osd.2 2024-09-22T01:38:36.989 DEBUG:teuthology.parallel:result is None 2024-09-22T01:38:37.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574900 for osd.6 2024-09-22T01:38:37.006 DEBUG:teuthology.parallel:result is None 2024-09-22T01:38:37.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574901 for osd.3 2024-09-22T01:38:37.008 DEBUG:teuthology.parallel:result is None 2024-09-22T01:38:37.008 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T01:38:37.008 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:38:37.337 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:38:37.338 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:38:37.355 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-22T01:38:35.441309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":158,"num_read":199153,"num_read_kb":1036614,"num_write":21550,"num_write_kb":543951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7705,"num_bytes_recovered":423839947,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19208,"ondisk_log_size":19208,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431248,"kb_used_data":22108,"kb_used_omap":12,"kb_used_meta":408947,"kb_avail":754543472,"statfs":{"total":773094113280,"available":772652515328,"internally_reserved":0,"allocated":22638592,"data_stored":11590442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":418762288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001073"},"pg_stats":[{"pgid":"3.1f","version":"200'725","reported_seq":6350,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.894747+0000","last_change":"2024-09-22T01:38:10.733388+0000","last_active":"2024-09-22T01:38:33.894747+0000","last_peered":"2024-09-22T01:38:33.894747+0000","last_clean":"2024-09-22T01:38:33.894747+0000","last_became_active":"2024-09-22T01:37:55.543472+0000","last_became_peered":"2024-09-22T01:37:55.543472+0000","last_unstale":"2024-09-22T01:38:33.894747+0000","last_undegraded":"2024-09-22T01:38:33.894747+0000","last_fullsized":"2024-09-22T01:38:33.894747+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:55:58.422492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003797618,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6872,"num_read_kb":35444,"num_write":908,"num_write_kb":14992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":471,"num_bytes_recovered":26513955,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'595","reported_seq":4885,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.889470+0000","last_change":"2024-09-22T01:38:10.718270+0000","last_active":"2024-09-22T01:38:33.889470+0000","last_peered":"2024-09-22T01:38:33.889470+0000","last_clean":"2024-09-22T01:38:33.889470+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:38:33.889470+0000","last_undegraded":"2024-09-22T01:38:33.889470+0000","last_fullsized":"2024-09-22T01:38:33.889470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:34:42.187105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013742629999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6272,"num_read_kb":47931,"num_write":611,"num_write_kb":23751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"192'1025","reported_seq":3547,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.596998+0000","last_change":"2024-09-22T01:38:10.722087+0000","last_active":"2024-09-22T01:38:34.596998+0000","last_peered":"2024-09-22T01:38:34.596998+0000","last_clean":"2024-09-22T01:38:34.596998+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:38:34.596998+0000","last_undegraded":"2024-09-22T01:38:34.596998+0000","last_fullsized":"2024-09-22T01:38:34.596998+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1025,"log_dups_size":0,"ondisk_log_size":1025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:23:49.654245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040346269999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5544,"num_read_kb":33914,"num_write":1530,"num_write_kb":16573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"200'301","reported_seq":3042,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.596938+0000","last_change":"2024-09-22T01:38:10.719510+0000","last_active":"2024-09-22T01:38:34.596938+0000","last_peered":"2024-09-22T01:38:34.596938+0000","last_clean":"2024-09-22T01:38:34.596938+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:38:34.596938+0000","last_undegraded":"2024-09-22T01:38:34.596938+0000","last_fullsized":"2024-09-22T01:38:34.596938+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:22.141096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001909486,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2195,"num_read_kb":35041,"num_write":325,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"199'1171","reported_seq":5655,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.894058+0000","last_change":"2024-09-22T01:38:10.733439+0000","last_active":"2024-09-22T01:38:33.894058+0000","last_peered":"2024-09-22T01:38:33.894058+0000","last_clean":"2024-09-22T01:38:33.894058+0000","last_became_active":"2024-09-22T01:37:55.544664+0000","last_became_peered":"2024-09-22T01:37:55.544664+0000","last_unstale":"2024-09-22T01:38:33.894058+0000","last_undegraded":"2024-09-22T01:38:33.894058+0000","last_fullsized":"2024-09-22T01:38:33.894058+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:19:31.181548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037623719999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9924,"num_read_kb":24565,"num_write":1636,"num_write_kb":13745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":17295622,"num_keys_recovered":162,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'501","reported_seq":5492,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.889319+0000","last_change":"2024-09-22T01:38:10.728240+0000","last_active":"2024-09-22T01:38:33.889319+0000","last_peered":"2024-09-22T01:38:33.889319+0000","last_clean":"2024-09-22T01:38:33.889319+0000","last_became_active":"2024-09-22T01:37:52.551423+0000","last_became_peered":"2024-09-22T01:37:52.551423+0000","last_unstale":"2024-09-22T01:38:33.889319+0000","last_undegraded":"2024-09-22T01:38:33.889319+0000","last_fullsized":"2024-09-22T01:38:33.889319+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:27:12.516388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040494620000000002,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":4854,"num_read_kb":40179,"num_write":503,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'860","reported_seq":9667,"reported_epoch":221,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.379283+0000","last_change":"2024-09-22T01:38:10.851316+0000","last_active":"2024-09-22T01:38:33.379283+0000","last_peered":"2024-09-22T01:38:33.379283+0000","last_clean":"2024-09-22T01:38:33.379283+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:38:33.379283+0000","last_undegraded":"2024-09-22T01:38:33.379283+0000","last_fullsized":"2024-09-22T01:38:33.379283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:03.606419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014346890000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10611,"num_read_kb":63679,"num_write":1135,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"189'946","reported_seq":3715,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.889135+0000","last_change":"2024-09-22T01:38:10.719184+0000","last_active":"2024-09-22T01:38:33.889135+0000","last_peered":"2024-09-22T01:38:33.889135+0000","last_clean":"2024-09-22T01:38:33.889135+0000","last_became_active":"2024-09-22T01:37:55.541794+0000","last_became_peered":"2024-09-22T01:37:55.541794+0000","last_unstale":"2024-09-22T01:38:33.889135+0000","last_undegraded":"2024-09-22T01:38:33.889135+0000","last_fullsized":"2024-09-22T01:38:33.889135+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:13.936798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020228920000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1485,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":2375363,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"197'537","reported_seq":6374,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.894862+0000","last_change":"2024-09-22T01:38:10.732478+0000","last_active":"2024-09-22T01:38:33.894862+0000","last_peered":"2024-09-22T01:38:33.894862+0000","last_clean":"2024-09-22T01:38:33.894862+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:38:33.894862+0000","last_undegraded":"2024-09-22T01:38:33.894862+0000","last_fullsized":"2024-09-22T01:38:33.894862+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:05:12.010523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028964960000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6199,"num_read_kb":32488,"num_write":514,"num_write_kb":34060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"194'705","reported_seq":14971,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.597186+0000","last_change":"2024-09-22T01:38:10.719590+0000","last_active":"2024-09-22T01:38:34.597186+0000","last_peered":"2024-09-22T01:38:34.597186+0000","last_clean":"2024-09-22T01:38:34.597186+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:38:34.597186+0000","last_undegraded":"2024-09-22T01:38:34.597186+0000","last_fullsized":"2024-09-22T01:38:34.597186+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:31:21.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018802389999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":14794,"num_read_kb":34409,"num_write":702,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"194'298","reported_seq":5179,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.893402+0000","last_change":"2024-09-22T01:38:10.876772+0000","last_active":"2024-09-22T01:38:33.893402+0000","last_peered":"2024-09-22T01:38:33.893402+0000","last_clean":"2024-09-22T01:38:33.893402+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:38:33.893402+0000","last_undegraded":"2024-09-22T01:38:33.893402+0000","last_fullsized":"2024-09-22T01:38:33.893402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:21:02.333056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002237429,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4129,"num_read_kb":34295,"num_write":247,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"198'437","reported_seq":6698,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.889319+0000","last_change":"2024-09-22T01:38:10.726480+0000","last_active":"2024-09-22T01:38:33.889319+0000","last_peered":"2024-09-22T01:38:33.889319+0000","last_clean":"2024-09-22T01:38:33.889319+0000","last_became_active":"2024-09-22T01:37:52.550304+0000","last_became_peered":"2024-09-22T01:37:52.550304+0000","last_unstale":"2024-09-22T01:38:33.889319+0000","last_undegraded":"2024-09-22T01:38:33.889319+0000","last_fullsized":"2024-09-22T01:38:33.889319+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:09:12.974811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029114100000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6427,"num_read_kb":54267,"num_write":376,"num_write_kb":20603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":440,"reported_epoch":221,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.010470+0000","last_change":"2024-09-22T01:37:51.552938+0000","last_active":"2024-09-22T01:38:33.010470+0000","last_peered":"2024-09-22T01:38:33.010470+0000","last_clean":"2024-09-22T01:38:33.010470+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:38:33.010470+0000","last_undegraded":"2024-09-22T01:38:33.010470+0000","last_fullsized":"2024-09-22T01:38:33.010470+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:20.798595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"200'512","reported_seq":6230,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.894598+0000","last_change":"2024-09-22T01:38:10.732138+0000","last_active":"2024-09-22T01:38:33.894598+0000","last_peered":"2024-09-22T01:38:33.894598+0000","last_clean":"2024-09-22T01:38:33.894598+0000","last_became_active":"2024-09-22T01:37:55.544363+0000","last_became_peered":"2024-09-22T01:37:55.544363+0000","last_unstale":"2024-09-22T01:38:33.894598+0000","last_undegraded":"2024-09-22T01:38:33.894598+0000","last_fullsized":"2024-09-22T01:38:33.894598+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:30:41.669758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028137370000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5201,"num_read_kb":38761,"num_write":409,"num_write_kb":38186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":46874722,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":421,"reported_epoch":221,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.379396+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:38:33.379396+0000","last_peered":"2024-09-22T01:38:33.379396+0000","last_clean":"2024-09-22T01:38:33.379396+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:38:33.379396+0000","last_undegraded":"2024-09-22T01:38:33.379396+0000","last_fullsized":"2024-09-22T01:38:33.379396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"199'371","reported_seq":3616,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.889457+0000","last_change":"2024-09-22T01:38:10.720206+0000","last_active":"2024-09-22T01:38:33.889457+0000","last_peered":"2024-09-22T01:38:33.889457+0000","last_clean":"2024-09-22T01:38:33.889457+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:38:33.889457+0000","last_undegraded":"2024-09-22T01:38:33.889457+0000","last_fullsized":"2024-09-22T01:38:33.889457+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:48:59.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026027870000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":3471,"num_read_kb":20726,"num_write":356,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":310,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.893163+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:38:33.893163+0000","last_peered":"2024-09-22T01:38:33.893163+0000","last_clean":"2024-09-22T01:38:33.893163+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:38:33.893163+0000","last_undegraded":"2024-09-22T01:38:33.893163+0000","last_fullsized":"2024-09-22T01:38:33.893163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"200'620","reported_seq":4734,"reported_epoch":221,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.379306+0000","last_change":"2024-09-22T01:38:22.557835+0000","last_active":"2024-09-22T01:38:33.379306+0000","last_peered":"2024-09-22T01:38:33.379306+0000","last_clean":"2024-09-22T01:38:33.379306+0000","last_became_active":"2024-09-22T01:38:22.556550+0000","last_became_peered":"2024-09-22T01:38:22.556550+0000","last_unstale":"2024-09-22T01:38:33.379306+0000","last_undegraded":"2024-09-22T01:38:33.379306+0000","last_fullsized":"2024-09-22T01:38:33.379306+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:37.414319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014576910000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5589,"num_read_kb":37802,"num_write":624,"num_write_kb":11232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":221,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.379435+0000","last_change":"2024-09-22T01:38:22.618094+0000","last_active":"2024-09-22T01:38:33.379435+0000","last_peered":"2024-09-22T01:38:33.379435+0000","last_clean":"2024-09-22T01:38:33.379435+0000","last_became_active":"2024-09-22T01:38:22.617578+0000","last_became_peered":"2024-09-22T01:38:22.617578+0000","last_unstale":"2024-09-22T01:38:33.379435+0000","last_undegraded":"2024-09-22T01:38:33.379435+0000","last_fullsized":"2024-09-22T01:38:33.379435+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:28.231940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'514","reported_seq":8219,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.597177+0000","last_change":"2024-09-22T01:38:10.721771+0000","last_active":"2024-09-22T01:38:34.597177+0000","last_peered":"2024-09-22T01:38:34.597177+0000","last_clean":"2024-09-22T01:38:34.597177+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:38:34.597177+0000","last_undegraded":"2024-09-22T01:38:34.597177+0000","last_fullsized":"2024-09-22T01:38:34.597177+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:29:02.007042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036439129999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":8480,"num_read_kb":54220,"num_write":523,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"200'431","reported_seq":1821,"reported_epoch":221,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.010401+0000","last_change":"2024-09-22T01:38:10.723787+0000","last_active":"2024-09-22T01:38:33.010401+0000","last_peered":"2024-09-22T01:38:33.010401+0000","last_clean":"2024-09-22T01:38:33.010401+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:38:33.010401+0000","last_undegraded":"2024-09-22T01:38:33.010401+0000","last_fullsized":"2024-09-22T01:38:33.010401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:11.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002825424,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":1512,"num_read_kb":6460,"num_write":402,"num_write_kb":3582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":170,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.596875+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:38:34.596875+0000","last_peered":"2024-09-22T01:38:34.596875+0000","last_clean":"2024-09-22T01:38:34.596875+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:38:34.596875+0000","last_undegraded":"2024-09-22T01:38:34.596875+0000","last_fullsized":"2024-09-22T01:38:34.596875+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"198'518","reported_seq":4477,"reported_epoch":221,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.379284+0000","last_change":"2024-09-22T01:38:21.559272+0000","last_active":"2024-09-22T01:38:33.379284+0000","last_peered":"2024-09-22T01:38:33.379284+0000","last_clean":"2024-09-22T01:38:33.379284+0000","last_became_active":"2024-09-22T01:38:21.557572+0000","last_became_peered":"2024-09-22T01:38:21.557572+0000","last_unstale":"2024-09-22T01:38:33.379284+0000","last_undegraded":"2024-09-22T01:38:33.379284+0000","last_fullsized":"2024-09-22T01:38:33.379284+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:14:50.230801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001437699,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4350,"num_read_kb":14870,"num_write":524,"num_write_kb":23558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.887633+0000","last_change":"2024-09-22T01:38:18.600969+0000","last_active":"2024-09-22T01:38:33.887633+0000","last_peered":"2024-09-22T01:38:33.887633+0000","last_clean":"2024-09-22T01:38:33.887633+0000","last_became_active":"2024-09-22T01:38:18.600600+0000","last_became_peered":"2024-09-22T01:38:18.600600+0000","last_unstale":"2024-09-22T01:38:33.887633+0000","last_undegraded":"2024-09-22T01:38:33.887633+0000","last_fullsized":"2024-09-22T01:38:33.887633+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:59:40.488792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"199'558","reported_seq":5301,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.894031+0000","last_change":"2024-09-22T01:38:10.731424+0000","last_active":"2024-09-22T01:38:33.894031+0000","last_peered":"2024-09-22T01:38:33.894031+0000","last_clean":"2024-09-22T01:38:33.894031+0000","last_became_active":"2024-09-22T01:37:53.571926+0000","last_became_peered":"2024-09-22T01:37:53.571926+0000","last_unstale":"2024-09-22T01:38:33.894031+0000","last_undegraded":"2024-09-22T01:38:33.894031+0000","last_fullsized":"2024-09-22T01:38:33.894031+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:31:16.964826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002041817,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":5042,"num_read_kb":25966,"num_write":576,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":305,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.892808+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:38:33.892808+0000","last_peered":"2024-09-22T01:38:33.892808+0000","last_clean":"2024-09-22T01:38:33.892808+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:38:33.892808+0000","last_undegraded":"2024-09-22T01:38:33.892808+0000","last_fullsized":"2024-09-22T01:38:33.892808+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"199'462","reported_seq":2783,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.889540+0000","last_change":"2024-09-22T01:38:10.718052+0000","last_active":"2024-09-22T01:38:33.889540+0000","last_peered":"2024-09-22T01:38:33.889540+0000","last_clean":"2024-09-22T01:38:33.889540+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:38:33.889540+0000","last_undegraded":"2024-09-22T01:38:33.889540+0000","last_fullsized":"2024-09-22T01:38:33.889540+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:08.277366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011708179999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2672,"num_read_kb":16190,"num_write":487,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":188,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.596760+0000","last_change":"2024-09-22T01:38:18.559667+0000","last_active":"2024-09-22T01:38:34.596760+0000","last_peered":"2024-09-22T01:38:34.596760+0000","last_clean":"2024-09-22T01:38:34.596760+0000","last_became_active":"2024-09-22T01:38:18.549611+0000","last_became_peered":"2024-09-22T01:38:18.549611+0000","last_unstale":"2024-09-22T01:38:34.596760+0000","last_undegraded":"2024-09-22T01:38:34.596760+0000","last_fullsized":"2024-09-22T01:38:34.596760+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:23:17.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":553,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.892905+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:38:33.892905+0000","last_peered":"2024-09-22T01:38:33.892905+0000","last_clean":"2024-09-22T01:38:33.892905+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:38:33.892905+0000","last_undegraded":"2024-09-22T01:38:33.892905+0000","last_fullsized":"2024-09-22T01:38:33.892905+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"200'710","reported_seq":2753,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.888857+0000","last_change":"2024-09-22T01:38:10.718846+0000","last_active":"2024-09-22T01:38:33.888857+0000","last_peered":"2024-09-22T01:38:33.888857+0000","last_clean":"2024-09-22T01:38:33.888857+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:38:33.888857+0000","last_undegraded":"2024-09-22T01:38:33.888857+0000","last_fullsized":"2024-09-22T01:38:33.888857+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:07.740863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019014889999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7238,"num_read_kb":52542,"num_write":881,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"200'459","reported_seq":6082,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.889037+0000","last_change":"2024-09-22T01:38:21.562582+0000","last_active":"2024-09-22T01:38:33.889037+0000","last_peered":"2024-09-22T01:38:33.889037+0000","last_clean":"2024-09-22T01:38:33.889037+0000","last_became_active":"2024-09-22T01:38:21.558253+0000","last_became_peered":"2024-09-22T01:38:21.558253+0000","last_unstale":"2024-09-22T01:38:33.889037+0000","last_undegraded":"2024-09-22T01:38:33.889037+0000","last_fullsized":"2024-09-22T01:38:33.889037+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:40.979341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001663412,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4390,"num_read_kb":53937,"num_write":461,"num_write_kb":17688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":594,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"200'635","reported_seq":14812,"reported_epoch":221,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.010430+0000","last_change":"2024-09-22T01:38:10.724616+0000","last_active":"2024-09-22T01:38:33.010430+0000","last_peered":"2024-09-22T01:38:33.010430+0000","last_clean":"2024-09-22T01:38:33.010430+0000","last_became_active":"2024-09-22T01:37:53.540222+0000","last_became_peered":"2024-09-22T01:37:53.540222+0000","last_unstale":"2024-09-22T01:38:33.010430+0000","last_undegraded":"2024-09-22T01:38:33.010430+0000","last_fullsized":"2024-09-22T01:38:33.010430+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:37.067471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003616101,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":15637,"num_read_kb":20649,"num_write":595,"num_write_kb":18769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2278048,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"199'443","reported_seq":3506,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.889886+0000","last_change":"2024-09-22T01:38:10.720117+0000","last_active":"2024-09-22T01:38:33.889886+0000","last_peered":"2024-09-22T01:38:33.889886+0000","last_clean":"2024-09-22T01:38:33.889886+0000","last_became_active":"2024-09-22T01:38:09.556931+0000","last_became_peered":"2024-09-22T01:38:09.556931+0000","last_unstale":"2024-09-22T01:38:33.889886+0000","last_undegraded":"2024-09-22T01:38:33.889886+0000","last_fullsized":"2024-09-22T01:38:33.889886+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:53.849962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027549219999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2831,"num_read_kb":14353,"num_write":499,"num_write_kb":9050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":11719816,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"199'567","reported_seq":6036,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.596992+0000","last_change":"2024-09-22T01:38:10.718677+0000","last_active":"2024-09-22T01:38:34.596992+0000","last_peered":"2024-09-22T01:38:34.596992+0000","last_clean":"2024-09-22T01:38:34.596992+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:38:34.596992+0000","last_undegraded":"2024-09-22T01:38:34.596992+0000","last_fullsized":"2024-09-22T01:38:34.596992+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:11.101496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095552699999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6990,"num_read_kb":34807,"num_write":525,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"195'504","reported_seq":5023,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.893677+0000","last_change":"2024-09-22T01:38:10.878997+0000","last_active":"2024-09-22T01:38:33.893677+0000","last_peered":"2024-09-22T01:38:33.893677+0000","last_clean":"2024-09-22T01:38:33.893677+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:38:33.893677+0000","last_undegraded":"2024-09-22T01:38:33.893677+0000","last_fullsized":"2024-09-22T01:38:33.893677+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:42.271093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043325960000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5598,"num_read_kb":19917,"num_write":545,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"199'719","reported_seq":4658,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.893633+0000","last_change":"2024-09-22T01:38:10.878033+0000","last_active":"2024-09-22T01:38:33.893633+0000","last_peered":"2024-09-22T01:38:33.893633+0000","last_clean":"2024-09-22T01:38:33.893633+0000","last_became_active":"2024-09-22T01:37:52.551465+0000","last_became_peered":"2024-09-22T01:37:52.551465+0000","last_unstale":"2024-09-22T01:38:33.893633+0000","last_undegraded":"2024-09-22T01:38:33.893633+0000","last_fullsized":"2024-09-22T01:38:33.893633+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:44:14.540874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003391972,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4576,"num_read_kb":18630,"num_write":892,"num_write_kb":13182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"195'719","reported_seq":3676,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.893914+0000","last_change":"2024-09-22T01:38:10.880113+0000","last_active":"2024-09-22T01:38:33.893914+0000","last_peered":"2024-09-22T01:38:33.893914+0000","last_clean":"2024-09-22T01:38:33.893914+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:38:33.893914+0000","last_undegraded":"2024-09-22T01:38:33.893914+0000","last_fullsized":"2024-09-22T01:38:33.893914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:08.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104090000000003,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5534,"num_read_kb":24700,"num_write":880,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"197'714","reported_seq":3401,"reported_epoch":221,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.010373+0000","last_change":"2024-09-22T01:38:10.724283+0000","last_active":"2024-09-22T01:38:33.010373+0000","last_peered":"2024-09-22T01:38:33.010373+0000","last_clean":"2024-09-22T01:38:33.010373+0000","last_became_active":"2024-09-22T01:37:55.549740+0000","last_became_peered":"2024-09-22T01:37:55.549740+0000","last_unstale":"2024-09-22T01:38:33.010373+0000","last_undegraded":"2024-09-22T01:38:33.010373+0000","last_fullsized":"2024-09-22T01:38:33.010373+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:19.659250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034685710000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4516,"num_read_kb":14551,"num_write":804,"num_write_kb":16271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":7558660,"num_keys_recovered":94,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'391","reported_seq":5797,"reported_epoch":222,"state":"peering","last_fresh":"2024-09-22T01:38:33.893745+0000","last_change":"2024-09-22T01:38:33.893745+0000","last_active":"2024-09-22T01:38:33.893745+0000","last_peered":"2024-09-22T01:38:05.684296+0000","last_clean":"2024-09-22T01:38:05.684296+0000","last_became_active":"2024-09-22T01:38:00.647506+0000","last_became_peered":"2024-09-22T01:38:00.647506+0000","last_unstale":"2024-09-22T01:38:33.893745+0000","last_undegraded":"2024-09-22T01:38:33.893745+0000","last_fullsized":"2024-09-22T01:38:33.893745+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081673900000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4801,"num_read_kb":46850,"num_write":333,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'488","reported_seq":5318,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.894191+0000","last_change":"2024-09-22T01:38:10.730581+0000","last_active":"2024-09-22T01:38:33.894191+0000","last_peered":"2024-09-22T01:38:33.894191+0000","last_clean":"2024-09-22T01:38:33.894191+0000","last_became_active":"2024-09-22T01:37:54.552738+0000","last_became_peered":"2024-09-22T01:37:54.552738+0000","last_unstale":"2024-09-22T01:38:33.894191+0000","last_undegraded":"2024-09-22T01:38:33.894191+0000","last_fullsized":"2024-09-22T01:38:33.894191+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:47.324243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012133160000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5061,"num_read_kb":18985,"num_write":533,"num_write_kb":10276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":8748779,"num_keys_recovered":66,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"195'652","reported_seq":11542,"reported_epoch":222,"state":"active+clean","last_fresh":"2024-09-22T01:38:33.892965+0000","last_change":"2024-09-22T01:38:10.881356+0000","last_active":"2024-09-22T01:38:33.892965+0000","last_peered":"2024-09-22T01:38:33.892965+0000","last_clean":"2024-09-22T01:38:33.892965+0000","last_became_active":"2024-09-22T01:37:53.541188+0000","last_became_peered":"2024-09-22T01:37:53.541188+0000","last_unstale":"2024-09-22T01:38:33.892965+0000","last_undegraded":"2024-09-22T01:38:33.892965+0000","last_fullsized":"2024-09-22T01:38:33.892965+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:43.737368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064999480000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":12287,"num_read_kb":47236,"num_write":568,"num_write_kb":13755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":329,"num_bytes_recovered":11479448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":158,"num_read":199037,"num_read_kb":1036514,"num_write":21389,"num_write_kb":541533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7692,"num_bytes_recovered":422659173,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19088,"ondisk_log_size":19088,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64924,"kb_used_data":3204,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306916,"statfs":{"total":96636764160,"available":96570281984,"internally_reserved":0,"allocated":3280896,"data_stored":1895223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":2612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":2674688,"data_stored":1299013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60172,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311668,"statfs":{"total":96636764160,"available":96575148032,"internally_reserved":0,"allocated":2678784,"data_stored":1299032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74076,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297764,"statfs":{"total":96636764160,"available":96560910336,"internally_reserved":0,"allocated":2691072,"data_stored":1304874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47700,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324140,"statfs":{"total":96636764160,"available":96587919360,"internally_reserved":0,"allocated":2686976,"data_stored":1304855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37980,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333860,"statfs":{"total":96636764160,"available":96597872640,"internally_reserved":0,"allocated":2686976,"data_stored":1304855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60180,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311660,"statfs":{"total":96636764160,"available":96575139840,"internally_reserved":0,"allocated":2682880,"data_stored":1299051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52416,"kb_used_data":3180,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319424,"statfs":{"total":96636764160,"available":96583090176,"internally_reserved":0,"allocated":3256320,"data_stored":1883539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:38:37.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:38:37.659 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:38:37.660 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:38:37.676 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-22T01:38:37.441845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":158,"num_read":199153,"num_read_kb":1036614,"num_write":21550,"num_write_kb":543951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7705,"num_bytes_recovered":423839947,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19208,"ondisk_log_size":19208,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431408,"kb_used_data":22264,"kb_used_omap":12,"kb_used_meta":408947,"kb_avail":754543312,"statfs":{"total":773094113280,"available":772652351488,"internally_reserved":0,"allocated":22798336,"data_stored":11666388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":418762288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.573122"},"pg_stats":[{"pgid":"3.1f","version":"200'725","reported_seq":6352,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347294+0000","last_change":"2024-09-22T01:38:10.733388+0000","last_active":"2024-09-22T01:38:35.347294+0000","last_peered":"2024-09-22T01:38:35.347294+0000","last_clean":"2024-09-22T01:38:35.347294+0000","last_became_active":"2024-09-22T01:37:55.543472+0000","last_became_peered":"2024-09-22T01:37:55.543472+0000","last_unstale":"2024-09-22T01:38:35.347294+0000","last_undegraded":"2024-09-22T01:38:35.347294+0000","last_fullsized":"2024-09-22T01:38:35.347294+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:55:58.422492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003797618,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6872,"num_read_kb":35444,"num_write":908,"num_write_kb":14992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":471,"num_bytes_recovered":26513955,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'595","reported_seq":4887,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896594+0000","last_change":"2024-09-22T01:38:10.718270+0000","last_active":"2024-09-22T01:38:34.896594+0000","last_peered":"2024-09-22T01:38:34.896594+0000","last_clean":"2024-09-22T01:38:34.896594+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:38:34.896594+0000","last_undegraded":"2024-09-22T01:38:34.896594+0000","last_fullsized":"2024-09-22T01:38:34.896594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:34:42.187105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013742629999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6272,"num_read_kb":47931,"num_write":611,"num_write_kb":23751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"192'1025","reported_seq":3549,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357872+0000","last_change":"2024-09-22T01:38:10.722087+0000","last_active":"2024-09-22T01:38:35.357872+0000","last_peered":"2024-09-22T01:38:35.357872+0000","last_clean":"2024-09-22T01:38:35.357872+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:38:35.357872+0000","last_undegraded":"2024-09-22T01:38:35.357872+0000","last_fullsized":"2024-09-22T01:38:35.357872+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1025,"log_dups_size":0,"ondisk_log_size":1025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:23:49.654245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040346269999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5544,"num_read_kb":33914,"num_write":1530,"num_write_kb":16573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"200'301","reported_seq":3044,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357569+0000","last_change":"2024-09-22T01:38:10.719510+0000","last_active":"2024-09-22T01:38:35.357569+0000","last_peered":"2024-09-22T01:38:35.357569+0000","last_clean":"2024-09-22T01:38:35.357569+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:38:35.357569+0000","last_undegraded":"2024-09-22T01:38:35.357569+0000","last_fullsized":"2024-09-22T01:38:35.357569+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:22.141096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001909486,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2195,"num_read_kb":35041,"num_write":325,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"199'1171","reported_seq":5657,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347210+0000","last_change":"2024-09-22T01:38:10.733439+0000","last_active":"2024-09-22T01:38:35.347210+0000","last_peered":"2024-09-22T01:38:35.347210+0000","last_clean":"2024-09-22T01:38:35.347210+0000","last_became_active":"2024-09-22T01:37:55.544664+0000","last_became_peered":"2024-09-22T01:37:55.544664+0000","last_unstale":"2024-09-22T01:38:35.347210+0000","last_undegraded":"2024-09-22T01:38:35.347210+0000","last_fullsized":"2024-09-22T01:38:35.347210+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:19:31.181548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037623719999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9924,"num_read_kb":24565,"num_write":1636,"num_write_kb":13745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":17295622,"num_keys_recovered":162,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'501","reported_seq":5494,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.901120+0000","last_change":"2024-09-22T01:38:10.728240+0000","last_active":"2024-09-22T01:38:34.901120+0000","last_peered":"2024-09-22T01:38:34.901120+0000","last_clean":"2024-09-22T01:38:34.901120+0000","last_became_active":"2024-09-22T01:37:52.551423+0000","last_became_peered":"2024-09-22T01:37:52.551423+0000","last_unstale":"2024-09-22T01:38:34.901120+0000","last_undegraded":"2024-09-22T01:38:34.901120+0000","last_fullsized":"2024-09-22T01:38:34.901120+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:27:12.516388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040494620000000002,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":4854,"num_read_kb":40179,"num_write":503,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'860","reported_seq":9670,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079513+0000","last_change":"2024-09-22T01:38:10.851316+0000","last_active":"2024-09-22T01:38:35.079513+0000","last_peered":"2024-09-22T01:38:35.079513+0000","last_clean":"2024-09-22T01:38:35.079513+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:38:35.079513+0000","last_undegraded":"2024-09-22T01:38:35.079513+0000","last_fullsized":"2024-09-22T01:38:35.079513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:03.606419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014346890000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10611,"num_read_kb":63679,"num_write":1135,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"189'946","reported_seq":3717,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896437+0000","last_change":"2024-09-22T01:38:10.719184+0000","last_active":"2024-09-22T01:38:34.896437+0000","last_peered":"2024-09-22T01:38:34.896437+0000","last_clean":"2024-09-22T01:38:34.896437+0000","last_became_active":"2024-09-22T01:37:55.541794+0000","last_became_peered":"2024-09-22T01:37:55.541794+0000","last_unstale":"2024-09-22T01:38:34.896437+0000","last_undegraded":"2024-09-22T01:38:34.896437+0000","last_fullsized":"2024-09-22T01:38:34.896437+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:13.936798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020228920000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1485,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":2375363,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"197'537","reported_seq":6376,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347339+0000","last_change":"2024-09-22T01:38:10.732478+0000","last_active":"2024-09-22T01:38:35.347339+0000","last_peered":"2024-09-22T01:38:35.347339+0000","last_clean":"2024-09-22T01:38:35.347339+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:38:35.347339+0000","last_undegraded":"2024-09-22T01:38:35.347339+0000","last_fullsized":"2024-09-22T01:38:35.347339+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:05:12.010523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028964960000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6199,"num_read_kb":32488,"num_write":514,"num_write_kb":34060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"194'705","reported_seq":14973,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357742+0000","last_change":"2024-09-22T01:38:10.719590+0000","last_active":"2024-09-22T01:38:35.357742+0000","last_peered":"2024-09-22T01:38:35.357742+0000","last_clean":"2024-09-22T01:38:35.357742+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:38:35.357742+0000","last_undegraded":"2024-09-22T01:38:35.357742+0000","last_fullsized":"2024-09-22T01:38:35.357742+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:31:21.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018802389999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":14794,"num_read_kb":34409,"num_write":702,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"194'298","reported_seq":5181,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904227+0000","last_change":"2024-09-22T01:38:10.876772+0000","last_active":"2024-09-22T01:38:34.904227+0000","last_peered":"2024-09-22T01:38:34.904227+0000","last_clean":"2024-09-22T01:38:34.904227+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:38:34.904227+0000","last_undegraded":"2024-09-22T01:38:34.904227+0000","last_fullsized":"2024-09-22T01:38:34.904227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:21:02.333056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002237429,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4129,"num_read_kb":34295,"num_write":247,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"198'437","reported_seq":6700,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.901138+0000","last_change":"2024-09-22T01:38:10.726480+0000","last_active":"2024-09-22T01:38:34.901138+0000","last_peered":"2024-09-22T01:38:34.901138+0000","last_clean":"2024-09-22T01:38:34.901138+0000","last_became_active":"2024-09-22T01:37:52.550304+0000","last_became_peered":"2024-09-22T01:37:52.550304+0000","last_unstale":"2024-09-22T01:38:34.901138+0000","last_undegraded":"2024-09-22T01:38:34.901138+0000","last_fullsized":"2024-09-22T01:38:34.901138+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:09:12.974811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029114100000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6427,"num_read_kb":54267,"num_write":376,"num_write_kb":20603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":443,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083680+0000","last_change":"2024-09-22T01:37:51.552938+0000","last_active":"2024-09-22T01:38:35.083680+0000","last_peered":"2024-09-22T01:38:35.083680+0000","last_clean":"2024-09-22T01:38:35.083680+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:38:35.083680+0000","last_undegraded":"2024-09-22T01:38:35.083680+0000","last_fullsized":"2024-09-22T01:38:35.083680+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:20.798595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"200'512","reported_seq":6232,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347244+0000","last_change":"2024-09-22T01:38:10.732138+0000","last_active":"2024-09-22T01:38:35.347244+0000","last_peered":"2024-09-22T01:38:35.347244+0000","last_clean":"2024-09-22T01:38:35.347244+0000","last_became_active":"2024-09-22T01:37:55.544363+0000","last_became_peered":"2024-09-22T01:37:55.544363+0000","last_unstale":"2024-09-22T01:38:35.347244+0000","last_undegraded":"2024-09-22T01:38:35.347244+0000","last_fullsized":"2024-09-22T01:38:35.347244+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:30:41.669758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028137370000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5201,"num_read_kb":38761,"num_write":409,"num_write_kb":38186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":46874722,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":424,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079990+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:38:35.079990+0000","last_peered":"2024-09-22T01:38:35.079990+0000","last_clean":"2024-09-22T01:38:35.079990+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:38:35.079990+0000","last_undegraded":"2024-09-22T01:38:35.079990+0000","last_fullsized":"2024-09-22T01:38:35.079990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"199'371","reported_seq":3618,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896657+0000","last_change":"2024-09-22T01:38:10.720206+0000","last_active":"2024-09-22T01:38:34.896657+0000","last_peered":"2024-09-22T01:38:34.896657+0000","last_clean":"2024-09-22T01:38:34.896657+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:38:34.896657+0000","last_undegraded":"2024-09-22T01:38:34.896657+0000","last_fullsized":"2024-09-22T01:38:34.896657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:48:59.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026027870000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":3471,"num_read_kb":20726,"num_write":356,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":312,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904225+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:38:34.904225+0000","last_peered":"2024-09-22T01:38:34.904225+0000","last_clean":"2024-09-22T01:38:34.904225+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:38:34.904225+0000","last_undegraded":"2024-09-22T01:38:34.904225+0000","last_fullsized":"2024-09-22T01:38:34.904225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"200'620","reported_seq":4737,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079641+0000","last_change":"2024-09-22T01:38:22.557835+0000","last_active":"2024-09-22T01:38:35.079641+0000","last_peered":"2024-09-22T01:38:35.079641+0000","last_clean":"2024-09-22T01:38:35.079641+0000","last_became_active":"2024-09-22T01:38:22.556550+0000","last_became_peered":"2024-09-22T01:38:22.556550+0000","last_unstale":"2024-09-22T01:38:35.079641+0000","last_undegraded":"2024-09-22T01:38:35.079641+0000","last_fullsized":"2024-09-22T01:38:35.079641+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:37.414319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014576910000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5589,"num_read_kb":37802,"num_write":624,"num_write_kb":11232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079797+0000","last_change":"2024-09-22T01:38:22.618094+0000","last_active":"2024-09-22T01:38:35.079797+0000","last_peered":"2024-09-22T01:38:35.079797+0000","last_clean":"2024-09-22T01:38:35.079797+0000","last_became_active":"2024-09-22T01:38:22.617578+0000","last_became_peered":"2024-09-22T01:38:22.617578+0000","last_unstale":"2024-09-22T01:38:35.079797+0000","last_undegraded":"2024-09-22T01:38:35.079797+0000","last_fullsized":"2024-09-22T01:38:35.079797+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:28.231940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'514","reported_seq":8221,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357890+0000","last_change":"2024-09-22T01:38:10.721771+0000","last_active":"2024-09-22T01:38:35.357890+0000","last_peered":"2024-09-22T01:38:35.357890+0000","last_clean":"2024-09-22T01:38:35.357890+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:38:35.357890+0000","last_undegraded":"2024-09-22T01:38:35.357890+0000","last_fullsized":"2024-09-22T01:38:35.357890+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:29:02.007042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036439129999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":8480,"num_read_kb":54220,"num_write":523,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"200'431","reported_seq":1824,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.084232+0000","last_change":"2024-09-22T01:38:10.723787+0000","last_active":"2024-09-22T01:38:35.084232+0000","last_peered":"2024-09-22T01:38:35.084232+0000","last_clean":"2024-09-22T01:38:35.084232+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:38:35.084232+0000","last_undegraded":"2024-09-22T01:38:35.084232+0000","last_fullsized":"2024-09-22T01:38:35.084232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:11.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002825424,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":1512,"num_read_kb":6460,"num_write":402,"num_write_kb":3582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":172,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357532+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:38:35.357532+0000","last_peered":"2024-09-22T01:38:35.357532+0000","last_clean":"2024-09-22T01:38:35.357532+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:38:35.357532+0000","last_undegraded":"2024-09-22T01:38:35.357532+0000","last_fullsized":"2024-09-22T01:38:35.357532+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"198'518","reported_seq":4480,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079647+0000","last_change":"2024-09-22T01:38:21.559272+0000","last_active":"2024-09-22T01:38:35.079647+0000","last_peered":"2024-09-22T01:38:35.079647+0000","last_clean":"2024-09-22T01:38:35.079647+0000","last_became_active":"2024-09-22T01:38:21.557572+0000","last_became_peered":"2024-09-22T01:38:21.557572+0000","last_unstale":"2024-09-22T01:38:35.079647+0000","last_undegraded":"2024-09-22T01:38:35.079647+0000","last_fullsized":"2024-09-22T01:38:35.079647+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:14:50.230801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001437699,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4350,"num_read_kb":14870,"num_write":524,"num_write_kb":23558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.902327+0000","last_change":"2024-09-22T01:38:18.600969+0000","last_active":"2024-09-22T01:38:34.902327+0000","last_peered":"2024-09-22T01:38:34.902327+0000","last_clean":"2024-09-22T01:38:34.902327+0000","last_became_active":"2024-09-22T01:38:18.600600+0000","last_became_peered":"2024-09-22T01:38:18.600600+0000","last_unstale":"2024-09-22T01:38:34.902327+0000","last_undegraded":"2024-09-22T01:38:34.902327+0000","last_fullsized":"2024-09-22T01:38:34.902327+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:59:40.488792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"199'558","reported_seq":5303,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347072+0000","last_change":"2024-09-22T01:38:10.731424+0000","last_active":"2024-09-22T01:38:35.347072+0000","last_peered":"2024-09-22T01:38:35.347072+0000","last_clean":"2024-09-22T01:38:35.347072+0000","last_became_active":"2024-09-22T01:37:53.571926+0000","last_became_peered":"2024-09-22T01:37:53.571926+0000","last_unstale":"2024-09-22T01:38:35.347072+0000","last_undegraded":"2024-09-22T01:38:35.347072+0000","last_fullsized":"2024-09-22T01:38:35.347072+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:31:16.964826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002041817,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":5042,"num_read_kb":25966,"num_write":576,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903756+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:38:34.903756+0000","last_peered":"2024-09-22T01:38:34.903756+0000","last_clean":"2024-09-22T01:38:34.903756+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:38:34.903756+0000","last_undegraded":"2024-09-22T01:38:34.903756+0000","last_fullsized":"2024-09-22T01:38:34.903756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"199'462","reported_seq":2785,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896568+0000","last_change":"2024-09-22T01:38:10.718052+0000","last_active":"2024-09-22T01:38:34.896568+0000","last_peered":"2024-09-22T01:38:34.896568+0000","last_clean":"2024-09-22T01:38:34.896568+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:38:34.896568+0000","last_undegraded":"2024-09-22T01:38:34.896568+0000","last_fullsized":"2024-09-22T01:38:34.896568+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:08.277366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011708179999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2672,"num_read_kb":16190,"num_write":487,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":190,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357506+0000","last_change":"2024-09-22T01:38:18.559667+0000","last_active":"2024-09-22T01:38:35.357506+0000","last_peered":"2024-09-22T01:38:35.357506+0000","last_clean":"2024-09-22T01:38:35.357506+0000","last_became_active":"2024-09-22T01:38:18.549611+0000","last_became_peered":"2024-09-22T01:38:18.549611+0000","last_unstale":"2024-09-22T01:38:35.357506+0000","last_undegraded":"2024-09-22T01:38:35.357506+0000","last_fullsized":"2024-09-22T01:38:35.357506+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:23:17.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":555,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903846+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:38:34.903846+0000","last_peered":"2024-09-22T01:38:34.903846+0000","last_clean":"2024-09-22T01:38:34.903846+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:38:34.903846+0000","last_undegraded":"2024-09-22T01:38:34.903846+0000","last_fullsized":"2024-09-22T01:38:34.903846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"200'710","reported_seq":2755,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896397+0000","last_change":"2024-09-22T01:38:10.718846+0000","last_active":"2024-09-22T01:38:34.896397+0000","last_peered":"2024-09-22T01:38:34.896397+0000","last_clean":"2024-09-22T01:38:34.896397+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:38:34.896397+0000","last_undegraded":"2024-09-22T01:38:34.896397+0000","last_fullsized":"2024-09-22T01:38:34.896397+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:07.740863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019014889999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7238,"num_read_kb":52542,"num_write":881,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"200'459","reported_seq":6084,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.900835+0000","last_change":"2024-09-22T01:38:21.562582+0000","last_active":"2024-09-22T01:38:34.900835+0000","last_peered":"2024-09-22T01:38:34.900835+0000","last_clean":"2024-09-22T01:38:34.900835+0000","last_became_active":"2024-09-22T01:38:21.558253+0000","last_became_peered":"2024-09-22T01:38:21.558253+0000","last_unstale":"2024-09-22T01:38:34.900835+0000","last_undegraded":"2024-09-22T01:38:34.900835+0000","last_fullsized":"2024-09-22T01:38:34.900835+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:40.979341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001663412,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4390,"num_read_kb":53937,"num_write":461,"num_write_kb":17688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":594,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"200'635","reported_seq":14815,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083618+0000","last_change":"2024-09-22T01:38:10.724616+0000","last_active":"2024-09-22T01:38:35.083618+0000","last_peered":"2024-09-22T01:38:35.083618+0000","last_clean":"2024-09-22T01:38:35.083618+0000","last_became_active":"2024-09-22T01:37:53.540222+0000","last_became_peered":"2024-09-22T01:37:53.540222+0000","last_unstale":"2024-09-22T01:38:35.083618+0000","last_undegraded":"2024-09-22T01:38:35.083618+0000","last_fullsized":"2024-09-22T01:38:35.083618+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:37.067471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003616101,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":15637,"num_read_kb":20649,"num_write":595,"num_write_kb":18769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2278048,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"199'443","reported_seq":3508,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896518+0000","last_change":"2024-09-22T01:38:10.720117+0000","last_active":"2024-09-22T01:38:34.896518+0000","last_peered":"2024-09-22T01:38:34.896518+0000","last_clean":"2024-09-22T01:38:34.896518+0000","last_became_active":"2024-09-22T01:38:09.556931+0000","last_became_peered":"2024-09-22T01:38:09.556931+0000","last_unstale":"2024-09-22T01:38:34.896518+0000","last_undegraded":"2024-09-22T01:38:34.896518+0000","last_fullsized":"2024-09-22T01:38:34.896518+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:53.849962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027549219999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2831,"num_read_kb":14353,"num_write":499,"num_write_kb":9050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":11719816,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"199'567","reported_seq":6038,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357579+0000","last_change":"2024-09-22T01:38:10.718677+0000","last_active":"2024-09-22T01:38:35.357579+0000","last_peered":"2024-09-22T01:38:35.357579+0000","last_clean":"2024-09-22T01:38:35.357579+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:38:35.357579+0000","last_undegraded":"2024-09-22T01:38:35.357579+0000","last_fullsized":"2024-09-22T01:38:35.357579+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:11.101496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095552699999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6990,"num_read_kb":34807,"num_write":525,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"195'504","reported_seq":5025,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904493+0000","last_change":"2024-09-22T01:38:10.878997+0000","last_active":"2024-09-22T01:38:34.904493+0000","last_peered":"2024-09-22T01:38:34.904493+0000","last_clean":"2024-09-22T01:38:34.904493+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:38:34.904493+0000","last_undegraded":"2024-09-22T01:38:34.904493+0000","last_fullsized":"2024-09-22T01:38:34.904493+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:42.271093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043325960000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5598,"num_read_kb":19917,"num_write":545,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"199'719","reported_seq":4660,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904179+0000","last_change":"2024-09-22T01:38:10.878033+0000","last_active":"2024-09-22T01:38:34.904179+0000","last_peered":"2024-09-22T01:38:34.904179+0000","last_clean":"2024-09-22T01:38:34.904179+0000","last_became_active":"2024-09-22T01:37:52.551465+0000","last_became_peered":"2024-09-22T01:37:52.551465+0000","last_unstale":"2024-09-22T01:38:34.904179+0000","last_undegraded":"2024-09-22T01:38:34.904179+0000","last_fullsized":"2024-09-22T01:38:34.904179+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:44:14.540874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003391972,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4576,"num_read_kb":18630,"num_write":892,"num_write_kb":13182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"195'719","reported_seq":3678,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904380+0000","last_change":"2024-09-22T01:38:10.880113+0000","last_active":"2024-09-22T01:38:34.904380+0000","last_peered":"2024-09-22T01:38:34.904380+0000","last_clean":"2024-09-22T01:38:34.904380+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:38:34.904380+0000","last_undegraded":"2024-09-22T01:38:34.904380+0000","last_fullsized":"2024-09-22T01:38:34.904380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:08.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104090000000003,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5534,"num_read_kb":24700,"num_write":880,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"197'714","reported_seq":3404,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083601+0000","last_change":"2024-09-22T01:38:10.724283+0000","last_active":"2024-09-22T01:38:35.083601+0000","last_peered":"2024-09-22T01:38:35.083601+0000","last_clean":"2024-09-22T01:38:35.083601+0000","last_became_active":"2024-09-22T01:37:55.549740+0000","last_became_peered":"2024-09-22T01:37:55.549740+0000","last_unstale":"2024-09-22T01:38:35.083601+0000","last_undegraded":"2024-09-22T01:38:35.083601+0000","last_fullsized":"2024-09-22T01:38:35.083601+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:19.659250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034685710000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4516,"num_read_kb":14551,"num_write":804,"num_write_kb":16271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":7558660,"num_keys_recovered":94,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'391","reported_seq":5805,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.909473+0000","last_change":"2024-09-22T01:38:34.909473+0000","last_active":"2024-09-22T01:38:34.909473+0000","last_peered":"2024-09-22T01:38:34.909473+0000","last_clean":"2024-09-22T01:38:34.909473+0000","last_became_active":"2024-09-22T01:38:34.906641+0000","last_became_peered":"2024-09-22T01:38:34.906641+0000","last_unstale":"2024-09-22T01:38:34.909473+0000","last_undegraded":"2024-09-22T01:38:34.909473+0000","last_fullsized":"2024-09-22T01:38:34.909473+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:15.996636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081673900000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4801,"num_read_kb":46850,"num_write":333,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'488","reported_seq":5320,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347078+0000","last_change":"2024-09-22T01:38:10.730581+0000","last_active":"2024-09-22T01:38:35.347078+0000","last_peered":"2024-09-22T01:38:35.347078+0000","last_clean":"2024-09-22T01:38:35.347078+0000","last_became_active":"2024-09-22T01:37:54.552738+0000","last_became_peered":"2024-09-22T01:37:54.552738+0000","last_unstale":"2024-09-22T01:38:35.347078+0000","last_undegraded":"2024-09-22T01:38:35.347078+0000","last_fullsized":"2024-09-22T01:38:35.347078+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:47.324243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012133160000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5061,"num_read_kb":18985,"num_write":533,"num_write_kb":10276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":8748779,"num_keys_recovered":66,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"195'652","reported_seq":11544,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903908+0000","last_change":"2024-09-22T01:38:10.881356+0000","last_active":"2024-09-22T01:38:34.903908+0000","last_peered":"2024-09-22T01:38:34.903908+0000","last_clean":"2024-09-22T01:38:34.903908+0000","last_became_active":"2024-09-22T01:37:53.541188+0000","last_became_peered":"2024-09-22T01:37:53.541188+0000","last_unstale":"2024-09-22T01:38:34.903908+0000","last_undegraded":"2024-09-22T01:38:34.903908+0000","last_fullsized":"2024-09-22T01:38:34.903908+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:43.737368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064999480000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":12287,"num_read_kb":47236,"num_write":568,"num_write_kb":13755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":329,"num_bytes_recovered":11479448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":158,"num_read":199037,"num_read_kb":1036514,"num_write":21389,"num_write_kb":541533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7692,"num_bytes_recovered":422659173,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19088,"ondisk_log_size":19088,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64940,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306900,"statfs":{"total":96636764160,"available":96570265600,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74092,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297748,"statfs":{"total":96636764160,"available":96560893952,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47716,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324124,"statfs":{"total":96636764160,"available":96587902976,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37984,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333856,"statfs":{"total":96636764160,"available":96597868544,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2707456,"data_stored":1310735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52452,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319388,"statfs":{"total":96636764160,"available":96583053312,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:38:37.678 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T01:38:37.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-22T01:38:37.986 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-22T01:38:37.996 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T01:38:37.996 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:38:38.305 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:38:38.305 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:38:38.324 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-22T01:38:37.441845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":158,"num_read":199153,"num_read_kb":1036614,"num_write":21550,"num_write_kb":543951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7705,"num_bytes_recovered":423839947,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19208,"ondisk_log_size":19208,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431408,"kb_used_data":22264,"kb_used_omap":12,"kb_used_meta":408947,"kb_avail":754543312,"statfs":{"total":773094113280,"available":772652351488,"internally_reserved":0,"allocated":22798336,"data_stored":11666388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":418762288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.573122"},"pg_stats":[{"pgid":"3.1f","version":"200'725","reported_seq":6352,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347294+0000","last_change":"2024-09-22T01:38:10.733388+0000","last_active":"2024-09-22T01:38:35.347294+0000","last_peered":"2024-09-22T01:38:35.347294+0000","last_clean":"2024-09-22T01:38:35.347294+0000","last_became_active":"2024-09-22T01:37:55.543472+0000","last_became_peered":"2024-09-22T01:37:55.543472+0000","last_unstale":"2024-09-22T01:38:35.347294+0000","last_undegraded":"2024-09-22T01:38:35.347294+0000","last_fullsized":"2024-09-22T01:38:35.347294+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:55:58.422492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003797618,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6872,"num_read_kb":35444,"num_write":908,"num_write_kb":14992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":471,"num_bytes_recovered":26513955,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'595","reported_seq":4887,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896594+0000","last_change":"2024-09-22T01:38:10.718270+0000","last_active":"2024-09-22T01:38:34.896594+0000","last_peered":"2024-09-22T01:38:34.896594+0000","last_clean":"2024-09-22T01:38:34.896594+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:38:34.896594+0000","last_undegraded":"2024-09-22T01:38:34.896594+0000","last_fullsized":"2024-09-22T01:38:34.896594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:34:42.187105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013742629999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6272,"num_read_kb":47931,"num_write":611,"num_write_kb":23751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"192'1025","reported_seq":3549,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357872+0000","last_change":"2024-09-22T01:38:10.722087+0000","last_active":"2024-09-22T01:38:35.357872+0000","last_peered":"2024-09-22T01:38:35.357872+0000","last_clean":"2024-09-22T01:38:35.357872+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:38:35.357872+0000","last_undegraded":"2024-09-22T01:38:35.357872+0000","last_fullsized":"2024-09-22T01:38:35.357872+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1025,"log_dups_size":0,"ondisk_log_size":1025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:23:49.654245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040346269999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5544,"num_read_kb":33914,"num_write":1530,"num_write_kb":16573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"200'301","reported_seq":3044,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357569+0000","last_change":"2024-09-22T01:38:10.719510+0000","last_active":"2024-09-22T01:38:35.357569+0000","last_peered":"2024-09-22T01:38:35.357569+0000","last_clean":"2024-09-22T01:38:35.357569+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:38:35.357569+0000","last_undegraded":"2024-09-22T01:38:35.357569+0000","last_fullsized":"2024-09-22T01:38:35.357569+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:22.141096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001909486,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2195,"num_read_kb":35041,"num_write":325,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"199'1171","reported_seq":5657,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347210+0000","last_change":"2024-09-22T01:38:10.733439+0000","last_active":"2024-09-22T01:38:35.347210+0000","last_peered":"2024-09-22T01:38:35.347210+0000","last_clean":"2024-09-22T01:38:35.347210+0000","last_became_active":"2024-09-22T01:37:55.544664+0000","last_became_peered":"2024-09-22T01:37:55.544664+0000","last_unstale":"2024-09-22T01:38:35.347210+0000","last_undegraded":"2024-09-22T01:38:35.347210+0000","last_fullsized":"2024-09-22T01:38:35.347210+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:19:31.181548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037623719999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9924,"num_read_kb":24565,"num_write":1636,"num_write_kb":13745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":17295622,"num_keys_recovered":162,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'501","reported_seq":5494,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.901120+0000","last_change":"2024-09-22T01:38:10.728240+0000","last_active":"2024-09-22T01:38:34.901120+0000","last_peered":"2024-09-22T01:38:34.901120+0000","last_clean":"2024-09-22T01:38:34.901120+0000","last_became_active":"2024-09-22T01:37:52.551423+0000","last_became_peered":"2024-09-22T01:37:52.551423+0000","last_unstale":"2024-09-22T01:38:34.901120+0000","last_undegraded":"2024-09-22T01:38:34.901120+0000","last_fullsized":"2024-09-22T01:38:34.901120+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:27:12.516388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040494620000000002,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":4854,"num_read_kb":40179,"num_write":503,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'860","reported_seq":9670,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079513+0000","last_change":"2024-09-22T01:38:10.851316+0000","last_active":"2024-09-22T01:38:35.079513+0000","last_peered":"2024-09-22T01:38:35.079513+0000","last_clean":"2024-09-22T01:38:35.079513+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:38:35.079513+0000","last_undegraded":"2024-09-22T01:38:35.079513+0000","last_fullsized":"2024-09-22T01:38:35.079513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:03.606419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014346890000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10611,"num_read_kb":63679,"num_write":1135,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"189'946","reported_seq":3717,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896437+0000","last_change":"2024-09-22T01:38:10.719184+0000","last_active":"2024-09-22T01:38:34.896437+0000","last_peered":"2024-09-22T01:38:34.896437+0000","last_clean":"2024-09-22T01:38:34.896437+0000","last_became_active":"2024-09-22T01:37:55.541794+0000","last_became_peered":"2024-09-22T01:37:55.541794+0000","last_unstale":"2024-09-22T01:38:34.896437+0000","last_undegraded":"2024-09-22T01:38:34.896437+0000","last_fullsized":"2024-09-22T01:38:34.896437+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:13.936798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020228920000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1485,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":2375363,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"197'537","reported_seq":6376,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347339+0000","last_change":"2024-09-22T01:38:10.732478+0000","last_active":"2024-09-22T01:38:35.347339+0000","last_peered":"2024-09-22T01:38:35.347339+0000","last_clean":"2024-09-22T01:38:35.347339+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:38:35.347339+0000","last_undegraded":"2024-09-22T01:38:35.347339+0000","last_fullsized":"2024-09-22T01:38:35.347339+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:05:12.010523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028964960000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6199,"num_read_kb":32488,"num_write":514,"num_write_kb":34060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"194'705","reported_seq":14973,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357742+0000","last_change":"2024-09-22T01:38:10.719590+0000","last_active":"2024-09-22T01:38:35.357742+0000","last_peered":"2024-09-22T01:38:35.357742+0000","last_clean":"2024-09-22T01:38:35.357742+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:38:35.357742+0000","last_undegraded":"2024-09-22T01:38:35.357742+0000","last_fullsized":"2024-09-22T01:38:35.357742+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:31:21.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018802389999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":14794,"num_read_kb":34409,"num_write":702,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"194'298","reported_seq":5181,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904227+0000","last_change":"2024-09-22T01:38:10.876772+0000","last_active":"2024-09-22T01:38:34.904227+0000","last_peered":"2024-09-22T01:38:34.904227+0000","last_clean":"2024-09-22T01:38:34.904227+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:38:34.904227+0000","last_undegraded":"2024-09-22T01:38:34.904227+0000","last_fullsized":"2024-09-22T01:38:34.904227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:21:02.333056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002237429,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4129,"num_read_kb":34295,"num_write":247,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"198'437","reported_seq":6700,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.901138+0000","last_change":"2024-09-22T01:38:10.726480+0000","last_active":"2024-09-22T01:38:34.901138+0000","last_peered":"2024-09-22T01:38:34.901138+0000","last_clean":"2024-09-22T01:38:34.901138+0000","last_became_active":"2024-09-22T01:37:52.550304+0000","last_became_peered":"2024-09-22T01:37:52.550304+0000","last_unstale":"2024-09-22T01:38:34.901138+0000","last_undegraded":"2024-09-22T01:38:34.901138+0000","last_fullsized":"2024-09-22T01:38:34.901138+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:09:12.974811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029114100000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6427,"num_read_kb":54267,"num_write":376,"num_write_kb":20603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":443,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083680+0000","last_change":"2024-09-22T01:37:51.552938+0000","last_active":"2024-09-22T01:38:35.083680+0000","last_peered":"2024-09-22T01:38:35.083680+0000","last_clean":"2024-09-22T01:38:35.083680+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:38:35.083680+0000","last_undegraded":"2024-09-22T01:38:35.083680+0000","last_fullsized":"2024-09-22T01:38:35.083680+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:20.798595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"200'512","reported_seq":6232,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347244+0000","last_change":"2024-09-22T01:38:10.732138+0000","last_active":"2024-09-22T01:38:35.347244+0000","last_peered":"2024-09-22T01:38:35.347244+0000","last_clean":"2024-09-22T01:38:35.347244+0000","last_became_active":"2024-09-22T01:37:55.544363+0000","last_became_peered":"2024-09-22T01:37:55.544363+0000","last_unstale":"2024-09-22T01:38:35.347244+0000","last_undegraded":"2024-09-22T01:38:35.347244+0000","last_fullsized":"2024-09-22T01:38:35.347244+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:30:41.669758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028137370000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5201,"num_read_kb":38761,"num_write":409,"num_write_kb":38186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":46874722,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":424,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079990+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:38:35.079990+0000","last_peered":"2024-09-22T01:38:35.079990+0000","last_clean":"2024-09-22T01:38:35.079990+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:38:35.079990+0000","last_undegraded":"2024-09-22T01:38:35.079990+0000","last_fullsized":"2024-09-22T01:38:35.079990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"199'371","reported_seq":3618,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896657+0000","last_change":"2024-09-22T01:38:10.720206+0000","last_active":"2024-09-22T01:38:34.896657+0000","last_peered":"2024-09-22T01:38:34.896657+0000","last_clean":"2024-09-22T01:38:34.896657+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:38:34.896657+0000","last_undegraded":"2024-09-22T01:38:34.896657+0000","last_fullsized":"2024-09-22T01:38:34.896657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:48:59.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026027870000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":3471,"num_read_kb":20726,"num_write":356,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":312,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904225+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:38:34.904225+0000","last_peered":"2024-09-22T01:38:34.904225+0000","last_clean":"2024-09-22T01:38:34.904225+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:38:34.904225+0000","last_undegraded":"2024-09-22T01:38:34.904225+0000","last_fullsized":"2024-09-22T01:38:34.904225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"200'620","reported_seq":4737,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079641+0000","last_change":"2024-09-22T01:38:22.557835+0000","last_active":"2024-09-22T01:38:35.079641+0000","last_peered":"2024-09-22T01:38:35.079641+0000","last_clean":"2024-09-22T01:38:35.079641+0000","last_became_active":"2024-09-22T01:38:22.556550+0000","last_became_peered":"2024-09-22T01:38:22.556550+0000","last_unstale":"2024-09-22T01:38:35.079641+0000","last_undegraded":"2024-09-22T01:38:35.079641+0000","last_fullsized":"2024-09-22T01:38:35.079641+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:37.414319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014576910000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5589,"num_read_kb":37802,"num_write":624,"num_write_kb":11232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079797+0000","last_change":"2024-09-22T01:38:22.618094+0000","last_active":"2024-09-22T01:38:35.079797+0000","last_peered":"2024-09-22T01:38:35.079797+0000","last_clean":"2024-09-22T01:38:35.079797+0000","last_became_active":"2024-09-22T01:38:22.617578+0000","last_became_peered":"2024-09-22T01:38:22.617578+0000","last_unstale":"2024-09-22T01:38:35.079797+0000","last_undegraded":"2024-09-22T01:38:35.079797+0000","last_fullsized":"2024-09-22T01:38:35.079797+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:28.231940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'514","reported_seq":8221,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357890+0000","last_change":"2024-09-22T01:38:10.721771+0000","last_active":"2024-09-22T01:38:35.357890+0000","last_peered":"2024-09-22T01:38:35.357890+0000","last_clean":"2024-09-22T01:38:35.357890+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:38:35.357890+0000","last_undegraded":"2024-09-22T01:38:35.357890+0000","last_fullsized":"2024-09-22T01:38:35.357890+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:29:02.007042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036439129999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":8480,"num_read_kb":54220,"num_write":523,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"200'431","reported_seq":1824,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.084232+0000","last_change":"2024-09-22T01:38:10.723787+0000","last_active":"2024-09-22T01:38:35.084232+0000","last_peered":"2024-09-22T01:38:35.084232+0000","last_clean":"2024-09-22T01:38:35.084232+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:38:35.084232+0000","last_undegraded":"2024-09-22T01:38:35.084232+0000","last_fullsized":"2024-09-22T01:38:35.084232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:11.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002825424,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":1512,"num_read_kb":6460,"num_write":402,"num_write_kb":3582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":172,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357532+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:38:35.357532+0000","last_peered":"2024-09-22T01:38:35.357532+0000","last_clean":"2024-09-22T01:38:35.357532+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:38:35.357532+0000","last_undegraded":"2024-09-22T01:38:35.357532+0000","last_fullsized":"2024-09-22T01:38:35.357532+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"198'518","reported_seq":4480,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079647+0000","last_change":"2024-09-22T01:38:21.559272+0000","last_active":"2024-09-22T01:38:35.079647+0000","last_peered":"2024-09-22T01:38:35.079647+0000","last_clean":"2024-09-22T01:38:35.079647+0000","last_became_active":"2024-09-22T01:38:21.557572+0000","last_became_peered":"2024-09-22T01:38:21.557572+0000","last_unstale":"2024-09-22T01:38:35.079647+0000","last_undegraded":"2024-09-22T01:38:35.079647+0000","last_fullsized":"2024-09-22T01:38:35.079647+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:14:50.230801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001437699,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4350,"num_read_kb":14870,"num_write":524,"num_write_kb":23558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.902327+0000","last_change":"2024-09-22T01:38:18.600969+0000","last_active":"2024-09-22T01:38:34.902327+0000","last_peered":"2024-09-22T01:38:34.902327+0000","last_clean":"2024-09-22T01:38:34.902327+0000","last_became_active":"2024-09-22T01:38:18.600600+0000","last_became_peered":"2024-09-22T01:38:18.600600+0000","last_unstale":"2024-09-22T01:38:34.902327+0000","last_undegraded":"2024-09-22T01:38:34.902327+0000","last_fullsized":"2024-09-22T01:38:34.902327+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:59:40.488792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"199'558","reported_seq":5303,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347072+0000","last_change":"2024-09-22T01:38:10.731424+0000","last_active":"2024-09-22T01:38:35.347072+0000","last_peered":"2024-09-22T01:38:35.347072+0000","last_clean":"2024-09-22T01:38:35.347072+0000","last_became_active":"2024-09-22T01:37:53.571926+0000","last_became_peered":"2024-09-22T01:37:53.571926+0000","last_unstale":"2024-09-22T01:38:35.347072+0000","last_undegraded":"2024-09-22T01:38:35.347072+0000","last_fullsized":"2024-09-22T01:38:35.347072+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:31:16.964826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002041817,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":5042,"num_read_kb":25966,"num_write":576,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903756+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:38:34.903756+0000","last_peered":"2024-09-22T01:38:34.903756+0000","last_clean":"2024-09-22T01:38:34.903756+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:38:34.903756+0000","last_undegraded":"2024-09-22T01:38:34.903756+0000","last_fullsized":"2024-09-22T01:38:34.903756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"199'462","reported_seq":2785,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896568+0000","last_change":"2024-09-22T01:38:10.718052+0000","last_active":"2024-09-22T01:38:34.896568+0000","last_peered":"2024-09-22T01:38:34.896568+0000","last_clean":"2024-09-22T01:38:34.896568+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:38:34.896568+0000","last_undegraded":"2024-09-22T01:38:34.896568+0000","last_fullsized":"2024-09-22T01:38:34.896568+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:08.277366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011708179999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2672,"num_read_kb":16190,"num_write":487,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":190,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357506+0000","last_change":"2024-09-22T01:38:18.559667+0000","last_active":"2024-09-22T01:38:35.357506+0000","last_peered":"2024-09-22T01:38:35.357506+0000","last_clean":"2024-09-22T01:38:35.357506+0000","last_became_active":"2024-09-22T01:38:18.549611+0000","last_became_peered":"2024-09-22T01:38:18.549611+0000","last_unstale":"2024-09-22T01:38:35.357506+0000","last_undegraded":"2024-09-22T01:38:35.357506+0000","last_fullsized":"2024-09-22T01:38:35.357506+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:23:17.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":555,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903846+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:38:34.903846+0000","last_peered":"2024-09-22T01:38:34.903846+0000","last_clean":"2024-09-22T01:38:34.903846+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:38:34.903846+0000","last_undegraded":"2024-09-22T01:38:34.903846+0000","last_fullsized":"2024-09-22T01:38:34.903846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"200'710","reported_seq":2755,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896397+0000","last_change":"2024-09-22T01:38:10.718846+0000","last_active":"2024-09-22T01:38:34.896397+0000","last_peered":"2024-09-22T01:38:34.896397+0000","last_clean":"2024-09-22T01:38:34.896397+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:38:34.896397+0000","last_undegraded":"2024-09-22T01:38:34.896397+0000","last_fullsized":"2024-09-22T01:38:34.896397+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:07.740863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019014889999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7238,"num_read_kb":52542,"num_write":881,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"200'459","reported_seq":6084,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.900835+0000","last_change":"2024-09-22T01:38:21.562582+0000","last_active":"2024-09-22T01:38:34.900835+0000","last_peered":"2024-09-22T01:38:34.900835+0000","last_clean":"2024-09-22T01:38:34.900835+0000","last_became_active":"2024-09-22T01:38:21.558253+0000","last_became_peered":"2024-09-22T01:38:21.558253+0000","last_unstale":"2024-09-22T01:38:34.900835+0000","last_undegraded":"2024-09-22T01:38:34.900835+0000","last_fullsized":"2024-09-22T01:38:34.900835+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:40.979341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001663412,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4390,"num_read_kb":53937,"num_write":461,"num_write_kb":17688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":594,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"200'635","reported_seq":14815,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083618+0000","last_change":"2024-09-22T01:38:10.724616+0000","last_active":"2024-09-22T01:38:35.083618+0000","last_peered":"2024-09-22T01:38:35.083618+0000","last_clean":"2024-09-22T01:38:35.083618+0000","last_became_active":"2024-09-22T01:37:53.540222+0000","last_became_peered":"2024-09-22T01:37:53.540222+0000","last_unstale":"2024-09-22T01:38:35.083618+0000","last_undegraded":"2024-09-22T01:38:35.083618+0000","last_fullsized":"2024-09-22T01:38:35.083618+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:37.067471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003616101,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":15637,"num_read_kb":20649,"num_write":595,"num_write_kb":18769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2278048,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"199'443","reported_seq":3508,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896518+0000","last_change":"2024-09-22T01:38:10.720117+0000","last_active":"2024-09-22T01:38:34.896518+0000","last_peered":"2024-09-22T01:38:34.896518+0000","last_clean":"2024-09-22T01:38:34.896518+0000","last_became_active":"2024-09-22T01:38:09.556931+0000","last_became_peered":"2024-09-22T01:38:09.556931+0000","last_unstale":"2024-09-22T01:38:34.896518+0000","last_undegraded":"2024-09-22T01:38:34.896518+0000","last_fullsized":"2024-09-22T01:38:34.896518+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:53.849962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027549219999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2831,"num_read_kb":14353,"num_write":499,"num_write_kb":9050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":11719816,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"199'567","reported_seq":6038,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357579+0000","last_change":"2024-09-22T01:38:10.718677+0000","last_active":"2024-09-22T01:38:35.357579+0000","last_peered":"2024-09-22T01:38:35.357579+0000","last_clean":"2024-09-22T01:38:35.357579+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:38:35.357579+0000","last_undegraded":"2024-09-22T01:38:35.357579+0000","last_fullsized":"2024-09-22T01:38:35.357579+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:11.101496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095552699999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6990,"num_read_kb":34807,"num_write":525,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"195'504","reported_seq":5025,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904493+0000","last_change":"2024-09-22T01:38:10.878997+0000","last_active":"2024-09-22T01:38:34.904493+0000","last_peered":"2024-09-22T01:38:34.904493+0000","last_clean":"2024-09-22T01:38:34.904493+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:38:34.904493+0000","last_undegraded":"2024-09-22T01:38:34.904493+0000","last_fullsized":"2024-09-22T01:38:34.904493+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:42.271093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043325960000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5598,"num_read_kb":19917,"num_write":545,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"199'719","reported_seq":4660,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904179+0000","last_change":"2024-09-22T01:38:10.878033+0000","last_active":"2024-09-22T01:38:34.904179+0000","last_peered":"2024-09-22T01:38:34.904179+0000","last_clean":"2024-09-22T01:38:34.904179+0000","last_became_active":"2024-09-22T01:37:52.551465+0000","last_became_peered":"2024-09-22T01:37:52.551465+0000","last_unstale":"2024-09-22T01:38:34.904179+0000","last_undegraded":"2024-09-22T01:38:34.904179+0000","last_fullsized":"2024-09-22T01:38:34.904179+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:44:14.540874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003391972,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4576,"num_read_kb":18630,"num_write":892,"num_write_kb":13182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"195'719","reported_seq":3678,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904380+0000","last_change":"2024-09-22T01:38:10.880113+0000","last_active":"2024-09-22T01:38:34.904380+0000","last_peered":"2024-09-22T01:38:34.904380+0000","last_clean":"2024-09-22T01:38:34.904380+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:38:34.904380+0000","last_undegraded":"2024-09-22T01:38:34.904380+0000","last_fullsized":"2024-09-22T01:38:34.904380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:08.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104090000000003,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5534,"num_read_kb":24700,"num_write":880,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"197'714","reported_seq":3404,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083601+0000","last_change":"2024-09-22T01:38:10.724283+0000","last_active":"2024-09-22T01:38:35.083601+0000","last_peered":"2024-09-22T01:38:35.083601+0000","last_clean":"2024-09-22T01:38:35.083601+0000","last_became_active":"2024-09-22T01:37:55.549740+0000","last_became_peered":"2024-09-22T01:37:55.549740+0000","last_unstale":"2024-09-22T01:38:35.083601+0000","last_undegraded":"2024-09-22T01:38:35.083601+0000","last_fullsized":"2024-09-22T01:38:35.083601+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:19.659250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034685710000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4516,"num_read_kb":14551,"num_write":804,"num_write_kb":16271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":7558660,"num_keys_recovered":94,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'391","reported_seq":5805,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.909473+0000","last_change":"2024-09-22T01:38:34.909473+0000","last_active":"2024-09-22T01:38:34.909473+0000","last_peered":"2024-09-22T01:38:34.909473+0000","last_clean":"2024-09-22T01:38:34.909473+0000","last_became_active":"2024-09-22T01:38:34.906641+0000","last_became_peered":"2024-09-22T01:38:34.906641+0000","last_unstale":"2024-09-22T01:38:34.909473+0000","last_undegraded":"2024-09-22T01:38:34.909473+0000","last_fullsized":"2024-09-22T01:38:34.909473+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:15.996636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081673900000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4801,"num_read_kb":46850,"num_write":333,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'488","reported_seq":5320,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347078+0000","last_change":"2024-09-22T01:38:10.730581+0000","last_active":"2024-09-22T01:38:35.347078+0000","last_peered":"2024-09-22T01:38:35.347078+0000","last_clean":"2024-09-22T01:38:35.347078+0000","last_became_active":"2024-09-22T01:37:54.552738+0000","last_became_peered":"2024-09-22T01:37:54.552738+0000","last_unstale":"2024-09-22T01:38:35.347078+0000","last_undegraded":"2024-09-22T01:38:35.347078+0000","last_fullsized":"2024-09-22T01:38:35.347078+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:47.324243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012133160000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5061,"num_read_kb":18985,"num_write":533,"num_write_kb":10276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":8748779,"num_keys_recovered":66,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"195'652","reported_seq":11544,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903908+0000","last_change":"2024-09-22T01:38:10.881356+0000","last_active":"2024-09-22T01:38:34.903908+0000","last_peered":"2024-09-22T01:38:34.903908+0000","last_clean":"2024-09-22T01:38:34.903908+0000","last_became_active":"2024-09-22T01:37:53.541188+0000","last_became_peered":"2024-09-22T01:37:53.541188+0000","last_unstale":"2024-09-22T01:38:34.903908+0000","last_undegraded":"2024-09-22T01:38:34.903908+0000","last_fullsized":"2024-09-22T01:38:34.903908+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:43.737368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064999480000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":12287,"num_read_kb":47236,"num_write":568,"num_write_kb":13755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":329,"num_bytes_recovered":11479448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":158,"num_read":199037,"num_read_kb":1036514,"num_write":21389,"num_write_kb":541533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7692,"num_bytes_recovered":422659173,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19088,"ondisk_log_size":19088,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64940,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306900,"statfs":{"total":96636764160,"available":96570265600,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74092,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297748,"statfs":{"total":96636764160,"available":96560893952,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47716,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324124,"statfs":{"total":96636764160,"available":96587902976,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37984,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333856,"statfs":{"total":96636764160,"available":96597868544,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2707456,"data_stored":1310735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52452,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319388,"statfs":{"total":96636764160,"available":96583053312,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:38:38.326 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:38:38.630 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:38:38.630 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:38:38.646 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-22T01:38:37.441845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":158,"num_read":199153,"num_read_kb":1036614,"num_write":21550,"num_write_kb":543951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7705,"num_bytes_recovered":423839947,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19208,"ondisk_log_size":19208,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431408,"kb_used_data":22264,"kb_used_omap":12,"kb_used_meta":408947,"kb_avail":754543312,"statfs":{"total":773094113280,"available":772652351488,"internally_reserved":0,"allocated":22798336,"data_stored":11666388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":418762288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.573122"},"pg_stats":[{"pgid":"3.1f","version":"200'725","reported_seq":6352,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347294+0000","last_change":"2024-09-22T01:38:10.733388+0000","last_active":"2024-09-22T01:38:35.347294+0000","last_peered":"2024-09-22T01:38:35.347294+0000","last_clean":"2024-09-22T01:38:35.347294+0000","last_became_active":"2024-09-22T01:37:55.543472+0000","last_became_peered":"2024-09-22T01:37:55.543472+0000","last_unstale":"2024-09-22T01:38:35.347294+0000","last_undegraded":"2024-09-22T01:38:35.347294+0000","last_fullsized":"2024-09-22T01:38:35.347294+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:55:58.422492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003797618,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6872,"num_read_kb":35444,"num_write":908,"num_write_kb":14992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":471,"num_bytes_recovered":26513955,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'595","reported_seq":4887,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896594+0000","last_change":"2024-09-22T01:38:10.718270+0000","last_active":"2024-09-22T01:38:34.896594+0000","last_peered":"2024-09-22T01:38:34.896594+0000","last_clean":"2024-09-22T01:38:34.896594+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:38:34.896594+0000","last_undegraded":"2024-09-22T01:38:34.896594+0000","last_fullsized":"2024-09-22T01:38:34.896594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:34:42.187105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013742629999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6272,"num_read_kb":47931,"num_write":611,"num_write_kb":23751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"192'1025","reported_seq":3549,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357872+0000","last_change":"2024-09-22T01:38:10.722087+0000","last_active":"2024-09-22T01:38:35.357872+0000","last_peered":"2024-09-22T01:38:35.357872+0000","last_clean":"2024-09-22T01:38:35.357872+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:38:35.357872+0000","last_undegraded":"2024-09-22T01:38:35.357872+0000","last_fullsized":"2024-09-22T01:38:35.357872+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1025,"log_dups_size":0,"ondisk_log_size":1025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:23:49.654245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040346269999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5544,"num_read_kb":33914,"num_write":1530,"num_write_kb":16573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"200'301","reported_seq":3044,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357569+0000","last_change":"2024-09-22T01:38:10.719510+0000","last_active":"2024-09-22T01:38:35.357569+0000","last_peered":"2024-09-22T01:38:35.357569+0000","last_clean":"2024-09-22T01:38:35.357569+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:38:35.357569+0000","last_undegraded":"2024-09-22T01:38:35.357569+0000","last_fullsized":"2024-09-22T01:38:35.357569+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:22.141096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001909486,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2195,"num_read_kb":35041,"num_write":325,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"199'1171","reported_seq":5657,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347210+0000","last_change":"2024-09-22T01:38:10.733439+0000","last_active":"2024-09-22T01:38:35.347210+0000","last_peered":"2024-09-22T01:38:35.347210+0000","last_clean":"2024-09-22T01:38:35.347210+0000","last_became_active":"2024-09-22T01:37:55.544664+0000","last_became_peered":"2024-09-22T01:37:55.544664+0000","last_unstale":"2024-09-22T01:38:35.347210+0000","last_undegraded":"2024-09-22T01:38:35.347210+0000","last_fullsized":"2024-09-22T01:38:35.347210+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:19:31.181548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037623719999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9924,"num_read_kb":24565,"num_write":1636,"num_write_kb":13745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":17295622,"num_keys_recovered":162,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'501","reported_seq":5494,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.901120+0000","last_change":"2024-09-22T01:38:10.728240+0000","last_active":"2024-09-22T01:38:34.901120+0000","last_peered":"2024-09-22T01:38:34.901120+0000","last_clean":"2024-09-22T01:38:34.901120+0000","last_became_active":"2024-09-22T01:37:52.551423+0000","last_became_peered":"2024-09-22T01:37:52.551423+0000","last_unstale":"2024-09-22T01:38:34.901120+0000","last_undegraded":"2024-09-22T01:38:34.901120+0000","last_fullsized":"2024-09-22T01:38:34.901120+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:27:12.516388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040494620000000002,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":4854,"num_read_kb":40179,"num_write":503,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'860","reported_seq":9670,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079513+0000","last_change":"2024-09-22T01:38:10.851316+0000","last_active":"2024-09-22T01:38:35.079513+0000","last_peered":"2024-09-22T01:38:35.079513+0000","last_clean":"2024-09-22T01:38:35.079513+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:38:35.079513+0000","last_undegraded":"2024-09-22T01:38:35.079513+0000","last_fullsized":"2024-09-22T01:38:35.079513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:03.606419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014346890000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10611,"num_read_kb":63679,"num_write":1135,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"189'946","reported_seq":3717,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896437+0000","last_change":"2024-09-22T01:38:10.719184+0000","last_active":"2024-09-22T01:38:34.896437+0000","last_peered":"2024-09-22T01:38:34.896437+0000","last_clean":"2024-09-22T01:38:34.896437+0000","last_became_active":"2024-09-22T01:37:55.541794+0000","last_became_peered":"2024-09-22T01:37:55.541794+0000","last_unstale":"2024-09-22T01:38:34.896437+0000","last_undegraded":"2024-09-22T01:38:34.896437+0000","last_fullsized":"2024-09-22T01:38:34.896437+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:13.936798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020228920000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1485,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":2375363,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"197'537","reported_seq":6376,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347339+0000","last_change":"2024-09-22T01:38:10.732478+0000","last_active":"2024-09-22T01:38:35.347339+0000","last_peered":"2024-09-22T01:38:35.347339+0000","last_clean":"2024-09-22T01:38:35.347339+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:38:35.347339+0000","last_undegraded":"2024-09-22T01:38:35.347339+0000","last_fullsized":"2024-09-22T01:38:35.347339+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:05:12.010523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028964960000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6199,"num_read_kb":32488,"num_write":514,"num_write_kb":34060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"194'705","reported_seq":14973,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357742+0000","last_change":"2024-09-22T01:38:10.719590+0000","last_active":"2024-09-22T01:38:35.357742+0000","last_peered":"2024-09-22T01:38:35.357742+0000","last_clean":"2024-09-22T01:38:35.357742+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:38:35.357742+0000","last_undegraded":"2024-09-22T01:38:35.357742+0000","last_fullsized":"2024-09-22T01:38:35.357742+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:31:21.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018802389999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":14794,"num_read_kb":34409,"num_write":702,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"194'298","reported_seq":5181,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904227+0000","last_change":"2024-09-22T01:38:10.876772+0000","last_active":"2024-09-22T01:38:34.904227+0000","last_peered":"2024-09-22T01:38:34.904227+0000","last_clean":"2024-09-22T01:38:34.904227+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:38:34.904227+0000","last_undegraded":"2024-09-22T01:38:34.904227+0000","last_fullsized":"2024-09-22T01:38:34.904227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:21:02.333056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002237429,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4129,"num_read_kb":34295,"num_write":247,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"198'437","reported_seq":6700,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.901138+0000","last_change":"2024-09-22T01:38:10.726480+0000","last_active":"2024-09-22T01:38:34.901138+0000","last_peered":"2024-09-22T01:38:34.901138+0000","last_clean":"2024-09-22T01:38:34.901138+0000","last_became_active":"2024-09-22T01:37:52.550304+0000","last_became_peered":"2024-09-22T01:37:52.550304+0000","last_unstale":"2024-09-22T01:38:34.901138+0000","last_undegraded":"2024-09-22T01:38:34.901138+0000","last_fullsized":"2024-09-22T01:38:34.901138+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:09:12.974811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029114100000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6427,"num_read_kb":54267,"num_write":376,"num_write_kb":20603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":443,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083680+0000","last_change":"2024-09-22T01:37:51.552938+0000","last_active":"2024-09-22T01:38:35.083680+0000","last_peered":"2024-09-22T01:38:35.083680+0000","last_clean":"2024-09-22T01:38:35.083680+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:38:35.083680+0000","last_undegraded":"2024-09-22T01:38:35.083680+0000","last_fullsized":"2024-09-22T01:38:35.083680+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:20.798595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"200'512","reported_seq":6232,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347244+0000","last_change":"2024-09-22T01:38:10.732138+0000","last_active":"2024-09-22T01:38:35.347244+0000","last_peered":"2024-09-22T01:38:35.347244+0000","last_clean":"2024-09-22T01:38:35.347244+0000","last_became_active":"2024-09-22T01:37:55.544363+0000","last_became_peered":"2024-09-22T01:37:55.544363+0000","last_unstale":"2024-09-22T01:38:35.347244+0000","last_undegraded":"2024-09-22T01:38:35.347244+0000","last_fullsized":"2024-09-22T01:38:35.347244+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:30:41.669758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028137370000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5201,"num_read_kb":38761,"num_write":409,"num_write_kb":38186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":46874722,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":424,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079990+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:38:35.079990+0000","last_peered":"2024-09-22T01:38:35.079990+0000","last_clean":"2024-09-22T01:38:35.079990+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:38:35.079990+0000","last_undegraded":"2024-09-22T01:38:35.079990+0000","last_fullsized":"2024-09-22T01:38:35.079990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"199'371","reported_seq":3618,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896657+0000","last_change":"2024-09-22T01:38:10.720206+0000","last_active":"2024-09-22T01:38:34.896657+0000","last_peered":"2024-09-22T01:38:34.896657+0000","last_clean":"2024-09-22T01:38:34.896657+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:38:34.896657+0000","last_undegraded":"2024-09-22T01:38:34.896657+0000","last_fullsized":"2024-09-22T01:38:34.896657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:48:59.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026027870000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":3471,"num_read_kb":20726,"num_write":356,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":312,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904225+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:38:34.904225+0000","last_peered":"2024-09-22T01:38:34.904225+0000","last_clean":"2024-09-22T01:38:34.904225+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:38:34.904225+0000","last_undegraded":"2024-09-22T01:38:34.904225+0000","last_fullsized":"2024-09-22T01:38:34.904225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"200'620","reported_seq":4737,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079641+0000","last_change":"2024-09-22T01:38:22.557835+0000","last_active":"2024-09-22T01:38:35.079641+0000","last_peered":"2024-09-22T01:38:35.079641+0000","last_clean":"2024-09-22T01:38:35.079641+0000","last_became_active":"2024-09-22T01:38:22.556550+0000","last_became_peered":"2024-09-22T01:38:22.556550+0000","last_unstale":"2024-09-22T01:38:35.079641+0000","last_undegraded":"2024-09-22T01:38:35.079641+0000","last_fullsized":"2024-09-22T01:38:35.079641+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:37.414319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014576910000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5589,"num_read_kb":37802,"num_write":624,"num_write_kb":11232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079797+0000","last_change":"2024-09-22T01:38:22.618094+0000","last_active":"2024-09-22T01:38:35.079797+0000","last_peered":"2024-09-22T01:38:35.079797+0000","last_clean":"2024-09-22T01:38:35.079797+0000","last_became_active":"2024-09-22T01:38:22.617578+0000","last_became_peered":"2024-09-22T01:38:22.617578+0000","last_unstale":"2024-09-22T01:38:35.079797+0000","last_undegraded":"2024-09-22T01:38:35.079797+0000","last_fullsized":"2024-09-22T01:38:35.079797+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:28.231940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'514","reported_seq":8221,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357890+0000","last_change":"2024-09-22T01:38:10.721771+0000","last_active":"2024-09-22T01:38:35.357890+0000","last_peered":"2024-09-22T01:38:35.357890+0000","last_clean":"2024-09-22T01:38:35.357890+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:38:35.357890+0000","last_undegraded":"2024-09-22T01:38:35.357890+0000","last_fullsized":"2024-09-22T01:38:35.357890+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:29:02.007042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036439129999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":8480,"num_read_kb":54220,"num_write":523,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"200'431","reported_seq":1824,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.084232+0000","last_change":"2024-09-22T01:38:10.723787+0000","last_active":"2024-09-22T01:38:35.084232+0000","last_peered":"2024-09-22T01:38:35.084232+0000","last_clean":"2024-09-22T01:38:35.084232+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:38:35.084232+0000","last_undegraded":"2024-09-22T01:38:35.084232+0000","last_fullsized":"2024-09-22T01:38:35.084232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:11.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002825424,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":1512,"num_read_kb":6460,"num_write":402,"num_write_kb":3582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":172,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357532+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:38:35.357532+0000","last_peered":"2024-09-22T01:38:35.357532+0000","last_clean":"2024-09-22T01:38:35.357532+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:38:35.357532+0000","last_undegraded":"2024-09-22T01:38:35.357532+0000","last_fullsized":"2024-09-22T01:38:35.357532+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"198'518","reported_seq":4480,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079647+0000","last_change":"2024-09-22T01:38:21.559272+0000","last_active":"2024-09-22T01:38:35.079647+0000","last_peered":"2024-09-22T01:38:35.079647+0000","last_clean":"2024-09-22T01:38:35.079647+0000","last_became_active":"2024-09-22T01:38:21.557572+0000","last_became_peered":"2024-09-22T01:38:21.557572+0000","last_unstale":"2024-09-22T01:38:35.079647+0000","last_undegraded":"2024-09-22T01:38:35.079647+0000","last_fullsized":"2024-09-22T01:38:35.079647+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:14:50.230801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001437699,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4350,"num_read_kb":14870,"num_write":524,"num_write_kb":23558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.902327+0000","last_change":"2024-09-22T01:38:18.600969+0000","last_active":"2024-09-22T01:38:34.902327+0000","last_peered":"2024-09-22T01:38:34.902327+0000","last_clean":"2024-09-22T01:38:34.902327+0000","last_became_active":"2024-09-22T01:38:18.600600+0000","last_became_peered":"2024-09-22T01:38:18.600600+0000","last_unstale":"2024-09-22T01:38:34.902327+0000","last_undegraded":"2024-09-22T01:38:34.902327+0000","last_fullsized":"2024-09-22T01:38:34.902327+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:59:40.488792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"199'558","reported_seq":5303,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347072+0000","last_change":"2024-09-22T01:38:10.731424+0000","last_active":"2024-09-22T01:38:35.347072+0000","last_peered":"2024-09-22T01:38:35.347072+0000","last_clean":"2024-09-22T01:38:35.347072+0000","last_became_active":"2024-09-22T01:37:53.571926+0000","last_became_peered":"2024-09-22T01:37:53.571926+0000","last_unstale":"2024-09-22T01:38:35.347072+0000","last_undegraded":"2024-09-22T01:38:35.347072+0000","last_fullsized":"2024-09-22T01:38:35.347072+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:31:16.964826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002041817,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":5042,"num_read_kb":25966,"num_write":576,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903756+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:38:34.903756+0000","last_peered":"2024-09-22T01:38:34.903756+0000","last_clean":"2024-09-22T01:38:34.903756+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:38:34.903756+0000","last_undegraded":"2024-09-22T01:38:34.903756+0000","last_fullsized":"2024-09-22T01:38:34.903756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"199'462","reported_seq":2785,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896568+0000","last_change":"2024-09-22T01:38:10.718052+0000","last_active":"2024-09-22T01:38:34.896568+0000","last_peered":"2024-09-22T01:38:34.896568+0000","last_clean":"2024-09-22T01:38:34.896568+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:38:34.896568+0000","last_undegraded":"2024-09-22T01:38:34.896568+0000","last_fullsized":"2024-09-22T01:38:34.896568+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:08.277366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011708179999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2672,"num_read_kb":16190,"num_write":487,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":190,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357506+0000","last_change":"2024-09-22T01:38:18.559667+0000","last_active":"2024-09-22T01:38:35.357506+0000","last_peered":"2024-09-22T01:38:35.357506+0000","last_clean":"2024-09-22T01:38:35.357506+0000","last_became_active":"2024-09-22T01:38:18.549611+0000","last_became_peered":"2024-09-22T01:38:18.549611+0000","last_unstale":"2024-09-22T01:38:35.357506+0000","last_undegraded":"2024-09-22T01:38:35.357506+0000","last_fullsized":"2024-09-22T01:38:35.357506+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:23:17.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":555,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903846+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:38:34.903846+0000","last_peered":"2024-09-22T01:38:34.903846+0000","last_clean":"2024-09-22T01:38:34.903846+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:38:34.903846+0000","last_undegraded":"2024-09-22T01:38:34.903846+0000","last_fullsized":"2024-09-22T01:38:34.903846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"200'710","reported_seq":2755,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896397+0000","last_change":"2024-09-22T01:38:10.718846+0000","last_active":"2024-09-22T01:38:34.896397+0000","last_peered":"2024-09-22T01:38:34.896397+0000","last_clean":"2024-09-22T01:38:34.896397+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:38:34.896397+0000","last_undegraded":"2024-09-22T01:38:34.896397+0000","last_fullsized":"2024-09-22T01:38:34.896397+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:07.740863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019014889999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7238,"num_read_kb":52542,"num_write":881,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"200'459","reported_seq":6084,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.900835+0000","last_change":"2024-09-22T01:38:21.562582+0000","last_active":"2024-09-22T01:38:34.900835+0000","last_peered":"2024-09-22T01:38:34.900835+0000","last_clean":"2024-09-22T01:38:34.900835+0000","last_became_active":"2024-09-22T01:38:21.558253+0000","last_became_peered":"2024-09-22T01:38:21.558253+0000","last_unstale":"2024-09-22T01:38:34.900835+0000","last_undegraded":"2024-09-22T01:38:34.900835+0000","last_fullsized":"2024-09-22T01:38:34.900835+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:40.979341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001663412,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4390,"num_read_kb":53937,"num_write":461,"num_write_kb":17688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":594,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"200'635","reported_seq":14815,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083618+0000","last_change":"2024-09-22T01:38:10.724616+0000","last_active":"2024-09-22T01:38:35.083618+0000","last_peered":"2024-09-22T01:38:35.083618+0000","last_clean":"2024-09-22T01:38:35.083618+0000","last_became_active":"2024-09-22T01:37:53.540222+0000","last_became_peered":"2024-09-22T01:37:53.540222+0000","last_unstale":"2024-09-22T01:38:35.083618+0000","last_undegraded":"2024-09-22T01:38:35.083618+0000","last_fullsized":"2024-09-22T01:38:35.083618+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:37.067471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003616101,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":15637,"num_read_kb":20649,"num_write":595,"num_write_kb":18769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2278048,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"199'443","reported_seq":3508,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896518+0000","last_change":"2024-09-22T01:38:10.720117+0000","last_active":"2024-09-22T01:38:34.896518+0000","last_peered":"2024-09-22T01:38:34.896518+0000","last_clean":"2024-09-22T01:38:34.896518+0000","last_became_active":"2024-09-22T01:38:09.556931+0000","last_became_peered":"2024-09-22T01:38:09.556931+0000","last_unstale":"2024-09-22T01:38:34.896518+0000","last_undegraded":"2024-09-22T01:38:34.896518+0000","last_fullsized":"2024-09-22T01:38:34.896518+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:53.849962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027549219999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2831,"num_read_kb":14353,"num_write":499,"num_write_kb":9050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":11719816,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"199'567","reported_seq":6038,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357579+0000","last_change":"2024-09-22T01:38:10.718677+0000","last_active":"2024-09-22T01:38:35.357579+0000","last_peered":"2024-09-22T01:38:35.357579+0000","last_clean":"2024-09-22T01:38:35.357579+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:38:35.357579+0000","last_undegraded":"2024-09-22T01:38:35.357579+0000","last_fullsized":"2024-09-22T01:38:35.357579+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:11.101496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095552699999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6990,"num_read_kb":34807,"num_write":525,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"195'504","reported_seq":5025,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904493+0000","last_change":"2024-09-22T01:38:10.878997+0000","last_active":"2024-09-22T01:38:34.904493+0000","last_peered":"2024-09-22T01:38:34.904493+0000","last_clean":"2024-09-22T01:38:34.904493+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:38:34.904493+0000","last_undegraded":"2024-09-22T01:38:34.904493+0000","last_fullsized":"2024-09-22T01:38:34.904493+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:42.271093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043325960000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5598,"num_read_kb":19917,"num_write":545,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"199'719","reported_seq":4660,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904179+0000","last_change":"2024-09-22T01:38:10.878033+0000","last_active":"2024-09-22T01:38:34.904179+0000","last_peered":"2024-09-22T01:38:34.904179+0000","last_clean":"2024-09-22T01:38:34.904179+0000","last_became_active":"2024-09-22T01:37:52.551465+0000","last_became_peered":"2024-09-22T01:37:52.551465+0000","last_unstale":"2024-09-22T01:38:34.904179+0000","last_undegraded":"2024-09-22T01:38:34.904179+0000","last_fullsized":"2024-09-22T01:38:34.904179+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:44:14.540874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003391972,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4576,"num_read_kb":18630,"num_write":892,"num_write_kb":13182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"195'719","reported_seq":3678,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904380+0000","last_change":"2024-09-22T01:38:10.880113+0000","last_active":"2024-09-22T01:38:34.904380+0000","last_peered":"2024-09-22T01:38:34.904380+0000","last_clean":"2024-09-22T01:38:34.904380+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:38:34.904380+0000","last_undegraded":"2024-09-22T01:38:34.904380+0000","last_fullsized":"2024-09-22T01:38:34.904380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:08.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104090000000003,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5534,"num_read_kb":24700,"num_write":880,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"197'714","reported_seq":3404,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083601+0000","last_change":"2024-09-22T01:38:10.724283+0000","last_active":"2024-09-22T01:38:35.083601+0000","last_peered":"2024-09-22T01:38:35.083601+0000","last_clean":"2024-09-22T01:38:35.083601+0000","last_became_active":"2024-09-22T01:37:55.549740+0000","last_became_peered":"2024-09-22T01:37:55.549740+0000","last_unstale":"2024-09-22T01:38:35.083601+0000","last_undegraded":"2024-09-22T01:38:35.083601+0000","last_fullsized":"2024-09-22T01:38:35.083601+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:19.659250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034685710000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4516,"num_read_kb":14551,"num_write":804,"num_write_kb":16271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":7558660,"num_keys_recovered":94,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'391","reported_seq":5805,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.909473+0000","last_change":"2024-09-22T01:38:34.909473+0000","last_active":"2024-09-22T01:38:34.909473+0000","last_peered":"2024-09-22T01:38:34.909473+0000","last_clean":"2024-09-22T01:38:34.909473+0000","last_became_active":"2024-09-22T01:38:34.906641+0000","last_became_peered":"2024-09-22T01:38:34.906641+0000","last_unstale":"2024-09-22T01:38:34.909473+0000","last_undegraded":"2024-09-22T01:38:34.909473+0000","last_fullsized":"2024-09-22T01:38:34.909473+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:15.996636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081673900000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4801,"num_read_kb":46850,"num_write":333,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'488","reported_seq":5320,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347078+0000","last_change":"2024-09-22T01:38:10.730581+0000","last_active":"2024-09-22T01:38:35.347078+0000","last_peered":"2024-09-22T01:38:35.347078+0000","last_clean":"2024-09-22T01:38:35.347078+0000","last_became_active":"2024-09-22T01:37:54.552738+0000","last_became_peered":"2024-09-22T01:37:54.552738+0000","last_unstale":"2024-09-22T01:38:35.347078+0000","last_undegraded":"2024-09-22T01:38:35.347078+0000","last_fullsized":"2024-09-22T01:38:35.347078+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:47.324243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012133160000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5061,"num_read_kb":18985,"num_write":533,"num_write_kb":10276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":8748779,"num_keys_recovered":66,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"195'652","reported_seq":11544,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903908+0000","last_change":"2024-09-22T01:38:10.881356+0000","last_active":"2024-09-22T01:38:34.903908+0000","last_peered":"2024-09-22T01:38:34.903908+0000","last_clean":"2024-09-22T01:38:34.903908+0000","last_became_active":"2024-09-22T01:37:53.541188+0000","last_became_peered":"2024-09-22T01:37:53.541188+0000","last_unstale":"2024-09-22T01:38:34.903908+0000","last_undegraded":"2024-09-22T01:38:34.903908+0000","last_fullsized":"2024-09-22T01:38:34.903908+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:43.737368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064999480000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":12287,"num_read_kb":47236,"num_write":568,"num_write_kb":13755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":329,"num_bytes_recovered":11479448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":158,"num_read":199037,"num_read_kb":1036514,"num_write":21389,"num_write_kb":541533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7692,"num_bytes_recovered":422659173,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19088,"ondisk_log_size":19088,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64940,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306900,"statfs":{"total":96636764160,"available":96570265600,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74092,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297748,"statfs":{"total":96636764160,"available":96560893952,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47716,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324124,"statfs":{"total":96636764160,"available":96587902976,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37984,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333856,"statfs":{"total":96636764160,"available":96597868544,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2707456,"data_stored":1310735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52452,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319388,"statfs":{"total":96636764160,"available":96583053312,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:38:38.648 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T01:38:38.648 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:38:38.953 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:38:38.953 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:38:38.970 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-22T01:38:37.441845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":158,"num_read":199153,"num_read_kb":1036614,"num_write":21550,"num_write_kb":543951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7705,"num_bytes_recovered":423839947,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19208,"ondisk_log_size":19208,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431408,"kb_used_data":22264,"kb_used_omap":12,"kb_used_meta":408947,"kb_avail":754543312,"statfs":{"total":773094113280,"available":772652351488,"internally_reserved":0,"allocated":22798336,"data_stored":11666388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":418762288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.573122"},"pg_stats":[{"pgid":"3.1f","version":"200'725","reported_seq":6352,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347294+0000","last_change":"2024-09-22T01:38:10.733388+0000","last_active":"2024-09-22T01:38:35.347294+0000","last_peered":"2024-09-22T01:38:35.347294+0000","last_clean":"2024-09-22T01:38:35.347294+0000","last_became_active":"2024-09-22T01:37:55.543472+0000","last_became_peered":"2024-09-22T01:37:55.543472+0000","last_unstale":"2024-09-22T01:38:35.347294+0000","last_undegraded":"2024-09-22T01:38:35.347294+0000","last_fullsized":"2024-09-22T01:38:35.347294+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:55:58.422492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003797618,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6872,"num_read_kb":35444,"num_write":908,"num_write_kb":14992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":471,"num_bytes_recovered":26513955,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'595","reported_seq":4887,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896594+0000","last_change":"2024-09-22T01:38:10.718270+0000","last_active":"2024-09-22T01:38:34.896594+0000","last_peered":"2024-09-22T01:38:34.896594+0000","last_clean":"2024-09-22T01:38:34.896594+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:38:34.896594+0000","last_undegraded":"2024-09-22T01:38:34.896594+0000","last_fullsized":"2024-09-22T01:38:34.896594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:34:42.187105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013742629999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6272,"num_read_kb":47931,"num_write":611,"num_write_kb":23751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"192'1025","reported_seq":3549,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357872+0000","last_change":"2024-09-22T01:38:10.722087+0000","last_active":"2024-09-22T01:38:35.357872+0000","last_peered":"2024-09-22T01:38:35.357872+0000","last_clean":"2024-09-22T01:38:35.357872+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:38:35.357872+0000","last_undegraded":"2024-09-22T01:38:35.357872+0000","last_fullsized":"2024-09-22T01:38:35.357872+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1025,"log_dups_size":0,"ondisk_log_size":1025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:23:49.654245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040346269999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5544,"num_read_kb":33914,"num_write":1530,"num_write_kb":16573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"200'301","reported_seq":3044,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357569+0000","last_change":"2024-09-22T01:38:10.719510+0000","last_active":"2024-09-22T01:38:35.357569+0000","last_peered":"2024-09-22T01:38:35.357569+0000","last_clean":"2024-09-22T01:38:35.357569+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:38:35.357569+0000","last_undegraded":"2024-09-22T01:38:35.357569+0000","last_fullsized":"2024-09-22T01:38:35.357569+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:22.141096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001909486,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2195,"num_read_kb":35041,"num_write":325,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"199'1171","reported_seq":5657,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347210+0000","last_change":"2024-09-22T01:38:10.733439+0000","last_active":"2024-09-22T01:38:35.347210+0000","last_peered":"2024-09-22T01:38:35.347210+0000","last_clean":"2024-09-22T01:38:35.347210+0000","last_became_active":"2024-09-22T01:37:55.544664+0000","last_became_peered":"2024-09-22T01:37:55.544664+0000","last_unstale":"2024-09-22T01:38:35.347210+0000","last_undegraded":"2024-09-22T01:38:35.347210+0000","last_fullsized":"2024-09-22T01:38:35.347210+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:19:31.181548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037623719999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9924,"num_read_kb":24565,"num_write":1636,"num_write_kb":13745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":17295622,"num_keys_recovered":162,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'501","reported_seq":5494,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.901120+0000","last_change":"2024-09-22T01:38:10.728240+0000","last_active":"2024-09-22T01:38:34.901120+0000","last_peered":"2024-09-22T01:38:34.901120+0000","last_clean":"2024-09-22T01:38:34.901120+0000","last_became_active":"2024-09-22T01:37:52.551423+0000","last_became_peered":"2024-09-22T01:37:52.551423+0000","last_unstale":"2024-09-22T01:38:34.901120+0000","last_undegraded":"2024-09-22T01:38:34.901120+0000","last_fullsized":"2024-09-22T01:38:34.901120+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:27:12.516388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040494620000000002,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":4854,"num_read_kb":40179,"num_write":503,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'860","reported_seq":9670,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079513+0000","last_change":"2024-09-22T01:38:10.851316+0000","last_active":"2024-09-22T01:38:35.079513+0000","last_peered":"2024-09-22T01:38:35.079513+0000","last_clean":"2024-09-22T01:38:35.079513+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:38:35.079513+0000","last_undegraded":"2024-09-22T01:38:35.079513+0000","last_fullsized":"2024-09-22T01:38:35.079513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:03:03.606419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014346890000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10611,"num_read_kb":63679,"num_write":1135,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"189'946","reported_seq":3717,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896437+0000","last_change":"2024-09-22T01:38:10.719184+0000","last_active":"2024-09-22T01:38:34.896437+0000","last_peered":"2024-09-22T01:38:34.896437+0000","last_clean":"2024-09-22T01:38:34.896437+0000","last_became_active":"2024-09-22T01:37:55.541794+0000","last_became_peered":"2024-09-22T01:37:55.541794+0000","last_unstale":"2024-09-22T01:38:34.896437+0000","last_undegraded":"2024-09-22T01:38:34.896437+0000","last_fullsized":"2024-09-22T01:38:34.896437+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:13.936798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020228920000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1485,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":2375363,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"197'537","reported_seq":6376,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347339+0000","last_change":"2024-09-22T01:38:10.732478+0000","last_active":"2024-09-22T01:38:35.347339+0000","last_peered":"2024-09-22T01:38:35.347339+0000","last_clean":"2024-09-22T01:38:35.347339+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:38:35.347339+0000","last_undegraded":"2024-09-22T01:38:35.347339+0000","last_fullsized":"2024-09-22T01:38:35.347339+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:05:12.010523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028964960000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6199,"num_read_kb":32488,"num_write":514,"num_write_kb":34060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"194'705","reported_seq":14973,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357742+0000","last_change":"2024-09-22T01:38:10.719590+0000","last_active":"2024-09-22T01:38:35.357742+0000","last_peered":"2024-09-22T01:38:35.357742+0000","last_clean":"2024-09-22T01:38:35.357742+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:38:35.357742+0000","last_undegraded":"2024-09-22T01:38:35.357742+0000","last_fullsized":"2024-09-22T01:38:35.357742+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:31:21.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018802389999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":14794,"num_read_kb":34409,"num_write":702,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"194'298","reported_seq":5181,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904227+0000","last_change":"2024-09-22T01:38:10.876772+0000","last_active":"2024-09-22T01:38:34.904227+0000","last_peered":"2024-09-22T01:38:34.904227+0000","last_clean":"2024-09-22T01:38:34.904227+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:38:34.904227+0000","last_undegraded":"2024-09-22T01:38:34.904227+0000","last_fullsized":"2024-09-22T01:38:34.904227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:21:02.333056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002237429,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4129,"num_read_kb":34295,"num_write":247,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"198'437","reported_seq":6700,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.901138+0000","last_change":"2024-09-22T01:38:10.726480+0000","last_active":"2024-09-22T01:38:34.901138+0000","last_peered":"2024-09-22T01:38:34.901138+0000","last_clean":"2024-09-22T01:38:34.901138+0000","last_became_active":"2024-09-22T01:37:52.550304+0000","last_became_peered":"2024-09-22T01:37:52.550304+0000","last_unstale":"2024-09-22T01:38:34.901138+0000","last_undegraded":"2024-09-22T01:38:34.901138+0000","last_fullsized":"2024-09-22T01:38:34.901138+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:09:12.974811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029114100000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6427,"num_read_kb":54267,"num_write":376,"num_write_kb":20603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":443,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083680+0000","last_change":"2024-09-22T01:37:51.552938+0000","last_active":"2024-09-22T01:38:35.083680+0000","last_peered":"2024-09-22T01:38:35.083680+0000","last_clean":"2024-09-22T01:38:35.083680+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:38:35.083680+0000","last_undegraded":"2024-09-22T01:38:35.083680+0000","last_fullsized":"2024-09-22T01:38:35.083680+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:20.798595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"200'512","reported_seq":6232,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347244+0000","last_change":"2024-09-22T01:38:10.732138+0000","last_active":"2024-09-22T01:38:35.347244+0000","last_peered":"2024-09-22T01:38:35.347244+0000","last_clean":"2024-09-22T01:38:35.347244+0000","last_became_active":"2024-09-22T01:37:55.544363+0000","last_became_peered":"2024-09-22T01:37:55.544363+0000","last_unstale":"2024-09-22T01:38:35.347244+0000","last_undegraded":"2024-09-22T01:38:35.347244+0000","last_fullsized":"2024-09-22T01:38:35.347244+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:30:41.669758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028137370000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5201,"num_read_kb":38761,"num_write":409,"num_write_kb":38186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":46874722,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":424,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079990+0000","last_change":"2024-09-22T01:34:40.368618+0000","last_active":"2024-09-22T01:38:35.079990+0000","last_peered":"2024-09-22T01:38:35.079990+0000","last_clean":"2024-09-22T01:38:35.079990+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:38:35.079990+0000","last_undegraded":"2024-09-22T01:38:35.079990+0000","last_fullsized":"2024-09-22T01:38:35.079990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:38:40.779969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"199'371","reported_seq":3618,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896657+0000","last_change":"2024-09-22T01:38:10.720206+0000","last_active":"2024-09-22T01:38:34.896657+0000","last_peered":"2024-09-22T01:38:34.896657+0000","last_clean":"2024-09-22T01:38:34.896657+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:38:34.896657+0000","last_undegraded":"2024-09-22T01:38:34.896657+0000","last_fullsized":"2024-09-22T01:38:34.896657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:48:59.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026027870000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":3471,"num_read_kb":20726,"num_write":356,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":312,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904225+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:38:34.904225+0000","last_peered":"2024-09-22T01:38:34.904225+0000","last_clean":"2024-09-22T01:38:34.904225+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:38:34.904225+0000","last_undegraded":"2024-09-22T01:38:34.904225+0000","last_fullsized":"2024-09-22T01:38:34.904225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"200'620","reported_seq":4737,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079641+0000","last_change":"2024-09-22T01:38:22.557835+0000","last_active":"2024-09-22T01:38:35.079641+0000","last_peered":"2024-09-22T01:38:35.079641+0000","last_clean":"2024-09-22T01:38:35.079641+0000","last_became_active":"2024-09-22T01:38:22.556550+0000","last_became_peered":"2024-09-22T01:38:22.556550+0000","last_unstale":"2024-09-22T01:38:35.079641+0000","last_undegraded":"2024-09-22T01:38:35.079641+0000","last_fullsized":"2024-09-22T01:38:35.079641+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:37.414319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014576910000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5589,"num_read_kb":37802,"num_write":624,"num_write_kb":11232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079797+0000","last_change":"2024-09-22T01:38:22.618094+0000","last_active":"2024-09-22T01:38:35.079797+0000","last_peered":"2024-09-22T01:38:35.079797+0000","last_clean":"2024-09-22T01:38:35.079797+0000","last_became_active":"2024-09-22T01:38:22.617578+0000","last_became_peered":"2024-09-22T01:38:22.617578+0000","last_unstale":"2024-09-22T01:38:35.079797+0000","last_undegraded":"2024-09-22T01:38:35.079797+0000","last_fullsized":"2024-09-22T01:38:35.079797+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:28.231940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'514","reported_seq":8221,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357890+0000","last_change":"2024-09-22T01:38:10.721771+0000","last_active":"2024-09-22T01:38:35.357890+0000","last_peered":"2024-09-22T01:38:35.357890+0000","last_clean":"2024-09-22T01:38:35.357890+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:38:35.357890+0000","last_undegraded":"2024-09-22T01:38:35.357890+0000","last_fullsized":"2024-09-22T01:38:35.357890+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:29:02.007042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036439129999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":8480,"num_read_kb":54220,"num_write":523,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"200'431","reported_seq":1824,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.084232+0000","last_change":"2024-09-22T01:38:10.723787+0000","last_active":"2024-09-22T01:38:35.084232+0000","last_peered":"2024-09-22T01:38:35.084232+0000","last_clean":"2024-09-22T01:38:35.084232+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:38:35.084232+0000","last_undegraded":"2024-09-22T01:38:35.084232+0000","last_fullsized":"2024-09-22T01:38:35.084232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:11.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002825424,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":1512,"num_read_kb":6460,"num_write":402,"num_write_kb":3582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":172,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357532+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:38:35.357532+0000","last_peered":"2024-09-22T01:38:35.357532+0000","last_clean":"2024-09-22T01:38:35.357532+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:38:35.357532+0000","last_undegraded":"2024-09-22T01:38:35.357532+0000","last_fullsized":"2024-09-22T01:38:35.357532+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"198'518","reported_seq":4480,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079647+0000","last_change":"2024-09-22T01:38:21.559272+0000","last_active":"2024-09-22T01:38:35.079647+0000","last_peered":"2024-09-22T01:38:35.079647+0000","last_clean":"2024-09-22T01:38:35.079647+0000","last_became_active":"2024-09-22T01:38:21.557572+0000","last_became_peered":"2024-09-22T01:38:21.557572+0000","last_unstale":"2024-09-22T01:38:35.079647+0000","last_undegraded":"2024-09-22T01:38:35.079647+0000","last_fullsized":"2024-09-22T01:38:35.079647+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:14:50.230801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001437699,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4350,"num_read_kb":14870,"num_write":524,"num_write_kb":23558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.902327+0000","last_change":"2024-09-22T01:38:18.600969+0000","last_active":"2024-09-22T01:38:34.902327+0000","last_peered":"2024-09-22T01:38:34.902327+0000","last_clean":"2024-09-22T01:38:34.902327+0000","last_became_active":"2024-09-22T01:38:18.600600+0000","last_became_peered":"2024-09-22T01:38:18.600600+0000","last_unstale":"2024-09-22T01:38:34.902327+0000","last_undegraded":"2024-09-22T01:38:34.902327+0000","last_fullsized":"2024-09-22T01:38:34.902327+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:59:40.488792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"199'558","reported_seq":5303,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347072+0000","last_change":"2024-09-22T01:38:10.731424+0000","last_active":"2024-09-22T01:38:35.347072+0000","last_peered":"2024-09-22T01:38:35.347072+0000","last_clean":"2024-09-22T01:38:35.347072+0000","last_became_active":"2024-09-22T01:37:53.571926+0000","last_became_peered":"2024-09-22T01:37:53.571926+0000","last_unstale":"2024-09-22T01:38:35.347072+0000","last_undegraded":"2024-09-22T01:38:35.347072+0000","last_fullsized":"2024-09-22T01:38:35.347072+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:31:16.964826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002041817,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":5042,"num_read_kb":25966,"num_write":576,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903756+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:38:34.903756+0000","last_peered":"2024-09-22T01:38:34.903756+0000","last_clean":"2024-09-22T01:38:34.903756+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:38:34.903756+0000","last_undegraded":"2024-09-22T01:38:34.903756+0000","last_fullsized":"2024-09-22T01:38:34.903756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"199'462","reported_seq":2785,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896568+0000","last_change":"2024-09-22T01:38:10.718052+0000","last_active":"2024-09-22T01:38:34.896568+0000","last_peered":"2024-09-22T01:38:34.896568+0000","last_clean":"2024-09-22T01:38:34.896568+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:38:34.896568+0000","last_undegraded":"2024-09-22T01:38:34.896568+0000","last_fullsized":"2024-09-22T01:38:34.896568+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:08.277366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011708179999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2672,"num_read_kb":16190,"num_write":487,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":190,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357506+0000","last_change":"2024-09-22T01:38:18.559667+0000","last_active":"2024-09-22T01:38:35.357506+0000","last_peered":"2024-09-22T01:38:35.357506+0000","last_clean":"2024-09-22T01:38:35.357506+0000","last_became_active":"2024-09-22T01:38:18.549611+0000","last_became_peered":"2024-09-22T01:38:18.549611+0000","last_unstale":"2024-09-22T01:38:35.357506+0000","last_undegraded":"2024-09-22T01:38:35.357506+0000","last_fullsized":"2024-09-22T01:38:35.357506+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:23:17.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":555,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903846+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:38:34.903846+0000","last_peered":"2024-09-22T01:38:34.903846+0000","last_clean":"2024-09-22T01:38:34.903846+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:38:34.903846+0000","last_undegraded":"2024-09-22T01:38:34.903846+0000","last_fullsized":"2024-09-22T01:38:34.903846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"200'710","reported_seq":2755,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896397+0000","last_change":"2024-09-22T01:38:10.718846+0000","last_active":"2024-09-22T01:38:34.896397+0000","last_peered":"2024-09-22T01:38:34.896397+0000","last_clean":"2024-09-22T01:38:34.896397+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:38:34.896397+0000","last_undegraded":"2024-09-22T01:38:34.896397+0000","last_fullsized":"2024-09-22T01:38:34.896397+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:07.740863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019014889999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7238,"num_read_kb":52542,"num_write":881,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"200'459","reported_seq":6084,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.900835+0000","last_change":"2024-09-22T01:38:21.562582+0000","last_active":"2024-09-22T01:38:34.900835+0000","last_peered":"2024-09-22T01:38:34.900835+0000","last_clean":"2024-09-22T01:38:34.900835+0000","last_became_active":"2024-09-22T01:38:21.558253+0000","last_became_peered":"2024-09-22T01:38:21.558253+0000","last_unstale":"2024-09-22T01:38:34.900835+0000","last_undegraded":"2024-09-22T01:38:34.900835+0000","last_fullsized":"2024-09-22T01:38:34.900835+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:40.979341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001663412,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4390,"num_read_kb":53937,"num_write":461,"num_write_kb":17688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":594,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"200'635","reported_seq":14815,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083618+0000","last_change":"2024-09-22T01:38:10.724616+0000","last_active":"2024-09-22T01:38:35.083618+0000","last_peered":"2024-09-22T01:38:35.083618+0000","last_clean":"2024-09-22T01:38:35.083618+0000","last_became_active":"2024-09-22T01:37:53.540222+0000","last_became_peered":"2024-09-22T01:37:53.540222+0000","last_unstale":"2024-09-22T01:38:35.083618+0000","last_undegraded":"2024-09-22T01:38:35.083618+0000","last_fullsized":"2024-09-22T01:38:35.083618+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:37.067471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003616101,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":15637,"num_read_kb":20649,"num_write":595,"num_write_kb":18769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2278048,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"199'443","reported_seq":3508,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896518+0000","last_change":"2024-09-22T01:38:10.720117+0000","last_active":"2024-09-22T01:38:34.896518+0000","last_peered":"2024-09-22T01:38:34.896518+0000","last_clean":"2024-09-22T01:38:34.896518+0000","last_became_active":"2024-09-22T01:38:09.556931+0000","last_became_peered":"2024-09-22T01:38:09.556931+0000","last_unstale":"2024-09-22T01:38:34.896518+0000","last_undegraded":"2024-09-22T01:38:34.896518+0000","last_fullsized":"2024-09-22T01:38:34.896518+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:53.849962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027549219999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2831,"num_read_kb":14353,"num_write":499,"num_write_kb":9050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":11719816,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"199'567","reported_seq":6038,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357579+0000","last_change":"2024-09-22T01:38:10.718677+0000","last_active":"2024-09-22T01:38:35.357579+0000","last_peered":"2024-09-22T01:38:35.357579+0000","last_clean":"2024-09-22T01:38:35.357579+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:38:35.357579+0000","last_undegraded":"2024-09-22T01:38:35.357579+0000","last_fullsized":"2024-09-22T01:38:35.357579+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:11.101496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095552699999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6990,"num_read_kb":34807,"num_write":525,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"195'504","reported_seq":5025,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904493+0000","last_change":"2024-09-22T01:38:10.878997+0000","last_active":"2024-09-22T01:38:34.904493+0000","last_peered":"2024-09-22T01:38:34.904493+0000","last_clean":"2024-09-22T01:38:34.904493+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:38:34.904493+0000","last_undegraded":"2024-09-22T01:38:34.904493+0000","last_fullsized":"2024-09-22T01:38:34.904493+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:42.271093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043325960000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5598,"num_read_kb":19917,"num_write":545,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"199'719","reported_seq":4660,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904179+0000","last_change":"2024-09-22T01:38:10.878033+0000","last_active":"2024-09-22T01:38:34.904179+0000","last_peered":"2024-09-22T01:38:34.904179+0000","last_clean":"2024-09-22T01:38:34.904179+0000","last_became_active":"2024-09-22T01:37:52.551465+0000","last_became_peered":"2024-09-22T01:37:52.551465+0000","last_unstale":"2024-09-22T01:38:34.904179+0000","last_undegraded":"2024-09-22T01:38:34.904179+0000","last_fullsized":"2024-09-22T01:38:34.904179+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:44:14.540874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003391972,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4576,"num_read_kb":18630,"num_write":892,"num_write_kb":13182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"195'719","reported_seq":3678,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904380+0000","last_change":"2024-09-22T01:38:10.880113+0000","last_active":"2024-09-22T01:38:34.904380+0000","last_peered":"2024-09-22T01:38:34.904380+0000","last_clean":"2024-09-22T01:38:34.904380+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:38:34.904380+0000","last_undegraded":"2024-09-22T01:38:34.904380+0000","last_fullsized":"2024-09-22T01:38:34.904380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:08.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104090000000003,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5534,"num_read_kb":24700,"num_write":880,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"197'714","reported_seq":3404,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083601+0000","last_change":"2024-09-22T01:38:10.724283+0000","last_active":"2024-09-22T01:38:35.083601+0000","last_peered":"2024-09-22T01:38:35.083601+0000","last_clean":"2024-09-22T01:38:35.083601+0000","last_became_active":"2024-09-22T01:37:55.549740+0000","last_became_peered":"2024-09-22T01:37:55.549740+0000","last_unstale":"2024-09-22T01:38:35.083601+0000","last_undegraded":"2024-09-22T01:38:35.083601+0000","last_fullsized":"2024-09-22T01:38:35.083601+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:19.659250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034685710000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4516,"num_read_kb":14551,"num_write":804,"num_write_kb":16271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":7558660,"num_keys_recovered":94,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'391","reported_seq":5805,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.909473+0000","last_change":"2024-09-22T01:38:34.909473+0000","last_active":"2024-09-22T01:38:34.909473+0000","last_peered":"2024-09-22T01:38:34.909473+0000","last_clean":"2024-09-22T01:38:34.909473+0000","last_became_active":"2024-09-22T01:38:34.906641+0000","last_became_peered":"2024-09-22T01:38:34.906641+0000","last_unstale":"2024-09-22T01:38:34.909473+0000","last_undegraded":"2024-09-22T01:38:34.909473+0000","last_fullsized":"2024-09-22T01:38:34.909473+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:15.996636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081673900000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4801,"num_read_kb":46850,"num_write":333,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'488","reported_seq":5320,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347078+0000","last_change":"2024-09-22T01:38:10.730581+0000","last_active":"2024-09-22T01:38:35.347078+0000","last_peered":"2024-09-22T01:38:35.347078+0000","last_clean":"2024-09-22T01:38:35.347078+0000","last_became_active":"2024-09-22T01:37:54.552738+0000","last_became_peered":"2024-09-22T01:37:54.552738+0000","last_unstale":"2024-09-22T01:38:35.347078+0000","last_undegraded":"2024-09-22T01:38:35.347078+0000","last_fullsized":"2024-09-22T01:38:35.347078+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:40:47.324243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012133160000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5061,"num_read_kb":18985,"num_write":533,"num_write_kb":10276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":8748779,"num_keys_recovered":66,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"195'652","reported_seq":11544,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903908+0000","last_change":"2024-09-22T01:38:10.881356+0000","last_active":"2024-09-22T01:38:34.903908+0000","last_peered":"2024-09-22T01:38:34.903908+0000","last_clean":"2024-09-22T01:38:34.903908+0000","last_became_active":"2024-09-22T01:37:53.541188+0000","last_became_peered":"2024-09-22T01:37:53.541188+0000","last_unstale":"2024-09-22T01:38:34.903908+0000","last_undegraded":"2024-09-22T01:38:34.903908+0000","last_fullsized":"2024-09-22T01:38:34.903908+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:43.737368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064999480000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":12287,"num_read_kb":47236,"num_write":568,"num_write_kb":13755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":329,"num_bytes_recovered":11479448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":158,"num_read":199037,"num_read_kb":1036514,"num_write":21389,"num_write_kb":541533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7692,"num_bytes_recovered":422659173,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19088,"ondisk_log_size":19088,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64940,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306900,"statfs":{"total":96636764160,"available":96570265600,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74092,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297748,"statfs":{"total":96636764160,"available":96560893952,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47716,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324124,"statfs":{"total":96636764160,"available":96587902976,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37984,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333856,"statfs":{"total":96636764160,"available":96597868544,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2707456,"data_stored":1310735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52452,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319388,"statfs":{"total":96636764160,"available":96583053312,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:38:38.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T01:38:39.259 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:38:39.259 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":223,"fsid":"2d4626ba-577e-46d9-ad53-8451e5733f43","created":"2024-09-22T01:34:18.722829+0000","modified":"2024-09-22T01:38:34.892310+0000","last_up_change":"2024-09-22T01:34:31.284224+0000","last_in_change":"2024-09-22T01:38:17.759354+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-22T01:34:31.452919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-22T01:34:36.960578+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-22T01:34:46.686791+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":47,"snap_epoch":200,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8de621b1-0a3b-4b8b-b982-70e8db073085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6825","nonce":1213730345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6827","nonce":1213730345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6831","nonce":1213730345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":1213730345},{"type":"v1","addr":"172.21.15.18:6829","nonce":1213730345}]},"public_addr":"172.21.15.18:6825/1213730345","cluster_addr":"172.21.15.18:6827/1213730345","heartbeat_back_addr":"172.21.15.18:6831/1213730345","heartbeat_front_addr":"172.21.15.18:6829/1213730345","state":["exists","up"]},{"osd":1,"uuid":"798cbd57-ebd4-461a-9bbf-68e683d1049e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":210,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6801","nonce":3361514324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6803","nonce":3361514324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6807","nonce":3361514324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3361514324},{"type":"v1","addr":"172.21.15.18:6805","nonce":3361514324}]},"public_addr":"172.21.15.18:6801/3361514324","cluster_addr":"172.21.15.18:6803/3361514324","heartbeat_back_addr":"172.21.15.18:6807/3361514324","heartbeat_front_addr":"172.21.15.18:6805/3361514324","state":["exists","up"]},{"osd":2,"uuid":"9294585f-3dc9-4b04-8cae-f8d78c92791e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":209,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6817","nonce":4002178714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6819","nonce":4002178714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6823","nonce":4002178714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":4002178714},{"type":"v1","addr":"172.21.15.18:6821","nonce":4002178714}]},"public_addr":"172.21.15.18:6817/4002178714","cluster_addr":"172.21.15.18:6819/4002178714","heartbeat_back_addr":"172.21.15.18:6823/4002178714","heartbeat_front_addr":"172.21.15.18:6821/4002178714","state":["exists","up"]},{"osd":3,"uuid":"1ff1abf7-fdbb-4f8a-85e5-90f102abcec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6809","nonce":2610959301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6811","nonce":2610959301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6815","nonce":2610959301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":2610959301},{"type":"v1","addr":"172.21.15.18:6813","nonce":2610959301}]},"public_addr":"172.21.15.18:6809/2610959301","cluster_addr":"172.21.15.18:6811/2610959301","heartbeat_back_addr":"172.21.15.18:6815/2610959301","heartbeat_front_addr":"172.21.15.18:6813/2610959301","state":["exists","up"]},{"osd":4,"uuid":"9aa2579a-ada1-45f3-9341-f46697c28212","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":209,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6825","nonce":482886379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6827","nonce":482886379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6831","nonce":482886379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":482886379},{"type":"v1","addr":"172.21.15.179:6829","nonce":482886379}]},"public_addr":"172.21.15.179:6825/482886379","cluster_addr":"172.21.15.179:6827/482886379","heartbeat_back_addr":"172.21.15.179:6831/482886379","heartbeat_front_addr":"172.21.15.179:6829/482886379","state":["exists","up"]},{"osd":5,"uuid":"4a6678eb-28ca-4b05-96ae-e9deeb60ca96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6817","nonce":2695689817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6819","nonce":2695689817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6823","nonce":2695689817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2695689817},{"type":"v1","addr":"172.21.15.179:6821","nonce":2695689817}]},"public_addr":"172.21.15.179:6817/2695689817","cluster_addr":"172.21.15.179:6819/2695689817","heartbeat_back_addr":"172.21.15.179:6823/2695689817","heartbeat_front_addr":"172.21.15.179:6821/2695689817","state":["exists","up"]},{"osd":6,"uuid":"775b01e8-5705-4b98-a3ab-f15a78271355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6809","nonce":1840779137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6811","nonce":1840779137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6815","nonce":1840779137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":1840779137},{"type":"v1","addr":"172.21.15.179:6813","nonce":1840779137}]},"public_addr":"172.21.15.179:6809/1840779137","cluster_addr":"172.21.15.179:6811/1840779137","heartbeat_back_addr":"172.21.15.179:6815/1840779137","heartbeat_front_addr":"172.21.15.179:6813/1840779137","state":["exists","up"]},{"osd":7,"uuid":"15f6d6c1-8a16-42c6-9e43-f3a92e511735","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":222,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6801","nonce":4222842386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6803","nonce":4222842386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6807","nonce":4222842386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":4222842386},{"type":"v1","addr":"172.21.15.179:6805","nonce":4222842386}]},"public_addr":"172.21.15.179:6801/4222842386","cluster_addr":"172.21.15.179:6803/4222842386","heartbeat_back_addr":"172.21.15.179:6807/4222842386","heartbeat_front_addr":"172.21.15.179:6805/4222842386","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.339566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.065958+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.261750+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.463117+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.557372+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.195553+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:28.008891+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-22T01:34:27.839466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T01:38:40.279 INFO:tasks.ceph:Scrubbing osd.0 2024-09-22T01:38:40.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-22T01:38:40.446 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:40.446 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T01:38:40.446 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:40.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-22T01:38:40.761 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 0 to deep-scrub 2024-09-22T01:38:40.781 INFO:tasks.ceph:Scrubbing osd.1 2024-09-22T01:38:40.782 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-22T01:38:40.935 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:40.936 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T01:38:40.936 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:40.954 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-22T01:38:41.251 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 1 to deep-scrub 2024-09-22T01:38:41.271 INFO:tasks.ceph:Scrubbing osd.2 2024-09-22T01:38:41.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-22T01:38:41.413 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:41.413 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T01:38:41.413 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:41.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-22T01:38:41.713 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 2 to deep-scrub 2024-09-22T01:38:41.730 INFO:tasks.ceph:Scrubbing osd.3 2024-09-22T01:38:41.731 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-22T01:38:41.874 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:41.874 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T01:38:41.874 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:41.889 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-22T01:38:42.178 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 3 to deep-scrub 2024-09-22T01:38:42.196 INFO:tasks.ceph:Scrubbing osd.4 2024-09-22T01:38:42.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-22T01:38:42.339 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:42.340 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T01:38:42.340 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:42.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-22T01:38:42.638 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 4 to deep-scrub 2024-09-22T01:38:42.657 INFO:tasks.ceph:Scrubbing osd.5 2024-09-22T01:38:42.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-22T01:38:42.801 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:42.802 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T01:38:42.802 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:42.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-22T01:38:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 5 to deep-scrub 2024-09-22T01:38:43.119 INFO:tasks.ceph:Scrubbing osd.6 2024-09-22T01:38:43.119 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-22T01:38:43.272 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:43.273 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T01:38:43.273 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:43.289 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-22T01:38:43.583 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 6 to deep-scrub 2024-09-22T01:38:43.605 INFO:tasks.ceph:Scrubbing osd.7 2024-09-22T01:38:43.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-22T01:38:43.758 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-22T01:38:43.758 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-22T01:38:43.758 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-22T01:38:43.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-22T01:38:44.078 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 7 to deep-scrub 2024-09-22T01:38:44.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:38:44.402 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:38:44.453 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:38:44.454 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-22T01:38:43.443634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":158,"num_read":199153,"num_read_kb":1036614,"num_write":21550,"num_write_kb":543951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7705,"num_bytes_recovered":423839947,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19215,"ondisk_log_size":19215,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":431400,"kb_used_data":22264,"kb_used_omap":12,"kb_used_meta":408947,"kb_avail":754543320,"statfs":{"total":773094113280,"available":772652359680,"internally_reserved":0,"allocated":22798336,"data_stored":11666388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":418762288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.556732"},"pg_stats":[{"pgid":"3.1f","version":"200'725","reported_seq":6353,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347345+0000","last_change":"2024-09-22T01:38:10.733388+0000","last_active":"2024-09-22T01:38:35.347345+0000","last_peered":"2024-09-22T01:38:35.347345+0000","last_clean":"2024-09-22T01:38:35.347345+0000","last_became_active":"2024-09-22T01:37:55.543472+0000","last_became_peered":"2024-09-22T01:37:55.543472+0000","last_unstale":"2024-09-22T01:38:35.347345+0000","last_undegraded":"2024-09-22T01:38:35.347345+0000","last_fullsized":"2024-09-22T01:38:35.347345+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003797618,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6872,"num_read_kb":35444,"num_write":908,"num_write_kb":14992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":471,"num_bytes_recovered":26513955,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'595","reported_seq":4887,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896594+0000","last_change":"2024-09-22T01:38:10.718270+0000","last_active":"2024-09-22T01:38:34.896594+0000","last_peered":"2024-09-22T01:38:34.896594+0000","last_clean":"2024-09-22T01:38:34.896594+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:38:34.896594+0000","last_undegraded":"2024-09-22T01:38:34.896594+0000","last_fullsized":"2024-09-22T01:38:34.896594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:34:42.187105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013742629999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6272,"num_read_kb":47931,"num_write":611,"num_write_kb":23751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"192'1025","reported_seq":3549,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357872+0000","last_change":"2024-09-22T01:38:10.722087+0000","last_active":"2024-09-22T01:38:35.357872+0000","last_peered":"2024-09-22T01:38:35.357872+0000","last_clean":"2024-09-22T01:38:35.357872+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:38:35.357872+0000","last_undegraded":"2024-09-22T01:38:35.357872+0000","last_fullsized":"2024-09-22T01:38:35.357872+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1025,"log_dups_size":0,"ondisk_log_size":1025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:23:49.654245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040346269999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5544,"num_read_kb":33914,"num_write":1530,"num_write_kb":16573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"200'301","reported_seq":3044,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357569+0000","last_change":"2024-09-22T01:38:10.719510+0000","last_active":"2024-09-22T01:38:35.357569+0000","last_peered":"2024-09-22T01:38:35.357569+0000","last_clean":"2024-09-22T01:38:35.357569+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:38:35.357569+0000","last_undegraded":"2024-09-22T01:38:35.357569+0000","last_fullsized":"2024-09-22T01:38:35.357569+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:09:22.141096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001909486,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2195,"num_read_kb":35041,"num_write":325,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"199'1171","reported_seq":5658,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347256+0000","last_change":"2024-09-22T01:38:10.733439+0000","last_active":"2024-09-22T01:38:35.347256+0000","last_peered":"2024-09-22T01:38:35.347256+0000","last_clean":"2024-09-22T01:38:35.347256+0000","last_became_active":"2024-09-22T01:37:55.544664+0000","last_became_peered":"2024-09-22T01:37:55.544664+0000","last_unstale":"2024-09-22T01:38:35.347256+0000","last_undegraded":"2024-09-22T01:38:35.347256+0000","last_fullsized":"2024-09-22T01:38:35.347256+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":1171,"log_dups_size":0,"ondisk_log_size":1171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037623719999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9924,"num_read_kb":24565,"num_write":1636,"num_write_kb":13745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":17295622,"num_keys_recovered":162,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"198'501","reported_seq":5494,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.901120+0000","last_change":"2024-09-22T01:38:10.728240+0000","last_active":"2024-09-22T01:38:34.901120+0000","last_peered":"2024-09-22T01:38:34.901120+0000","last_clean":"2024-09-22T01:38:34.901120+0000","last_became_active":"2024-09-22T01:37:52.551423+0000","last_became_peered":"2024-09-22T01:37:52.551423+0000","last_unstale":"2024-09-22T01:38:34.901120+0000","last_undegraded":"2024-09-22T01:38:34.901120+0000","last_fullsized":"2024-09-22T01:38:34.901120+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:27:12.516388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040494620000000002,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":4854,"num_read_kb":40179,"num_write":503,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"199'860","reported_seq":9671,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079561+0000","last_change":"2024-09-22T01:38:10.851316+0000","last_active":"2024-09-22T01:38:35.079561+0000","last_peered":"2024-09-22T01:38:35.079561+0000","last_clean":"2024-09-22T01:38:35.079561+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:38:35.079561+0000","last_undegraded":"2024-09-22T01:38:35.079561+0000","last_fullsized":"2024-09-22T01:38:35.079561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":860,"log_dups_size":0,"ondisk_log_size":860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014346890000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10611,"num_read_kb":63679,"num_write":1135,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"189'946","reported_seq":3717,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896437+0000","last_change":"2024-09-22T01:38:10.719184+0000","last_active":"2024-09-22T01:38:34.896437+0000","last_peered":"2024-09-22T01:38:34.896437+0000","last_clean":"2024-09-22T01:38:34.896437+0000","last_became_active":"2024-09-22T01:37:55.541794+0000","last_became_peered":"2024-09-22T01:37:55.541794+0000","last_unstale":"2024-09-22T01:38:34.896437+0000","last_undegraded":"2024-09-22T01:38:34.896437+0000","last_fullsized":"2024-09-22T01:38:34.896437+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":946,"log_dups_size":0,"ondisk_log_size":946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:40:13.936798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020228920000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1485,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":2375363,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"223'544","reported_seq":6392,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:40.945970+0000","last_change":"2024-09-22T01:38:40.946011+0000","last_active":"2024-09-22T01:38:40.945970+0000","last_peered":"2024-09-22T01:38:40.945970+0000","last_clean":"2024-09-22T01:38:40.945970+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:38:40.945970+0000","last_undegraded":"2024-09-22T01:38:40.945970+0000","last_fullsized":"2024-09-22T01:38:40.945970+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'544","last_scrub_stamp":"2024-09-22T01:38:40.945881+0000","last_deep_scrub":"223'544","last_deep_scrub_stamp":"2024-09-22T01:38:40.945881+0000","last_clean_scrub_stamp":"2024-09-22T01:38:40.945881+0000","objects_scrubbed":7,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:48:46.428425+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0028964960000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6199,"num_read_kb":32488,"num_write":514,"num_write_kb":34060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"194'705","reported_seq":14973,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357742+0000","last_change":"2024-09-22T01:38:10.719590+0000","last_active":"2024-09-22T01:38:35.357742+0000","last_peered":"2024-09-22T01:38:35.357742+0000","last_clean":"2024-09-22T01:38:35.357742+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:38:35.357742+0000","last_undegraded":"2024-09-22T01:38:35.357742+0000","last_fullsized":"2024-09-22T01:38:35.357742+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:31:21.547906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018802389999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":14794,"num_read_kb":34409,"num_write":702,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"194'298","reported_seq":5181,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904227+0000","last_change":"2024-09-22T01:38:10.876772+0000","last_active":"2024-09-22T01:38:34.904227+0000","last_peered":"2024-09-22T01:38:34.904227+0000","last_clean":"2024-09-22T01:38:34.904227+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:38:34.904227+0000","last_undegraded":"2024-09-22T01:38:34.904227+0000","last_fullsized":"2024-09-22T01:38:34.904227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:21:02.333056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002237429,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4129,"num_read_kb":34295,"num_write":247,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"198'437","reported_seq":6700,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.901138+0000","last_change":"2024-09-22T01:38:10.726480+0000","last_active":"2024-09-22T01:38:34.901138+0000","last_peered":"2024-09-22T01:38:34.901138+0000","last_clean":"2024-09-22T01:38:34.901138+0000","last_became_active":"2024-09-22T01:37:52.550304+0000","last_became_peered":"2024-09-22T01:37:52.550304+0000","last_unstale":"2024-09-22T01:38:34.901138+0000","last_undegraded":"2024-09-22T01:38:34.901138+0000","last_fullsized":"2024-09-22T01:38:34.901138+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:09:12.974811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029114100000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6427,"num_read_kb":54267,"num_write":376,"num_write_kb":20603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":443,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083680+0000","last_change":"2024-09-22T01:37:51.552938+0000","last_active":"2024-09-22T01:38:35.083680+0000","last_peered":"2024-09-22T01:38:35.083680+0000","last_clean":"2024-09-22T01:38:35.083680+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:38:35.083680+0000","last_undegraded":"2024-09-22T01:38:35.083680+0000","last_fullsized":"2024-09-22T01:38:35.083680+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:03:20.798595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"200'512","reported_seq":6233,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347295+0000","last_change":"2024-09-22T01:38:10.732138+0000","last_active":"2024-09-22T01:38:35.347295+0000","last_peered":"2024-09-22T01:38:35.347295+0000","last_clean":"2024-09-22T01:38:35.347295+0000","last_became_active":"2024-09-22T01:37:55.544363+0000","last_became_peered":"2024-09-22T01:37:55.544363+0000","last_unstale":"2024-09-22T01:38:35.347295+0000","last_undegraded":"2024-09-22T01:38:35.347295+0000","last_fullsized":"2024-09-22T01:38:35.347295+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":512,"log_dups_size":0,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028137370000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5201,"num_read_kb":38761,"num_write":409,"num_write_kb":38186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":46874722,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":433,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:41.573009+0000","last_change":"2024-09-22T01:38:41.573034+0000","last_active":"2024-09-22T01:38:41.573009+0000","last_peered":"2024-09-22T01:38:41.573009+0000","last_clean":"2024-09-22T01:38:41.573009+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:38:41.573009+0000","last_undegraded":"2024-09-22T01:38:41.573009+0000","last_fullsized":"2024-09-22T01:38:41.573009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:38:41.572913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:38:41.572913+0000","last_clean_scrub_stamp":"2024-09-22T01:38:41.572913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:54.253158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"199'371","reported_seq":3618,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896657+0000","last_change":"2024-09-22T01:38:10.720206+0000","last_active":"2024-09-22T01:38:34.896657+0000","last_peered":"2024-09-22T01:38:34.896657+0000","last_clean":"2024-09-22T01:38:34.896657+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:38:34.896657+0000","last_undegraded":"2024-09-22T01:38:34.896657+0000","last_fullsized":"2024-09-22T01:38:34.896657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:48:59.654933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026027870000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":3471,"num_read_kb":20726,"num_write":356,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":312,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904225+0000","last_change":"2024-09-22T01:36:03.523287+0000","last_active":"2024-09-22T01:38:34.904225+0000","last_peered":"2024-09-22T01:38:34.904225+0000","last_clean":"2024-09-22T01:38:34.904225+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:38:34.904225+0000","last_undegraded":"2024-09-22T01:38:34.904225+0000","last_fullsized":"2024-09-22T01:38:34.904225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:59:41.272135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"200'620","reported_seq":4738,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079684+0000","last_change":"2024-09-22T01:38:22.557835+0000","last_active":"2024-09-22T01:38:35.079684+0000","last_peered":"2024-09-22T01:38:35.079684+0000","last_clean":"2024-09-22T01:38:35.079684+0000","last_became_active":"2024-09-22T01:38:22.556550+0000","last_became_peered":"2024-09-22T01:38:22.556550+0000","last_unstale":"2024-09-22T01:38:35.079684+0000","last_undegraded":"2024-09-22T01:38:35.079684+0000","last_fullsized":"2024-09-22T01:38:35.079684+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014576910000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5589,"num_read_kb":37802,"num_write":624,"num_write_kb":11232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.079833+0000","last_change":"2024-09-22T01:38:22.618094+0000","last_active":"2024-09-22T01:38:35.079833+0000","last_peered":"2024-09-22T01:38:35.079833+0000","last_clean":"2024-09-22T01:38:35.079833+0000","last_became_active":"2024-09-22T01:38:22.617578+0000","last_became_peered":"2024-09-22T01:38:22.617578+0000","last_unstale":"2024-09-22T01:38:35.079833+0000","last_undegraded":"2024-09-22T01:38:35.079833+0000","last_fullsized":"2024-09-22T01:38:35.079833+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"198'514","reported_seq":8221,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357890+0000","last_change":"2024-09-22T01:38:10.721771+0000","last_active":"2024-09-22T01:38:35.357890+0000","last_peered":"2024-09-22T01:38:35.357890+0000","last_clean":"2024-09-22T01:38:35.357890+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:38:35.357890+0000","last_undegraded":"2024-09-22T01:38:35.357890+0000","last_fullsized":"2024-09-22T01:38:35.357890+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:29:02.007042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036439129999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":8480,"num_read_kb":54220,"num_write":523,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"200'431","reported_seq":1824,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.084232+0000","last_change":"2024-09-22T01:38:10.723787+0000","last_active":"2024-09-22T01:38:35.084232+0000","last_peered":"2024-09-22T01:38:35.084232+0000","last_clean":"2024-09-22T01:38:35.084232+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:38:35.084232+0000","last_undegraded":"2024-09-22T01:38:35.084232+0000","last_fullsized":"2024-09-22T01:38:35.084232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:24:11.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002825424,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":1512,"num_read_kb":6460,"num_write":402,"num_write_kb":3582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":172,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357532+0000","last_change":"2024-09-22T01:37:13.539302+0000","last_active":"2024-09-22T01:38:35.357532+0000","last_peered":"2024-09-22T01:38:35.357532+0000","last_clean":"2024-09-22T01:38:35.357532+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:38:35.357532+0000","last_undegraded":"2024-09-22T01:38:35.357532+0000","last_fullsized":"2024-09-22T01:38:35.357532+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:46:25.783396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"198'518","reported_seq":4482,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:41.251482+0000","last_change":"2024-09-22T01:38:21.559272+0000","last_active":"2024-09-22T01:38:41.251482+0000","last_peered":"2024-09-22T01:38:41.251482+0000","last_clean":"2024-09-22T01:38:41.251482+0000","last_became_active":"2024-09-22T01:38:21.557572+0000","last_became_peered":"2024-09-22T01:38:21.557572+0000","last_unstale":"2024-09-22T01:38:41.251482+0000","last_undegraded":"2024-09-22T01:38:41.251482+0000","last_fullsized":"2024-09-22T01:38:41.251482+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001437699,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4350,"num_read_kb":14870,"num_write":524,"num_write_kb":23558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.902378+0000","last_change":"2024-09-22T01:38:18.600969+0000","last_active":"2024-09-22T01:38:34.902378+0000","last_peered":"2024-09-22T01:38:34.902378+0000","last_clean":"2024-09-22T01:38:34.902378+0000","last_became_active":"2024-09-22T01:38:18.600600+0000","last_became_peered":"2024-09-22T01:38:18.600600+0000","last_unstale":"2024-09-22T01:38:34.902378+0000","last_undegraded":"2024-09-22T01:38:34.902378+0000","last_fullsized":"2024-09-22T01:38:34.902378+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"199'558","reported_seq":5304,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347130+0000","last_change":"2024-09-22T01:38:10.731424+0000","last_active":"2024-09-22T01:38:35.347130+0000","last_peered":"2024-09-22T01:38:35.347130+0000","last_clean":"2024-09-22T01:38:35.347130+0000","last_became_active":"2024-09-22T01:37:53.571926+0000","last_became_peered":"2024-09-22T01:37:53.571926+0000","last_unstale":"2024-09-22T01:38:35.347130+0000","last_undegraded":"2024-09-22T01:38:35.347130+0000","last_fullsized":"2024-09-22T01:38:35.347130+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002041817,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":5042,"num_read_kb":25966,"num_write":576,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":307,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903756+0000","last_change":"2024-09-22T01:35:57.529949+0000","last_active":"2024-09-22T01:38:34.903756+0000","last_peered":"2024-09-22T01:38:34.903756+0000","last_clean":"2024-09-22T01:38:34.903756+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:38:34.903756+0000","last_undegraded":"2024-09-22T01:38:34.903756+0000","last_fullsized":"2024-09-22T01:38:34.903756+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:25:40.722718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"199'462","reported_seq":2785,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896568+0000","last_change":"2024-09-22T01:38:10.718052+0000","last_active":"2024-09-22T01:38:34.896568+0000","last_peered":"2024-09-22T01:38:34.896568+0000","last_clean":"2024-09-22T01:38:34.896568+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:38:34.896568+0000","last_undegraded":"2024-09-22T01:38:34.896568+0000","last_fullsized":"2024-09-22T01:38:34.896568+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:00:08.277366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011708179999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2672,"num_read_kb":16190,"num_write":487,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":190,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357506+0000","last_change":"2024-09-22T01:38:18.559667+0000","last_active":"2024-09-22T01:38:35.357506+0000","last_peered":"2024-09-22T01:38:35.357506+0000","last_clean":"2024-09-22T01:38:35.357506+0000","last_became_active":"2024-09-22T01:38:18.549611+0000","last_became_peered":"2024-09-22T01:38:18.549611+0000","last_unstale":"2024-09-22T01:38:35.357506+0000","last_undegraded":"2024-09-22T01:38:35.357506+0000","last_fullsized":"2024-09-22T01:38:35.357506+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:37.328917+0000","last_clean_scrub_stamp":"2024-09-22T01:34:37.328917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:23:17.593051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":555,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903846+0000","last_change":"2024-09-22T01:36:06.620598+0000","last_active":"2024-09-22T01:38:34.903846+0000","last_peered":"2024-09-22T01:38:34.903846+0000","last_clean":"2024-09-22T01:38:34.903846+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:38:34.903846+0000","last_undegraded":"2024-09-22T01:38:34.903846+0000","last_fullsized":"2024-09-22T01:38:34.903846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:32.287098+0000","last_clean_scrub_stamp":"2024-09-22T01:34:32.287098+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:31:41.408160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"200'710","reported_seq":2755,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896397+0000","last_change":"2024-09-22T01:38:10.718846+0000","last_active":"2024-09-22T01:38:34.896397+0000","last_peered":"2024-09-22T01:38:34.896397+0000","last_clean":"2024-09-22T01:38:34.896397+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:38:34.896397+0000","last_undegraded":"2024-09-22T01:38:34.896397+0000","last_fullsized":"2024-09-22T01:38:34.896397+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:50:07.740863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019014889999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7238,"num_read_kb":52542,"num_write":881,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"200'459","reported_seq":6084,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.900835+0000","last_change":"2024-09-22T01:38:21.562582+0000","last_active":"2024-09-22T01:38:34.900835+0000","last_peered":"2024-09-22T01:38:34.900835+0000","last_clean":"2024-09-22T01:38:34.900835+0000","last_became_active":"2024-09-22T01:38:21.558253+0000","last_became_peered":"2024-09-22T01:38:21.558253+0000","last_unstale":"2024-09-22T01:38:34.900835+0000","last_undegraded":"2024-09-22T01:38:34.900835+0000","last_fullsized":"2024-09-22T01:38:34.900835+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:19:40.979341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001663412,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4390,"num_read_kb":53937,"num_write":461,"num_write_kb":17688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":594,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"200'635","reported_seq":14815,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083618+0000","last_change":"2024-09-22T01:38:10.724616+0000","last_active":"2024-09-22T01:38:35.083618+0000","last_peered":"2024-09-22T01:38:35.083618+0000","last_clean":"2024-09-22T01:38:35.083618+0000","last_became_active":"2024-09-22T01:37:53.540222+0000","last_became_peered":"2024-09-22T01:37:53.540222+0000","last_unstale":"2024-09-22T01:38:35.083618+0000","last_undegraded":"2024-09-22T01:38:35.083618+0000","last_fullsized":"2024-09-22T01:38:35.083618+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:41:37.067471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003616101,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":15637,"num_read_kb":20649,"num_write":595,"num_write_kb":18769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2278048,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"199'443","reported_seq":3508,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.896518+0000","last_change":"2024-09-22T01:38:10.720117+0000","last_active":"2024-09-22T01:38:34.896518+0000","last_peered":"2024-09-22T01:38:34.896518+0000","last_clean":"2024-09-22T01:38:34.896518+0000","last_became_active":"2024-09-22T01:38:09.556931+0000","last_became_peered":"2024-09-22T01:38:09.556931+0000","last_unstale":"2024-09-22T01:38:34.896518+0000","last_undegraded":"2024-09-22T01:38:34.896518+0000","last_fullsized":"2024-09-22T01:38:34.896518+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:14:53.849962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027549219999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2831,"num_read_kb":14353,"num_write":499,"num_write_kb":9050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":11719816,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"199'567","reported_seq":6038,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.357579+0000","last_change":"2024-09-22T01:38:10.718677+0000","last_active":"2024-09-22T01:38:35.357579+0000","last_peered":"2024-09-22T01:38:35.357579+0000","last_clean":"2024-09-22T01:38:35.357579+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:38:35.357579+0000","last_undegraded":"2024-09-22T01:38:35.357579+0000","last_fullsized":"2024-09-22T01:38:35.357579+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:07:11.101496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095552699999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6990,"num_read_kb":34807,"num_write":525,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"195'504","reported_seq":5025,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904493+0000","last_change":"2024-09-22T01:38:10.878997+0000","last_active":"2024-09-22T01:38:34.904493+0000","last_peered":"2024-09-22T01:38:34.904493+0000","last_clean":"2024-09-22T01:38:34.904493+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:38:34.904493+0000","last_undegraded":"2024-09-22T01:38:34.904493+0000","last_fullsized":"2024-09-22T01:38:34.904493+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:18:42.271093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043325960000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5598,"num_read_kb":19917,"num_write":545,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"199'719","reported_seq":4660,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904179+0000","last_change":"2024-09-22T01:38:10.878033+0000","last_active":"2024-09-22T01:38:34.904179+0000","last_peered":"2024-09-22T01:38:34.904179+0000","last_clean":"2024-09-22T01:38:34.904179+0000","last_became_active":"2024-09-22T01:37:52.551465+0000","last_became_peered":"2024-09-22T01:37:52.551465+0000","last_unstale":"2024-09-22T01:38:34.904179+0000","last_undegraded":"2024-09-22T01:38:34.904179+0000","last_fullsized":"2024-09-22T01:38:34.904179+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:44:14.540874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003391972,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4576,"num_read_kb":18630,"num_write":892,"num_write_kb":13182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"195'719","reported_seq":3678,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.904380+0000","last_change":"2024-09-22T01:38:10.880113+0000","last_active":"2024-09-22T01:38:34.904380+0000","last_peered":"2024-09-22T01:38:34.904380+0000","last_clean":"2024-09-22T01:38:34.904380+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:38:34.904380+0000","last_undegraded":"2024-09-22T01:38:34.904380+0000","last_fullsized":"2024-09-22T01:38:34.904380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:49:08.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104090000000003,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5534,"num_read_kb":24700,"num_write":880,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"197'714","reported_seq":3404,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.083601+0000","last_change":"2024-09-22T01:38:10.724283+0000","last_active":"2024-09-22T01:38:35.083601+0000","last_peered":"2024-09-22T01:38:35.083601+0000","last_clean":"2024-09-22T01:38:35.083601+0000","last_became_active":"2024-09-22T01:37:55.549740+0000","last_became_peered":"2024-09-22T01:37:55.549740+0000","last_unstale":"2024-09-22T01:38:35.083601+0000","last_undegraded":"2024-09-22T01:38:35.083601+0000","last_fullsized":"2024-09-22T01:38:35.083601+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:51:19.659250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034685710000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4516,"num_read_kb":14551,"num_write":804,"num_write_kb":16271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":7558660,"num_keys_recovered":94,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'391","reported_seq":5805,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.909473+0000","last_change":"2024-09-22T01:38:34.909473+0000","last_active":"2024-09-22T01:38:34.909473+0000","last_peered":"2024-09-22T01:38:34.909473+0000","last_clean":"2024-09-22T01:38:34.909473+0000","last_became_active":"2024-09-22T01:38:34.906641+0000","last_became_peered":"2024-09-22T01:38:34.906641+0000","last_unstale":"2024-09-22T01:38:34.909473+0000","last_undegraded":"2024-09-22T01:38:34.909473+0000","last_fullsized":"2024-09-22T01:38:34.909473+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:01:15.996636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081673900000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4801,"num_read_kb":46850,"num_write":333,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"199'488","reported_seq":5321,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:35.347130+0000","last_change":"2024-09-22T01:38:10.730581+0000","last_active":"2024-09-22T01:38:35.347130+0000","last_peered":"2024-09-22T01:38:35.347130+0000","last_clean":"2024-09-22T01:38:35.347130+0000","last_became_active":"2024-09-22T01:37:54.552738+0000","last_became_peered":"2024-09-22T01:37:54.552738+0000","last_unstale":"2024-09-22T01:38:35.347130+0000","last_undegraded":"2024-09-22T01:38:35.347130+0000","last_fullsized":"2024-09-22T01:38:35.347130+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012133160000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5061,"num_read_kb":18985,"num_write":533,"num_write_kb":10276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":8748779,"num_keys_recovered":66,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"195'652","reported_seq":11544,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:34.903908+0000","last_change":"2024-09-22T01:38:10.881356+0000","last_active":"2024-09-22T01:38:34.903908+0000","last_peered":"2024-09-22T01:38:34.903908+0000","last_clean":"2024-09-22T01:38:34.903908+0000","last_became_active":"2024-09-22T01:37:53.541188+0000","last_became_peered":"2024-09-22T01:37:53.541188+0000","last_unstale":"2024-09-22T01:38:34.903908+0000","last_undegraded":"2024-09-22T01:38:34.903908+0000","last_fullsized":"2024-09-22T01:38:34.903908+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:34:47.495664+0000","last_clean_scrub_stamp":"2024-09-22T01:34:47.495664+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:11:43.737368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064999480000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":12287,"num_read_kb":47236,"num_write":568,"num_write_kb":13755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":329,"num_bytes_recovered":11479448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":158,"num_read":199037,"num_read_kb":1036514,"num_write":21389,"num_write_kb":541533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7692,"num_bytes_recovered":422659173,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19095,"ondisk_log_size":19095,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64940,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94306900,"statfs":{"total":96636764160,"available":96570265600,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33824,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338016,"statfs":{"total":96636764160,"available":96602128384,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60192,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311648,"statfs":{"total":96636764160,"available":96575127552,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74092,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297748,"statfs":{"total":96636764160,"available":96560893952,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47716,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324124,"statfs":{"total":96636764160,"available":96587902976,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37984,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333856,"statfs":{"total":96636764160,"available":96597868544,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60200,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":2707456,"data_stored":1310735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52452,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319388,"statfs":{"total":96636764160,"available":96583053312,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:38:44.458 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.458 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.458 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.458 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.459 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.459 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.459 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.459 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.459 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.459 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.460 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.460 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-22T01:34:37.328917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.460 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.460 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.460 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-22T01:34:37.328917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.460 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.460 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-22T01:34:37.328917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.460 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.460 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-22T01:34:37.328917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-22T01:34:37.328917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-22T01:34:37.328917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-22T01:34:37.328917+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=37, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-22T01:34:32.287098+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=32, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.461 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.462 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.462 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.462 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.462 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.462 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.462 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.462 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.462 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.462 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-22T01:34:47.495664+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=34, tm_sec=47, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=1, tm_min=38, tm_sec=39, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T01:38:44.463 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T01:39:04.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T01:39:04.784 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-22T01:39:04.785 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-22T01:39:04.803 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2024-09-22T01:39:03.449575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":166,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":158,"num_read":199153,"num_read_kb":1036614,"num_write":21550,"num_write_kb":543951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7705,"num_bytes_recovered":423839947,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19374,"ondisk_log_size":19374,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":414712,"kb_used_data":22264,"kb_used_omap":12,"kb_used_meta":392307,"kb_avail":754560008,"statfs":{"total":773094113280,"available":772669448192,"internally_reserved":0,"allocated":22798336,"data_stored":11666388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":401722928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003522"},"pg_stats":[{"pgid":"3.1f","version":"223'727","reported_seq":6363,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:43.965884+0000","last_change":"2024-09-22T01:38:43.965930+0000","last_active":"2024-09-22T01:38:43.965884+0000","last_peered":"2024-09-22T01:38:43.965884+0000","last_clean":"2024-09-22T01:38:43.965884+0000","last_became_active":"2024-09-22T01:37:55.543472+0000","last_became_peered":"2024-09-22T01:37:55.543472+0000","last_unstale":"2024-09-22T01:38:43.965884+0000","last_undegraded":"2024-09-22T01:38:43.965884+0000","last_fullsized":"2024-09-22T01:38:43.965884+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'727","last_scrub_stamp":"2024-09-22T01:38:43.965768+0000","last_deep_scrub":"223'727","last_deep_scrub_stamp":"2024-09-22T01:38:43.965768+0000","last_clean_scrub_stamp":"2024-09-22T01:38:43.965768+0000","objects_scrubbed":2,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:07:16.003871+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.003797618,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6872,"num_read_kb":35444,"num_write":908,"num_write_kb":14992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":471,"num_bytes_recovered":26513955,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"223'597","reported_seq":4899,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:42.693084+0000","last_change":"2024-09-22T01:38:42.693084+0000","last_active":"2024-09-22T01:38:42.693084+0000","last_peered":"2024-09-22T01:38:42.693084+0000","last_clean":"2024-09-22T01:38:42.693084+0000","last_became_active":"2024-09-22T01:34:48.539288+0000","last_became_peered":"2024-09-22T01:34:48.539288+0000","last_unstale":"2024-09-22T01:38:42.693084+0000","last_undegraded":"2024-09-22T01:38:42.693084+0000","last_fullsized":"2024-09-22T01:38:42.693084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'597","last_scrub_stamp":"2024-09-22T01:38:42.692944+0000","last_deep_scrub":"223'597","last_deep_scrub_stamp":"2024-09-22T01:38:42.692944+0000","last_clean_scrub_stamp":"2024-09-22T01:38:42.692944+0000","objects_scrubbed":2,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:50:47.101196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0013742629999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":6272,"num_read_kb":47931,"num_write":611,"num_write_kb":23751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"223'1030","reported_seq":3563,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:47.548138+0000","last_change":"2024-09-22T01:38:47.548289+0000","last_active":"2024-09-22T01:38:47.548138+0000","last_peered":"2024-09-22T01:38:47.548138+0000","last_clean":"2024-09-22T01:38:47.548138+0000","last_became_active":"2024-09-22T01:37:18.542332+0000","last_became_peered":"2024-09-22T01:37:18.542332+0000","last_unstale":"2024-09-22T01:38:47.548138+0000","last_undegraded":"2024-09-22T01:38:47.548138+0000","last_fullsized":"2024-09-22T01:38:47.548138+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1030","last_scrub_stamp":"2024-09-22T01:38:47.547870+0000","last_deep_scrub":"223'1030","last_deep_scrub_stamp":"2024-09-22T01:38:47.547870+0000","last_clean_scrub_stamp":"2024-09-22T01:38:47.547870+0000","objects_scrubbed":5,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:53:02.292002+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0.0040346269999999998,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5544,"num_read_kb":33914,"num_write":1530,"num_write_kb":16573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":21436981,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"223'303","reported_seq":3055,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:44.564826+0000","last_change":"2024-09-22T01:38:44.564894+0000","last_active":"2024-09-22T01:38:44.564826+0000","last_peered":"2024-09-22T01:38:44.564826+0000","last_clean":"2024-09-22T01:38:44.564826+0000","last_became_active":"2024-09-22T01:37:16.660954+0000","last_became_peered":"2024-09-22T01:37:16.660954+0000","last_unstale":"2024-09-22T01:38:44.564826+0000","last_undegraded":"2024-09-22T01:38:44.564826+0000","last_fullsized":"2024-09-22T01:38:44.564826+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'303","last_scrub_stamp":"2024-09-22T01:38:44.564600+0000","last_deep_scrub":"223'303","last_deep_scrub_stamp":"2024-09-22T01:38:44.564600+0000","last_clean_scrub_stamp":"2024-09-22T01:38:44.564600+0000","objects_scrubbed":2,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:18:07.992480+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001909486,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":2195,"num_read_kb":35041,"num_write":325,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":27920519,"num_keys_recovered":160,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"223'1178","reported_seq":5673,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:45.976467+0000","last_change":"2024-09-22T01:38:45.976541+0000","last_active":"2024-09-22T01:38:45.976467+0000","last_peered":"2024-09-22T01:38:45.976467+0000","last_clean":"2024-09-22T01:38:45.976467+0000","last_became_active":"2024-09-22T01:37:55.544664+0000","last_became_peered":"2024-09-22T01:37:55.544664+0000","last_unstale":"2024-09-22T01:38:45.976467+0000","last_undegraded":"2024-09-22T01:38:45.976467+0000","last_fullsized":"2024-09-22T01:38:45.976467+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'1178","last_scrub_stamp":"2024-09-22T01:38:45.976279+0000","last_deep_scrub":"223'1178","last_deep_scrub_stamp":"2024-09-22T01:38:45.976279+0000","last_clean_scrub_stamp":"2024-09-22T01:38:45.976279+0000","objects_scrubbed":7,"log_size":1178,"log_dups_size":0,"ondisk_log_size":1178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:39:56.762781+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0.0037623719999999999,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":9924,"num_read_kb":24565,"num_write":1636,"num_write_kb":13745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":17295622,"num_keys_recovered":162,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"223'509","reported_seq":5511,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:44.639460+0000","last_change":"2024-09-22T01:38:44.639545+0000","last_active":"2024-09-22T01:38:44.639460+0000","last_peered":"2024-09-22T01:38:44.639460+0000","last_clean":"2024-09-22T01:38:44.639460+0000","last_became_active":"2024-09-22T01:37:52.551423+0000","last_became_peered":"2024-09-22T01:37:52.551423+0000","last_unstale":"2024-09-22T01:38:44.639460+0000","last_undegraded":"2024-09-22T01:38:44.639460+0000","last_fullsized":"2024-09-22T01:38:44.639460+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'509","last_scrub_stamp":"2024-09-22T01:38:44.639289+0000","last_deep_scrub":"223'509","last_deep_scrub_stamp":"2024-09-22T01:38:44.639289+0000","last_clean_scrub_stamp":"2024-09-22T01:38:44.639289+0000","objects_scrubbed":8,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:29:45.108798+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0.0040494620000000002,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":7,"num_read":4854,"num_read_kb":40179,"num_write":503,"num_write_kb":25287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":11186668,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"223'864","reported_seq":9683,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:42.561542+0000","last_change":"2024-09-22T01:38:42.561611+0000","last_active":"2024-09-22T01:38:42.561542+0000","last_peered":"2024-09-22T01:38:42.561542+0000","last_clean":"2024-09-22T01:38:42.561542+0000","last_became_active":"2024-09-22T01:34:48.537162+0000","last_became_peered":"2024-09-22T01:34:48.537162+0000","last_unstale":"2024-09-22T01:38:42.561542+0000","last_undegraded":"2024-09-22T01:38:42.561542+0000","last_fullsized":"2024-09-22T01:38:42.561542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'864","last_scrub_stamp":"2024-09-22T01:38:42.561366+0000","last_deep_scrub":"223'864","last_deep_scrub_stamp":"2024-09-22T01:38:42.561366+0000","last_clean_scrub_stamp":"2024-09-22T01:38:42.561366+0000","objects_scrubbed":4,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:41.103314+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0014346890000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":10611,"num_read_kb":63679,"num_write":1135,"num_write_kb":22708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"223'949","reported_seq":3729,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:46.766170+0000","last_change":"2024-09-22T01:38:46.766242+0000","last_active":"2024-09-22T01:38:46.766170+0000","last_peered":"2024-09-22T01:38:46.766170+0000","last_clean":"2024-09-22T01:38:46.766170+0000","last_became_active":"2024-09-22T01:37:55.541794+0000","last_became_peered":"2024-09-22T01:37:55.541794+0000","last_unstale":"2024-09-22T01:38:46.766170+0000","last_undegraded":"2024-09-22T01:38:46.766170+0000","last_fullsized":"2024-09-22T01:38:46.766170+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'949","last_scrub_stamp":"2024-09-22T01:38:46.765970+0000","last_deep_scrub":"223'949","last_deep_scrub_stamp":"2024-09-22T01:38:46.765970+0000","last_clean_scrub_stamp":"2024-09-22T01:38:46.765970+0000","objects_scrubbed":3,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:06:11.972914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0020228920000000001,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":5440,"num_read_kb":18150,"num_write":1485,"num_write_kb":7193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":225,"num_bytes_recovered":2375363,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"223'544","reported_seq":6392,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:40.945970+0000","last_change":"2024-09-22T01:38:40.946011+0000","last_active":"2024-09-22T01:38:40.945970+0000","last_peered":"2024-09-22T01:38:40.945970+0000","last_clean":"2024-09-22T01:38:40.945970+0000","last_became_active":"2024-09-22T01:37:17.666836+0000","last_became_peered":"2024-09-22T01:37:17.666836+0000","last_unstale":"2024-09-22T01:38:40.945970+0000","last_undegraded":"2024-09-22T01:38:40.945970+0000","last_fullsized":"2024-09-22T01:38:40.945970+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'544","last_scrub_stamp":"2024-09-22T01:38:40.945881+0000","last_deep_scrub":"223'544","last_deep_scrub_stamp":"2024-09-22T01:38:40.945881+0000","last_clean_scrub_stamp":"2024-09-22T01:38:40.945881+0000","objects_scrubbed":7,"log_size":544,"log_dups_size":0,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:48:46.428425+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0028964960000000001,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6199,"num_read_kb":32488,"num_write":514,"num_write_kb":34060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":26010620,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"223'709","reported_seq":14986,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:48.515417+0000","last_change":"2024-09-22T01:38:48.515494+0000","last_active":"2024-09-22T01:38:48.515417+0000","last_peered":"2024-09-22T01:38:48.515417+0000","last_clean":"2024-09-22T01:38:48.515417+0000","last_became_active":"2024-09-22T01:37:19.534423+0000","last_became_peered":"2024-09-22T01:37:19.534423+0000","last_unstale":"2024-09-22T01:38:48.515417+0000","last_undegraded":"2024-09-22T01:38:48.515417+0000","last_fullsized":"2024-09-22T01:38:48.515417+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'709","last_scrub_stamp":"2024-09-22T01:38:48.515214+0000","last_deep_scrub":"223'709","last_deep_scrub_stamp":"2024-09-22T01:38:48.515214+0000","last_clean_scrub_stamp":"2024-09-22T01:38:48.515214+0000","objects_scrubbed":4,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:47:46.431951+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0018802389999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":14794,"num_read_kb":34409,"num_write":702,"num_write_kb":12436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":356,"num_bytes_recovered":23730559,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"223'302","reported_seq":5194,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:45.938690+0000","last_change":"2024-09-22T01:38:45.938757+0000","last_active":"2024-09-22T01:38:45.938690+0000","last_peered":"2024-09-22T01:38:45.938690+0000","last_clean":"2024-09-22T01:38:45.938690+0000","last_became_active":"2024-09-22T01:36:00.573980+0000","last_became_peered":"2024-09-22T01:36:00.573980+0000","last_unstale":"2024-09-22T01:38:45.938690+0000","last_undegraded":"2024-09-22T01:38:45.938690+0000","last_fullsized":"2024-09-22T01:38:45.938690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'302","last_scrub_stamp":"2024-09-22T01:38:45.938508+0000","last_deep_scrub":"223'302","last_deep_scrub_stamp":"2024-09-22T01:38:45.938508+0000","last_clean_scrub_stamp":"2024-09-22T01:38:45.938508+0000","objects_scrubbed":4,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:45:37.426258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002237429,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4129,"num_read_kb":34295,"num_write":247,"num_write_kb":8332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":2672099,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"223'442","reported_seq":6714,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:43.638966+0000","last_change":"2024-09-22T01:38:43.639166+0000","last_active":"2024-09-22T01:38:43.638966+0000","last_peered":"2024-09-22T01:38:43.638966+0000","last_clean":"2024-09-22T01:38:43.638966+0000","last_became_active":"2024-09-22T01:37:52.550304+0000","last_became_peered":"2024-09-22T01:37:52.550304+0000","last_unstale":"2024-09-22T01:38:43.638966+0000","last_undegraded":"2024-09-22T01:38:43.638966+0000","last_fullsized":"2024-09-22T01:38:43.638966+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'442","last_scrub_stamp":"2024-09-22T01:38:43.638746+0000","last_deep_scrub":"223'442","last_deep_scrub_stamp":"2024-09-22T01:38:43.638746+0000","last_clean_scrub_stamp":"2024-09-22T01:38:43.638746+0000","objects_scrubbed":5,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:05:13.441927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0029114100000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":6427,"num_read_kb":54267,"num_write":376,"num_write_kb":20603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":294,"num_bytes_recovered":10262452,"num_keys_recovered":96,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":453,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:45.241280+0000","last_change":"2024-09-22T01:38:45.241280+0000","last_active":"2024-09-22T01:38:45.241280+0000","last_peered":"2024-09-22T01:38:45.241280+0000","last_clean":"2024-09-22T01:38:45.241280+0000","last_became_active":"2024-09-22T01:37:51.552447+0000","last_became_peered":"2024-09-22T01:37:51.552447+0000","last_unstale":"2024-09-22T01:38:45.241280+0000","last_undegraded":"2024-09-22T01:38:45.241280+0000","last_fullsized":"2024-09-22T01:38:45.241280+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:38:45.241040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:38:45.241040+0000","last_clean_scrub_stamp":"2024-09-22T01:38:45.241040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T06:06:41.104404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098373199999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"223'521","reported_seq":6250,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:44.979224+0000","last_change":"2024-09-22T01:38:44.979419+0000","last_active":"2024-09-22T01:38:44.979224+0000","last_peered":"2024-09-22T01:38:44.979224+0000","last_clean":"2024-09-22T01:38:44.979224+0000","last_became_active":"2024-09-22T01:37:55.544363+0000","last_became_peered":"2024-09-22T01:37:55.544363+0000","last_unstale":"2024-09-22T01:38:44.979224+0000","last_undegraded":"2024-09-22T01:38:44.979224+0000","last_fullsized":"2024-09-22T01:38:44.979224+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'521","last_scrub_stamp":"2024-09-22T01:38:44.978965+0000","last_deep_scrub":"223'521","last_deep_scrub_stamp":"2024-09-22T01:38:44.978965+0000","last_clean_scrub_stamp":"2024-09-22T01:38:44.978965+0000","objects_scrubbed":9,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:24:53.040605+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0.0028137370000000002,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":9,"num_read":5201,"num_read_kb":38761,"num_write":409,"num_write_kb":38186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":46874722,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":434,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:41.573034+0000","last_change":"2024-09-22T01:38:41.573034+0000","last_active":"2024-09-22T01:38:41.573034+0000","last_peered":"2024-09-22T01:38:41.573034+0000","last_clean":"2024-09-22T01:38:41.573034+0000","last_became_active":"2024-09-22T01:34:38.359628+0000","last_became_peered":"2024-09-22T01:34:38.359628+0000","last_unstale":"2024-09-22T01:38:41.573034+0000","last_undegraded":"2024-09-22T01:38:41.573034+0000","last_fullsized":"2024-09-22T01:38:41.573034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:38:41.572913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:38:41.572913+0000","last_clean_scrub_stamp":"2024-09-22T01:38:41.572913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:58:54.253158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011318179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"223'377","reported_seq":3633,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:43.692589+0000","last_change":"2024-09-22T01:38:43.692658+0000","last_active":"2024-09-22T01:38:43.692589+0000","last_peered":"2024-09-22T01:38:43.692589+0000","last_clean":"2024-09-22T01:38:43.692589+0000","last_became_active":"2024-09-22T01:36:00.566963+0000","last_became_peered":"2024-09-22T01:36:00.566963+0000","last_unstale":"2024-09-22T01:38:43.692589+0000","last_undegraded":"2024-09-22T01:38:43.692589+0000","last_fullsized":"2024-09-22T01:38:43.692589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'377","last_scrub_stamp":"2024-09-22T01:38:43.692497+0000","last_deep_scrub":"223'377","last_deep_scrub_stamp":"2024-09-22T01:38:43.692497+0000","last_clean_scrub_stamp":"2024-09-22T01:38:43.692497+0000","objects_scrubbed":6,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:59:51.725989+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0026027870000000001,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":3471,"num_read_kb":20726,"num_write":356,"num_write_kb":6744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1178100,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":321,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:47.938201+0000","last_change":"2024-09-22T01:38:47.938255+0000","last_active":"2024-09-22T01:38:47.938201+0000","last_peered":"2024-09-22T01:38:47.938201+0000","last_clean":"2024-09-22T01:38:47.938201+0000","last_became_active":"2024-09-22T01:36:03.522685+0000","last_became_peered":"2024-09-22T01:36:03.522685+0000","last_unstale":"2024-09-22T01:38:47.938201+0000","last_undegraded":"2024-09-22T01:38:47.938201+0000","last_fullsized":"2024-09-22T01:38:47.938201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:38:47.938003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:38:47.938003+0000","last_clean_scrub_stamp":"2024-09-22T01:38:47.938003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:23:33.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011116279999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"223'625","reported_seq":4751,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:44.627362+0000","last_change":"2024-09-22T01:38:44.627430+0000","last_active":"2024-09-22T01:38:44.627362+0000","last_peered":"2024-09-22T01:38:44.627362+0000","last_clean":"2024-09-22T01:38:44.627362+0000","last_became_active":"2024-09-22T01:38:22.556550+0000","last_became_peered":"2024-09-22T01:38:22.556550+0000","last_unstale":"2024-09-22T01:38:44.627362+0000","last_undegraded":"2024-09-22T01:38:44.627362+0000","last_fullsized":"2024-09-22T01:38:44.627362+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'625","last_scrub_stamp":"2024-09-22T01:38:44.627187+0000","last_deep_scrub":"223'625","last_deep_scrub_stamp":"2024-09-22T01:38:44.627187+0000","last_clean_scrub_stamp":"2024-09-22T01:38:44.627187+0000","objects_scrubbed":5,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:02:18.604877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0014576910000000001,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":5589,"num_read_kb":37802,"num_write":624,"num_write_kb":11232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":7755614,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:45.578352+0000","last_change":"2024-09-22T01:38:45.578404+0000","last_active":"2024-09-22T01:38:45.578352+0000","last_peered":"2024-09-22T01:38:45.578352+0000","last_clean":"2024-09-22T01:38:45.578352+0000","last_became_active":"2024-09-22T01:38:22.617578+0000","last_became_peered":"2024-09-22T01:38:22.617578+0000","last_unstale":"2024-09-22T01:38:45.578352+0000","last_undegraded":"2024-09-22T01:38:45.578352+0000","last_fullsized":"2024-09-22T01:38:45.578352+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:38:45.578167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:38:45.578167+0000","last_clean_scrub_stamp":"2024-09-22T01:38:45.578167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:55:44.846118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"223'518","reported_seq":8234,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:45.600288+0000","last_change":"2024-09-22T01:38:45.600357+0000","last_active":"2024-09-22T01:38:45.600288+0000","last_peered":"2024-09-22T01:38:45.600288+0000","last_clean":"2024-09-22T01:38:45.600288+0000","last_became_active":"2024-09-22T01:37:17.670568+0000","last_became_peered":"2024-09-22T01:37:17.670568+0000","last_unstale":"2024-09-22T01:38:45.600288+0000","last_undegraded":"2024-09-22T01:38:45.600288+0000","last_fullsized":"2024-09-22T01:38:45.600288+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'518","last_scrub_stamp":"2024-09-22T01:38:45.600114+0000","last_deep_scrub":"223'518","last_deep_scrub_stamp":"2024-09-22T01:38:45.600114+0000","last_clean_scrub_stamp":"2024-09-22T01:38:45.600114+0000","objects_scrubbed":4,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:47:07.119104+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0036439129999999999,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":8480,"num_read_kb":54220,"num_write":523,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":20868139,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"223'440","reported_seq":1842,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:44.262321+0000","last_change":"2024-09-22T01:38:44.262405+0000","last_active":"2024-09-22T01:38:44.262321+0000","last_peered":"2024-09-22T01:38:44.262321+0000","last_clean":"2024-09-22T01:38:44.262321+0000","last_became_active":"2024-09-22T01:36:07.624038+0000","last_became_peered":"2024-09-22T01:36:07.624038+0000","last_unstale":"2024-09-22T01:38:44.262321+0000","last_undegraded":"2024-09-22T01:38:44.262321+0000","last_fullsized":"2024-09-22T01:38:44.262321+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'440","last_scrub_stamp":"2024-09-22T01:38:44.262108+0000","last_deep_scrub":"223'440","last_deep_scrub_stamp":"2024-09-22T01:38:44.262108+0000","last_clean_scrub_stamp":"2024-09-22T01:38:44.262108+0000","objects_scrubbed":9,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:24:48.672721+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.002825424,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":8,"num_read":1512,"num_read_kb":6460,"num_write":402,"num_write_kb":3582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8160520,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"223'3","reported_seq":182,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:43.555155+0000","last_change":"2024-09-22T01:38:43.555311+0000","last_active":"2024-09-22T01:38:43.555155+0000","last_peered":"2024-09-22T01:38:43.555155+0000","last_clean":"2024-09-22T01:38:43.555155+0000","last_became_active":"2024-09-22T01:37:13.533597+0000","last_became_peered":"2024-09-22T01:37:13.533597+0000","last_unstale":"2024-09-22T01:38:43.555155+0000","last_undegraded":"2024-09-22T01:38:43.555155+0000","last_fullsized":"2024-09-22T01:38:43.555155+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'3","last_scrub_stamp":"2024-09-22T01:38:43.554864+0000","last_deep_scrub":"223'3","last_deep_scrub_stamp":"2024-09-22T01:38:43.554864+0000","last_clean_scrub_stamp":"2024-09-22T01:38:43.554864+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:07:01.279563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"223'522","reported_seq":4494,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:43.599273+0000","last_change":"2024-09-22T01:38:43.599318+0000","last_active":"2024-09-22T01:38:43.599273+0000","last_peered":"2024-09-22T01:38:43.599273+0000","last_clean":"2024-09-22T01:38:43.599273+0000","last_became_active":"2024-09-22T01:38:21.557572+0000","last_became_peered":"2024-09-22T01:38:21.557572+0000","last_unstale":"2024-09-22T01:38:43.599273+0000","last_undegraded":"2024-09-22T01:38:43.599273+0000","last_fullsized":"2024-09-22T01:38:43.599273+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'522","last_scrub_stamp":"2024-09-22T01:38:43.599159+0000","last_deep_scrub":"223'522","last_deep_scrub_stamp":"2024-09-22T01:38:43.599159+0000","last_clean_scrub_stamp":"2024-09-22T01:38:43.599159+0000","objects_scrubbed":4,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:43:36.744899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001437699,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":4350,"num_read_kb":14870,"num_write":524,"num_write_kb":23558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":273,"num_bytes_recovered":1755819,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:42.606373+0000","last_change":"2024-09-22T01:38:42.606429+0000","last_active":"2024-09-22T01:38:42.606373+0000","last_peered":"2024-09-22T01:38:42.606373+0000","last_clean":"2024-09-22T01:38:42.606373+0000","last_became_active":"2024-09-22T01:38:18.600600+0000","last_became_peered":"2024-09-22T01:38:18.600600+0000","last_unstale":"2024-09-22T01:38:42.606373+0000","last_undegraded":"2024-09-22T01:38:42.606373+0000","last_fullsized":"2024-09-22T01:38:42.606373+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:38:42.606177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:38:42.606177+0000","last_clean_scrub_stamp":"2024-09-22T01:38:42.606177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:48:00.838312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"223'568","reported_seq":5322,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:41.966473+0000","last_change":"2024-09-22T01:38:41.966530+0000","last_active":"2024-09-22T01:38:41.966473+0000","last_peered":"2024-09-22T01:38:41.966473+0000","last_clean":"2024-09-22T01:38:41.966473+0000","last_became_active":"2024-09-22T01:37:53.571926+0000","last_became_peered":"2024-09-22T01:37:53.571926+0000","last_unstale":"2024-09-22T01:38:41.966473+0000","last_undegraded":"2024-09-22T01:38:41.966473+0000","last_fullsized":"2024-09-22T01:38:41.966473+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'568","last_scrub_stamp":"2024-09-22T01:38:41.966368+0000","last_deep_scrub":"223'568","last_deep_scrub_stamp":"2024-09-22T01:38:41.966368+0000","last_clean_scrub_stamp":"2024-09-22T01:38:41.966368+0000","objects_scrubbed":10,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T04:42:03.549368+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.002041817,"stat_sum":{"num_bytes":0,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":10,"num_read":5042,"num_read_kb":25966,"num_write":576,"num_write_kb":13032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":485,"num_bytes_recovered":21536753,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":316,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:44.902617+0000","last_change":"2024-09-22T01:38:44.902673+0000","last_active":"2024-09-22T01:38:44.902617+0000","last_peered":"2024-09-22T01:38:44.902617+0000","last_clean":"2024-09-22T01:38:44.902617+0000","last_became_active":"2024-09-22T01:35:57.529008+0000","last_became_peered":"2024-09-22T01:35:57.529008+0000","last_unstale":"2024-09-22T01:38:44.902617+0000","last_undegraded":"2024-09-22T01:38:44.902617+0000","last_fullsized":"2024-09-22T01:38:44.902617+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T01:38:44.902414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T01:38:44.902414+0000","last_clean_scrub_stamp":"2024-09-22T01:38:44.902414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:43:02.964516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"223'468","reported_seq":2801,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:45.726909+0000","last_change":"2024-09-22T01:38:45.726909+0000","last_active":"2024-09-22T01:38:45.726909+0000","last_peered":"2024-09-22T01:38:45.726909+0000","last_clean":"2024-09-22T01:38:45.726909+0000","last_became_active":"2024-09-22T01:37:16.655284+0000","last_became_peered":"2024-09-22T01:37:16.655284+0000","last_unstale":"2024-09-22T01:38:45.726909+0000","last_undegraded":"2024-09-22T01:38:45.726909+0000","last_fullsized":"2024-09-22T01:38:45.726909+0000","mapping_epoch":145,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":146,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'468","last_scrub_stamp":"2024-09-22T01:38:45.726647+0000","last_deep_scrub":"223'468","last_deep_scrub_stamp":"2024-09-22T01:38:45.726647+0000","last_clean_scrub_stamp":"2024-09-22T01:38:45.726647+0000","objects_scrubbed":6,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:34:30.034227+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0011708179999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2672,"num_read_kb":16190,"num_write":487,"num_write_kb":8311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":9478630,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"223'2","reported_seq":200,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:49.558113+0000","last_change":"2024-09-22T01:38:49.558184+0000","last_active":"2024-09-22T01:38:49.558113+0000","last_peered":"2024-09-22T01:38:49.558113+0000","last_clean":"2024-09-22T01:38:49.558113+0000","last_became_active":"2024-09-22T01:38:18.549611+0000","last_became_peered":"2024-09-22T01:38:18.549611+0000","last_unstale":"2024-09-22T01:38:49.558113+0000","last_undegraded":"2024-09-22T01:38:49.558113+0000","last_fullsized":"2024-09-22T01:38:49.558113+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'2","last_scrub_stamp":"2024-09-22T01:38:49.557909+0000","last_deep_scrub":"223'2","last_deep_scrub_stamp":"2024-09-22T01:38:49.557909+0000","last_clean_scrub_stamp":"2024-09-22T01:38:49.557909+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:16:09.415910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001225304,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"223'119","reported_seq":566,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:48.932752+0000","last_change":"2024-09-22T01:38:48.932830+0000","last_active":"2024-09-22T01:38:48.932752+0000","last_peered":"2024-09-22T01:38:48.932752+0000","last_clean":"2024-09-22T01:38:48.932752+0000","last_became_active":"2024-09-22T01:36:06.619630+0000","last_became_peered":"2024-09-22T01:36:06.619630+0000","last_unstale":"2024-09-22T01:38:48.932752+0000","last_undegraded":"2024-09-22T01:38:48.932752+0000","last_fullsized":"2024-09-22T01:38:48.932752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'119","last_scrub_stamp":"2024-09-22T01:38:48.932567+0000","last_deep_scrub":"223'119","last_deep_scrub_stamp":"2024-09-22T01:38:48.932567+0000","last_clean_scrub_stamp":"2024-09-22T01:38:48.932567+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T10:45:25.690700+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"223'713","reported_seq":2768,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:44.685380+0000","last_change":"2024-09-22T01:38:44.685380+0000","last_active":"2024-09-22T01:38:44.685380+0000","last_peered":"2024-09-22T01:38:44.685380+0000","last_clean":"2024-09-22T01:38:44.685380+0000","last_became_active":"2024-09-22T01:36:36.822850+0000","last_became_peered":"2024-09-22T01:36:36.822850+0000","last_unstale":"2024-09-22T01:38:44.685380+0000","last_undegraded":"2024-09-22T01:38:44.685380+0000","last_fullsized":"2024-09-22T01:38:44.685380+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'713","last_scrub_stamp":"2024-09-22T01:38:44.685094+0000","last_deep_scrub":"223'713","last_deep_scrub_stamp":"2024-09-22T01:38:44.685094+0000","last_clean_scrub_stamp":"2024-09-22T01:38:44.685094+0000","objects_scrubbed":3,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:56:40.287204+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0019014889999999999,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":3,"num_read":7238,"num_read_kb":52542,"num_write":881,"num_write_kb":26324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":24610743,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"223'460","reported_seq":6094,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:45.652247+0000","last_change":"2024-09-22T01:38:45.652428+0000","last_active":"2024-09-22T01:38:45.652247+0000","last_peered":"2024-09-22T01:38:45.652247+0000","last_clean":"2024-09-22T01:38:45.652247+0000","last_became_active":"2024-09-22T01:38:21.558253+0000","last_became_peered":"2024-09-22T01:38:21.558253+0000","last_unstale":"2024-09-22T01:38:45.652247+0000","last_undegraded":"2024-09-22T01:38:45.652247+0000","last_fullsized":"2024-09-22T01:38:45.652247+0000","mapping_epoch":209,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":210,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'460","last_scrub_stamp":"2024-09-22T01:38:45.652034+0000","last_deep_scrub":"223'460","last_deep_scrub_stamp":"2024-09-22T01:38:45.652034+0000","last_clean_scrub_stamp":"2024-09-22T01:38:45.652034+0000","objects_scrubbed":1,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:03:26.770507+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.001663412,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4390,"num_read_kb":53937,"num_write":461,"num_write_kb":17688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":594,"num_bytes_recovered":4389160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"223'641","reported_seq":14830,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:46.237545+0000","last_change":"2024-09-22T01:38:46.237617+0000","last_active":"2024-09-22T01:38:46.237545+0000","last_peered":"2024-09-22T01:38:46.237545+0000","last_clean":"2024-09-22T01:38:46.237545+0000","last_became_active":"2024-09-22T01:37:53.540222+0000","last_became_peered":"2024-09-22T01:37:53.540222+0000","last_unstale":"2024-09-22T01:38:46.237545+0000","last_undegraded":"2024-09-22T01:38:46.237545+0000","last_fullsized":"2024-09-22T01:38:46.237545+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'641","last_scrub_stamp":"2024-09-22T01:38:46.237360+0000","last_deep_scrub":"223'641","last_deep_scrub_stamp":"2024-09-22T01:38:46.237360+0000","last_clean_scrub_stamp":"2024-09-22T01:38:46.237360+0000","objects_scrubbed":6,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:36:05.873025+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.003616101,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":5,"num_read":15637,"num_read_kb":20649,"num_write":595,"num_write_kb":18769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":2278048,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"223'449","reported_seq":3523,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:47.780218+0000","last_change":"2024-09-22T01:38:47.780307+0000","last_active":"2024-09-22T01:38:47.780218+0000","last_peered":"2024-09-22T01:38:47.780218+0000","last_clean":"2024-09-22T01:38:47.780218+0000","last_became_active":"2024-09-22T01:38:09.556931+0000","last_became_peered":"2024-09-22T01:38:09.556931+0000","last_unstale":"2024-09-22T01:38:47.780218+0000","last_undegraded":"2024-09-22T01:38:47.780218+0000","last_fullsized":"2024-09-22T01:38:47.780218+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'449","last_scrub_stamp":"2024-09-22T01:38:47.780020+0000","last_deep_scrub":"223'449","last_deep_scrub_stamp":"2024-09-22T01:38:47.780020+0000","last_clean_scrub_stamp":"2024-09-22T01:38:47.780020+0000","objects_scrubbed":6,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T08:47:17.992238+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0027549219999999999,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":2831,"num_read_kb":14353,"num_write":499,"num_write_kb":9050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":203,"num_bytes_recovered":11719816,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"223'574","reported_seq":6054,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:46.559800+0000","last_change":"2024-09-22T01:38:46.559882+0000","last_active":"2024-09-22T01:38:46.559800+0000","last_peered":"2024-09-22T01:38:46.559800+0000","last_clean":"2024-09-22T01:38:46.559800+0000","last_became_active":"2024-09-22T01:37:18.541146+0000","last_became_peered":"2024-09-22T01:37:18.541146+0000","last_unstale":"2024-09-22T01:38:46.559800+0000","last_undegraded":"2024-09-22T01:38:46.559800+0000","last_fullsized":"2024-09-22T01:38:46.559800+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'574","last_scrub_stamp":"2024-09-22T01:38:46.559623+0000","last_deep_scrub":"223'574","last_deep_scrub_stamp":"2024-09-22T01:38:46.559623+0000","last_clean_scrub_stamp":"2024-09-22T01:38:46.559623+0000","objects_scrubbed":7,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T13:22:48.225392+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0.00095552699999999996,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":6990,"num_read_kb":34807,"num_write":525,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":23746490,"num_keys_recovered":45,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"223'506","reported_seq":5036,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:49.975067+0000","last_change":"2024-09-22T01:38:49.975143+0000","last_active":"2024-09-22T01:38:49.975067+0000","last_peered":"2024-09-22T01:38:49.975067+0000","last_clean":"2024-09-22T01:38:49.975067+0000","last_became_active":"2024-09-22T01:37:18.535327+0000","last_became_peered":"2024-09-22T01:37:18.535327+0000","last_unstale":"2024-09-22T01:38:49.975067+0000","last_undegraded":"2024-09-22T01:38:49.975067+0000","last_fullsized":"2024-09-22T01:38:49.975067+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'506","last_scrub_stamp":"2024-09-22T01:38:49.974882+0000","last_deep_scrub":"223'506","last_deep_scrub_stamp":"2024-09-22T01:38:49.974882+0000","last_clean_scrub_stamp":"2024-09-22T01:38:49.974882+0000","objects_scrubbed":2,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T07:03:18.204257+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0043325960000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5598,"num_read_kb":19917,"num_write":545,"num_write_kb":16495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":270,"num_bytes_recovered":15399206,"num_keys_recovered":72,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"223'725","reported_seq":4675,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:50.969877+0000","last_change":"2024-09-22T01:38:50.969954+0000","last_active":"2024-09-22T01:38:50.969877+0000","last_peered":"2024-09-22T01:38:50.969877+0000","last_clean":"2024-09-22T01:38:50.969877+0000","last_became_active":"2024-09-22T01:37:52.551465+0000","last_became_peered":"2024-09-22T01:37:52.551465+0000","last_unstale":"2024-09-22T01:38:50.969877+0000","last_undegraded":"2024-09-22T01:38:50.969877+0000","last_fullsized":"2024-09-22T01:38:50.969877+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'725","last_scrub_stamp":"2024-09-22T01:38:50.969687+0000","last_deep_scrub":"223'725","last_deep_scrub_stamp":"2024-09-22T01:38:50.969687+0000","last_clean_scrub_stamp":"2024-09-22T01:38:50.969687+0000","objects_scrubbed":6,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T11:00:30.972247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0.003391972,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":6,"num_read":4576,"num_read_kb":18630,"num_write":892,"num_write_kb":13182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":8508934,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"223'721","reported_seq":3689,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:46.985967+0000","last_change":"2024-09-22T01:38:46.986029+0000","last_active":"2024-09-22T01:38:46.985967+0000","last_peered":"2024-09-22T01:38:46.985967+0000","last_clean":"2024-09-22T01:38:46.985967+0000","last_became_active":"2024-09-22T01:36:01.566605+0000","last_became_peered":"2024-09-22T01:36:01.566605+0000","last_unstale":"2024-09-22T01:38:46.985967+0000","last_undegraded":"2024-09-22T01:38:46.985967+0000","last_fullsized":"2024-09-22T01:38:46.985967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'721","last_scrub_stamp":"2024-09-22T01:38:46.985779+0000","last_deep_scrub":"223'721","last_deep_scrub_stamp":"2024-09-22T01:38:46.985779+0000","last_clean_scrub_stamp":"2024-09-22T01:38:46.985779+0000","objects_scrubbed":2,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T02:59:05.929649+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0053104090000000003,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":5534,"num_read_kb":24700,"num_write":880,"num_write_kb":20860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":39,"num_bytes_recovered":11830604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"223'721","reported_seq":3420,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:47.217187+0000","last_change":"2024-09-22T01:38:47.217281+0000","last_active":"2024-09-22T01:38:47.217187+0000","last_peered":"2024-09-22T01:38:47.217187+0000","last_clean":"2024-09-22T01:38:47.217187+0000","last_became_active":"2024-09-22T01:37:55.549740+0000","last_became_peered":"2024-09-22T01:37:55.549740+0000","last_unstale":"2024-09-22T01:38:47.217187+0000","last_undegraded":"2024-09-22T01:38:47.217187+0000","last_fullsized":"2024-09-22T01:38:47.217187+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'721","last_scrub_stamp":"2024-09-22T01:38:47.216987+0000","last_deep_scrub":"223'721","last_deep_scrub_stamp":"2024-09-22T01:38:47.216987+0000","last_clean_scrub_stamp":"2024-09-22T01:38:47.216987+0000","objects_scrubbed":7,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T09:19:29.492012+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0.0034685710000000002,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4516,"num_read_kb":14551,"num_write":804,"num_write_kb":16271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":276,"num_bytes_recovered":7558660,"num_keys_recovered":94,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"223'398","reported_seq":5821,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:52.933240+0000","last_change":"2024-09-22T01:38:52.933326+0000","last_active":"2024-09-22T01:38:52.933240+0000","last_peered":"2024-09-22T01:38:52.933240+0000","last_clean":"2024-09-22T01:38:52.933240+0000","last_became_active":"2024-09-22T01:38:34.906641+0000","last_became_peered":"2024-09-22T01:38:34.906641+0000","last_unstale":"2024-09-22T01:38:52.933240+0000","last_undegraded":"2024-09-22T01:38:52.933240+0000","last_fullsized":"2024-09-22T01:38:52.933240+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'398","last_scrub_stamp":"2024-09-22T01:38:52.933039+0000","last_deep_scrub":"223'398","last_deep_scrub_stamp":"2024-09-22T01:38:52.933039+0000","last_clean_scrub_stamp":"2024-09-22T01:38:52.933039+0000","objects_scrubbed":7,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T05:08:44.986229+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0.00081673900000000003,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":7,"num_read":4801,"num_read_kb":46850,"num_write":333,"num_write_kb":23779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":5376150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"223'492","reported_seq":5333,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:42.916716+0000","last_change":"2024-09-22T01:38:42.916742+0000","last_active":"2024-09-22T01:38:42.916716+0000","last_peered":"2024-09-22T01:38:42.916716+0000","last_clean":"2024-09-22T01:38:42.916716+0000","last_became_active":"2024-09-22T01:37:54.552738+0000","last_became_peered":"2024-09-22T01:37:54.552738+0000","last_unstale":"2024-09-22T01:38:42.916716+0000","last_undegraded":"2024-09-22T01:38:42.916716+0000","last_fullsized":"2024-09-22T01:38:42.916716+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'492","last_scrub_stamp":"2024-09-22T01:38:42.916658+0000","last_deep_scrub":"223'492","last_deep_scrub_stamp":"2024-09-22T01:38:42.916658+0000","last_clean_scrub_stamp":"2024-09-22T01:38:42.916658+0000","objects_scrubbed":4,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T12:24:06.020923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0012133160000000001,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":4,"num_read":5061,"num_read_kb":18985,"num_write":533,"num_write_kb":10276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":299,"num_bytes_recovered":8748779,"num_keys_recovered":66,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"223'657","reported_seq":11558,"reported_epoch":223,"state":"active+clean","last_fresh":"2024-09-22T01:38:51.971097+0000","last_change":"2024-09-22T01:38:51.971175+0000","last_active":"2024-09-22T01:38:51.971097+0000","last_peered":"2024-09-22T01:38:51.971097+0000","last_clean":"2024-09-22T01:38:51.971097+0000","last_became_active":"2024-09-22T01:37:53.541188+0000","last_became_peered":"2024-09-22T01:37:53.541188+0000","last_unstale":"2024-09-22T01:38:51.971097+0000","last_undegraded":"2024-09-22T01:38:51.971097+0000","last_fullsized":"2024-09-22T01:38:51.971097+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"223'657","last_scrub_stamp":"2024-09-22T01:38:51.970911+0000","last_deep_scrub":"223'657","last_deep_scrub_stamp":"2024-09-22T01:38:51.970911+0000","last_clean_scrub_stamp":"2024-09-22T01:38:51.970911+0000","objects_scrubbed":5,"log_size":657,"log_dups_size":0,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T03:48:41.588128+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0.0064999480000000002,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":5,"num_read":12287,"num_read_kb":47236,"num_write":568,"num_write_kb":13755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":329,"num_bytes_recovered":11479448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":162,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":158,"num_read":199037,"num_read_kb":1036514,"num_write":21389,"num_write_kb":541533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7692,"num_bytes_recovered":422659173,"num_keys_recovered":1090,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19250,"ondisk_log_size":19250,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48288,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323552,"statfs":{"total":96636764160,"available":96587317248,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33820,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338020,"statfs":{"total":96636764160,"available":96602132480,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60192,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311648,"statfs":{"total":96636764160,"available":96575127552,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74080,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94297760,"statfs":{"total":96636764160,"available":96560906240,"internally_reserved":0,"allocated":2703360,"data_stored":1310716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47708,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324132,"statfs":{"total":96636764160,"available":96587911168,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37980,"kb_used_data":2636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333860,"statfs":{"total":96636764160,"available":96597872640,"internally_reserved":0,"allocated":2699264,"data_stored":1310697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60196,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311644,"statfs":{"total":96636764160,"available":96575123456,"internally_reserved":0,"allocated":2707456,"data_stored":1310735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52448,"kb_used_data":3216,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319392,"statfs":{"total":96636764160,"available":96583057408,"internally_reserved":0,"allocated":3293184,"data_stored":1901065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T01:39:04.806 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-22T01:39:05.136 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-22T01:39:05.136 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-22T01:39:05.136 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-22T01:39:05.137 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:05.235 INFO:tasks.ceph.osd.0:Stopped 2024-09-22T01:39:05.235 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-22T01:39:05.235 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:05.327 INFO:tasks.ceph.osd.1:Stopped 2024-09-22T01:39:05.327 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-22T01:39:05.327 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:05.414 INFO:tasks.ceph.osd.2:Stopped 2024-09-22T01:39:05.414 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-22T01:39:05.414 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:05.505 INFO:tasks.ceph.osd.3:Stopped 2024-09-22T01:39:05.506 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-22T01:39:05.506 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:05.601 INFO:tasks.ceph.osd.4:Stopped 2024-09-22T01:39:05.601 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-22T01:39:05.601 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:07.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-22T01:39:11.703 INFO:tasks.ceph.osd.5:Stopped 2024-09-22T01:39:11.703 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-22T01:39:11.704 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:11.764 INFO:tasks.ceph.osd.6:Stopped 2024-09-22T01:39:11.764 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-22T01:39:11.764 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:13.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-22T01:39:13.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-22T01:39:17.866 INFO:tasks.ceph.osd.7:Stopped 2024-09-22T01:39:17.866 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-22T01:39:17.867 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-22T01:39:17.867 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:17.902 INFO:tasks.ceph.mgr.y:Stopped 2024-09-22T01:39:17.902 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-22T01:39:17.903 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:17.933 INFO:tasks.ceph.mgr.x:Stopped 2024-09-22T01:39:17.933 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-22T01:39:17.934 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-22T01:39:17.934 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:17.961 INFO:tasks.ceph.mon.a:Stopped 2024-09-22T01:39:17.961 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-22T01:39:17.961 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:18.024 INFO:tasks.ceph.mon.c:Stopped 2024-09-22T01:39:18.024 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-22T01:39:18.024 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T01:39:18.048 INFO:tasks.ceph.mon.b:Stopped 2024-09-22T01:39:18.048 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-22T01:39:18.048 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-22T01:39:18.087 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:39:18.087 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-22T01:39:18.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-22T01:39:18.371 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:39:18.371 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-22T01:39:18.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:39:18.550 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-22T01:39:18.707 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:39:18.707 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-22T01:39:18.849 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:39:18.849 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-22T01:39:19.022 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:39:19.023 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-22T01:39:19.179 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:39:19.179 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-22T01:39:19.343 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:39:19.343 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-22T01:39:19.496 INFO:tasks.ceph:Archiving mon data... 2024-09-22T01:39:19.497 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619/data/mon.a.tgz 2024-09-22T01:39:19.497 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-22T01:39:19.504 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.ZeWJhh0NHV 2024-09-22T01:39:19.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZeWJhh0NHV 2024-09-22T01:39:19.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.ZeWJhh0NHV 2024-09-22T01:39:19.741 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.ZeWJhh0NHV is 464KB 2024-09-22T01:39:19.802 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.ZeWJhh0NHV 2024-09-22T01:39:19.807 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619/data/mon.c.tgz 2024-09-22T01:39:19.807 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-22T01:39:19.856 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.FU2zvyus90 2024-09-22T01:39:19.857 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.FU2zvyus90 2024-09-22T01:39:20.065 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.FU2zvyus90 2024-09-22T01:39:20.128 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.FU2zvyus90 is 641KB 2024-09-22T01:39:20.189 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.FU2zvyus90 2024-09-22T01:39:20.195 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619/data/mon.b.tgz 2024-09-22T01:39:20.195 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-09-22T01:39:20.201 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.lZFyfsS6gV 2024-09-22T01:39:20.201 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.lZFyfsS6gV 2024-09-22T01:39:20.401 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.lZFyfsS6gV 2024-09-22T01:39:20.462 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.lZFyfsS6gV is 641KB 2024-09-22T01:39:20.483 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.lZFyfsS6gV 2024-09-22T01:39:20.488 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-22T01:39:20.488 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T01:39:20.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T01:39:20.553 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T01:39:20.594 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T01:39:20.594 INFO:tasks.ceph:Archiving crash dumps... 2024-09-22T01:39:20.596 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619/remote/smithi018/crash 2024-09-22T01:39:20.597 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T01:39:20.611 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619/remote/smithi179/crash 2024-09-22T01:39:20.612 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T01:39:20.650 INFO:tasks.ceph:Compressing logs... 2024-09-22T01:39:20.650 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T01:39:20.657 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T01:39:20.677 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39153.log 2024-09-22T01:39:20.678 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37719.log 2024-09-22T01:39:20.678 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38862.log 2024-09-22T01:39:20.679 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39153.log.gz 2024-09-22T01:39:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37719.log.gz 2024-09-22T01:39:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42078.log 2024-09-22T01:39:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41645.log 2024-09-22T01:39:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38862.log: /var/log/ceph/ceph-client.admin.42078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39674.log 2024-09-22T01:39:20.681 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38862.log.gz 2024-09-22T01:39:20.681 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42078.log.gz 2024-09-22T01:39:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42990.log 2024-09-22T01:39:20.681 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41645.log.gz 2024-09-22T01:39:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39674.log.gz 2024-09-22T01:39:20.681 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39460.log 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41828.log 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42990.log.gz 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31956.log 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39460.log.gz 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33965.log 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41828.log.gz 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38799.log 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31956.log.gz 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33965.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33965.log.gz 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31550.log 2024-09-22T01:39:20.684 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38799.log.gz 2024-09-22T01:39:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31767.log 2024-09-22T01:39:20.685 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36573.log 2024-09-22T01:39:20.685 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31550.log.gz 2024-09-22T01:39:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34871.log 2024-09-22T01:39:20.687 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31767.log.gz 2024-09-22T01:39:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41158.log 0.0% 2024-09-22T01:39:20.687 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36573.log.gz 2024-09-22T01:39:20.687 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38680.log 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34871.log.gz 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32392.log 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41158.log.gz 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38680.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.33013.log 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38680.log.gz 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43508.log 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32392.log.gz 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42104.log 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33013.log.gz 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41313.log 2024-09-22T01:39:20.688 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43508.log.gz 2024-09-22T01:39:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39537.log 2024-09-22T01:39:20.691 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42104.log.gz 2024-09-22T01:39:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42573.log 2024-09-22T01:39:20.691 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41313.log.gz 2024-09-22T01:39:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39537.log.gz 2024-09-22T01:39:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32947.log 2024-09-22T01:39:20.691 INFO:teuthology.orchestra.run.smithi018.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-22T01:39:20.691 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35208.log 2024-09-22T01:39:20.691 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42573.log.gz 2024-09-22T01:39:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40256.log 2024-09-22T01:39:20.692 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32947.log.gz 2024-09-22T01:39:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35208.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-22T01:39:20.692 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35208.log.gz 2024-09-22T01:39:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41279.log 2024-09-22T01:39:20.692 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40256.log.gz 2024-09-22T01:39:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42260.log 2024-09-22T01:39:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33652.log 2024-09-22T01:39:20.692 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41279.log.gz 2024-09-22T01:39:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41200.log 2024-09-22T01:39:20.696 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42260.log.gz 2024-09-22T01:39:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36260.log 2024-09-22T01:39:20.696 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33652.log.gz 2024-09-22T01:39:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33204.log 2024-09-22T01:39:20.696 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41200.log.gz 2024-09-22T01:39:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40963.log 2024-09-22T01:39:20.696 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36260.log.gz 2024-09-22T01:39:20.696 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32821.log 2024-09-22T01:39:20.696 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33204.log.gz 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34270.log 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40963.log.gz 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32821.log.gz 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40748.log 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34270.log.gz 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40313.log 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37108.log 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40748.log.gz 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41995.log 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40313.log.gz 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43768.log 2024-09-22T01:39:20.697 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37108.log.gz 2024-09-22T01:39:20.703 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36286.log 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41995.log.gz 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40105.log 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43768.log.gz 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38201.log 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36286.log.gz 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39866.log 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40105.log.gz 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35179.log 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38201.log.gz 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38887.log 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39866.log.gz 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41786.log 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35179.log.gz 2024-09-22T01:39:20.704 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41887.log 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38887.log.gz 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43248.log 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41786.log.gz 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33333.log 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41887.log.gz 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43248.log.gz 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33838.log 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37992.log 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33333.log.gz 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39371.log 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33838.log.gz 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43352.log 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37992.log.gz 2024-09-22T01:39:20.705 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34225.log 2024-09-22T01:39:20.706 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39371.log.gz 2024-09-22T01:39:20.706 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43352.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43352.log.gz -5 2024-09-22T01:39:20.706 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32789.log 2024-09-22T01:39:20.706 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36347.log 2024-09-22T01:39:20.706 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34225.log.gz 2024-09-22T01:39:20.706 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32789.log.gz 2024-09-22T01:39:20.706 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42987.log 2024-09-22T01:39:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38304.log 2024-09-22T01:39:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36347.log.gz 2024-09-22T01:39:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36381.log 2024-09-22T01:39:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42987.log.gz 2024-09-22T01:39:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38304.log.gz 2024-09-22T01:39:20.712 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39631.log 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42047.log 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36381.log.gz 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39631.log.gz 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42047.log.gz 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38044.log 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32727.log 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38044.log.gz 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42774.log 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40854.log/var/log/ceph/ceph-client.admin.32727.log: 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32727.log.gz 2024-09-22T01:39:20.713 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42774.log.gz 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39778.log 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36442.log 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40854.log.gz 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39778.log.gz 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31983.log 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36442.log.gz 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40398.log 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31983.log.gz 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41598.log 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40398.log.gz 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38419.log 2024-09-22T01:39:20.714 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38337.log 2024-09-22T01:39:20.715 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41598.log.gz/var/log/ceph/ceph-client.admin.38419.log: 2024-09-22T01:39:20.715 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38419.log.gz 2024-09-22T01:39:20.715 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42974.log 2024-09-22T01:39:20.715 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42754.log 2024-09-22T01:39:20.715 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38337.log: /var/log/ceph/ceph-client.admin.42974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38337.log.gz 2024-09-22T01:39:20.715 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42974.log.gz 2024-09-22T01:39:20.715 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33270.log 2024-09-22T01:39:20.731 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26506.log 2024-09-22T01:39:20.731 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-22T01:39:20.731 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.26506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26602.log 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26506.log.gz 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26578.log 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.26602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26602.log.gz 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26554.log 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.26578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26482.log 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26578.log.gz 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.26554.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26554.log.gz 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.26482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26482.log.gz 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26530.log 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-22T01:39:20.732 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.26530.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.26530.log.gz -5 2024-09-22T01:39:20.733 INFO:teuthology.orchestra.run.smithi179.stderr: --verbose -- /var/log/ceph/ceph.log 2024-09-22T01:39:20.733 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26458.log 2024-09-22T01:39:20.733 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26434.log 2024-09-22T01:39:20.733 INFO:teuthology.orchestra.run.smithi179.stderr:gzip/var/log/ceph/ceph-client.admin.26458.log: -5 --verbose 0.0% -- /var/log/ceph/ceph.audit.log 2024-09-22T01:39:20.733 INFO:teuthology.orchestra.run.smithi179.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26458.log.gz 2024-09-22T01:39:20.733 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.26434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26434.log.gz 2024-09-22T01:39:20.733 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-22T01:39:20.733 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-22T01:39:20.734 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T01:39:20.734 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T01:39:20.747 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34574.log 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42754.log.gz 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41541.log 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33270.log.gz 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34574.log.gz 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42782.log 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37836.log 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41541.log.gz 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42782.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42782.log.gz -5 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39581.log 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37836.log.gz 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42772.log 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42760.log 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39581.log.gz 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42772.log.gz 2024-09-22T01:39:20.748 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31965.log 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39252.log 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42760.log.gz 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31965.log.gz 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34465.log 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38126.log 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39252.log.gz 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34465.log.gz 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42364.log 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42494.log 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38126.log.gz 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42364.log.gz 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42021.log 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37947.log 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42494.log.gz 2024-09-22T01:39:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42021.log.gz 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31972.log 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37947.log.gz 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42234.log 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31565.log 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31972.log.gz 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42234.log.gzgzip 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42570.log 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31565.log.gz 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34094.log 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31462.log 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42570.log: /var/log/ceph/ceph-client.admin.34094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42570.log.gz 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34094.log.gz 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40959.log 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41341.log 2024-09-22T01:39:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31462.log.gz 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31566.log 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40959.log.gz 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41341.log.gz 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43716.log 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34507.log 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31566.log.gz 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43716.log.gz 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38018.log 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37394.log 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34507.log.gz 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38018.log.gz 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43274.log 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31971.log 2024-09-22T01:39:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37394.log.gz 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40572.log 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43274.log.gz 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31971.log.gz 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40576.log 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40741.log 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40572.log.gz 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40576.log.gz 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31488.log 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38263.log 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40741.log.gz 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32543.log 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31488.log.gz 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38263.log.gz 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36820.log 2024-09-22T01:39:20.752 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.32543.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39000.log 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32543.log.gz 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36820.log.gz 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36955.log 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39000.log.gz 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30870.log 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36955.log.gz 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31568.log 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37182.log 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.30870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30870.log.gz 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31568.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.31568.log.gz -5 2024-09-22T01:39:20.753 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40749.log 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37182.log.gz 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37029.log 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41049.log 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40749.log: /var/log/ceph/ceph-client.admin.37029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40749.log.gz 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33095.log 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37029.log.gz 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41049.log.gz 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42773.log 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35660.log 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33095.log.gz 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42773.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42773.log.gz -5 2024-09-22T01:39:20.754 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35557.log 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35660.log.gz 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33598.log 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36714.log 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35557.log.gz 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31765.log 0.0% 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33598.log.gz 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36714.log.gz 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43742.log 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43818.log 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31765.log.gz 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43742.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43742.log.gz 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.43196.log 2024-09-22T01:39:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43818.log.gz 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32584.log 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43196.log.gz 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33905.log 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32584.log.gz 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34689.log 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40534.log 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33905.log.gz 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43560.log 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34689.log.gz 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40534.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40534.log.gz -5 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42156.log 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33434.log 2024-09-22T01:39:20.756 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43560.log.gz 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38634.log 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42156.log.gz 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33434.log.gz 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42338.log 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.38634.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43456.log 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38634.log.gz 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39833.log 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42338.log.gz 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43456.log.gz 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42565.log 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43534.log 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39833.log.gz 2024-09-22T01:39:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36476.log 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42565.log.gz 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40006.log 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43534.log.gz 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31554.log 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36476.log.gz 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38512.log 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40006.log.gz 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43170.log 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31554.log.gz 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21401.log 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38512.log.gz 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34716.log 2024-09-22T01:39:20.758 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43170.log.gz 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.tmp-client.admin.21401.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21401.log.gz 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36862.log 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32909.log/var/log/ceph/ceph-client.admin.34716.log: 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34716.log.gz 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35391.log 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36862.log.gz 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32909.log.gz 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37299.log 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31442.log 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35391.log.gz 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43404.log 2024-09-22T01:39:20.759 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37299.log.gz 2024-09-22T01:39:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31442.log.gz 2024-09-22T01:39:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33748.log 2024-09-22T01:39:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-22T01:39:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43404.log.gz 2024-09-22T01:39:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40204.log 2024-09-22T01:39:20.779 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33748.log.gz 2024-09-22T01:39:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41108.log 2024-09-22T01:39:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38721.log 2024-09-22T01:39:20.779 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40204.log.gz 2024-09-22T01:39:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41108.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41108.log.gz 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36520.log 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26520.log 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38721.log.gz 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36520.log.gz 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41479.log 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.26520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43326.log 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26520.log.gz 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41479.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38443.log 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41479.log.gz 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31759.log 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43326.log.gz 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36795.log 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38443.log.gz 2024-09-22T01:39:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26253.log 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31759.log.gz 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37185.log 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36795.log: /var/log/ceph/ceph-client.admin.26253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36795.log.gz 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26253.log.gz 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35052.log 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35296.log 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37185.log.gz 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35052.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35052.log.gz -5 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34336.log 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39211.log 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35296.log.gz 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41229.log 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34336.log.gz 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39211.log.gz 2024-09-22T01:39:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43690.log 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39891.log 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41229.log.gz 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41438.log 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43690.log.gz 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35130.log 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39891.log.gz 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42520.log 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41438.log.gz 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32242.log 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35130.log.gz 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37070.log 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42520.log.gz 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34927.log 2024-09-22T01:39:20.782 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32242.log.gz 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34607.log 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37070.log.gz 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34927.log.gz 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35346.log 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35027.log 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34607.log.gz 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42312.log 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35346.log.gz 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40630.log 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35027.log.gz 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42771.log 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42312.log.gz 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42390.log 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40630.log: /var/log/ceph/ceph-client.admin.42771.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T01:39:20.783 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42771.log.gz 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40630.log.gz 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42390.log.gz 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43482.log 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42781.log 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39501.log 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43482.log.gz 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42781.log.gz 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41374.log 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31417.log 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39501.log.gz 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41374.log.gz 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40699.log 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T01:39:20.784 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42574.log 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31417.log.gz 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40699.log.gz 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38048.log 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31561.log 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42574.log.gz 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33719.log 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38048.log.gz 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31561.log.gz 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35607.log 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41015.log 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33719.log.gz 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42468.log 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35607.log.gz 2024-09-22T01:39:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37520.log 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41015.log.gz 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42468.log.gz 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39742.log 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33960.log 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37520.log.gz 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41969.log 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39742.log.gz 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41749.log 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33960.log: /var/log/ceph/ceph-client.admin.41969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37439.log 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33960.log.gz 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41969.log.gz 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41749.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36021.log 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41749.log.gz 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42973.log 2024-09-22T01:39:20.786 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37439.log.gz 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43794.log 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36021.log: /var/log/ceph/ceph-client.admin.42973.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32884.log 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36021.log.gz 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42973.log.gz 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43794.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33834.log 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43794.log.gz 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32884.log.gz 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35235.log 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33834.log.gz 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35740.log 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43664.log 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35235.log.gz 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35740.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37486.log 2024-09-22T01:39:20.787 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43664.log.gz 2024-09-22T01:39:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42989.log 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38447.log 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37486.log.gz 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42989.log.gz 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37756.log 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38447.log.gz 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37654.log 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40439.log 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37756.log: /var/log/ceph/ceph-client.admin.37654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37756.log.gz 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37654.log.gz 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37235.log 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40040.log 2024-09-22T01:39:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40439.log: /var/log/ceph/ceph-client.admin.37235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40439.log.gz 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37235.log.gz 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34836.log 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40040.log: /var/log/ceph/ceph-client.admin.43222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40040.log.gz 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33489.log 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40098.log 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34836.log: /var/log/ceph/ceph-client.admin.33489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34836.log.gz 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33489.log.gz 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35900.log 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42988.log 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40098.log: /var/log/ceph/ceph-client.admin.35900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40098.log.gz 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35900.log.gz 2024-09-22T01:39:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31392.log 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42988.log: /var/log/ceph/ceph-client.admin.31392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42988.log.gz 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31392.log.gz 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42286.log 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36013.log 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42286.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35899.log 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36013.log.gz 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32190.log 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39960.log 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35899.log.gz 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32190.log.gz 2024-09-22T01:39:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31563.log 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39960.log.gz 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41597.log 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39096.log 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31563.log.gz 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41597.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39043.log 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39096.log.gz 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39043.log.gz 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2024-09-22T01:39:20.802 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40231.log 2024-09-22T01:39:20.802 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33139.log 2024-09-22T01:39:20.802 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.40231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40231.log.gz 2024-09-22T01:39:20.806 INFO:teuthology.orchestra.run.smithi018.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T01:39:20.806 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36900.log 2024-09-22T01:39:20.806 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32320.log 2024-09-22T01:39:20.806 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33139.log.gz 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36900.log.gz 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34970.log 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32320.log.gz 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43638.log 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36206.log 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34970.log.gz 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43638.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40137.log 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43638.log.gz 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36206.log.gz 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34062.log 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38581.log 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40137.log.gz 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34062.log.gzgzip 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34390.log 2024-09-22T01:39:20.807 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38581.log.gz 2024-09-22T01:39:20.808 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42442.log 2024-09-22T01:39:20.808 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38538.log 2024-09-22T01:39:20.808 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34390.log.gz 2024-09-22T01:39:20.808 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42442.log.gzgzip 2024-09-22T01:39:20.808 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33693.log 2024-09-22T01:39:20.810 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38538.log.gz 2024-09-22T01:39:20.810 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38191.log 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31982.log 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33693.log.gz 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38191.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26400.log 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31982.log.gz 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33173.log 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36895.log 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.26400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26400.log.gz 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33173.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34366.log 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33173.log.gz 2024-09-22T01:39:20.811 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36895.log.gz 2024-09-22T01:39:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2024-09-22T01:39:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37840.log 2024-09-22T01:39:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34366.log.gz 2024-09-22T01:39:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40917.log 2024-09-22T01:39:20.813 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37840.log.gz 2024-09-22T01:39:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31775.log 2024-09-22T01:39:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36104.log 2024-09-22T01:39:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40917.log: /var/log/ceph/ceph-client.admin.31775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40917.log.gz 2024-09-22T01:39:20.815 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31775.log.gz 2024-09-22T01:39:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36419.log 2024-09-22T01:39:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34776.log 2024-09-22T01:39:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36104.log: /var/log/ceph/ceph-client.admin.36419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36104.log.gz 2024-09-22T01:39:20.815 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36419.log.gz 2024-09-22T01:39:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39678.log 2024-09-22T01:39:20.816 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33486.log 2024-09-22T01:39:20.817 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34776.log.gz 2024-09-22T01:39:20.817 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39678.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43378.log 2024-09-22T01:39:20.817 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.817 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33486.log.gz 2024-09-22T01:39:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33232.log 2024-09-22T01:39:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40473.log 2024-09-22T01:39:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43378.log: /var/log/ceph/ceph-client.admin.33232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43378.log.gz 2024-09-22T01:39:20.818 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33232.log.gz 2024-09-22T01:39:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41832.log 2024-09-22T01:39:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36635.log 2024-09-22T01:39:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40473.log.gz 2024-09-22T01:39:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41832.log.gz 2024-09-22T01:39:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36680.log 2024-09-22T01:39:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36635.log.gz 2024-09-22T01:39:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43586.log 2024-09-22T01:39:20.821 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34024.log 2024-09-22T01:39:20.821 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36680.log: /var/log/ceph/ceph-client.admin.43586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36680.log.gz 2024-09-22T01:39:20.821 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43586.log.gz 2024-09-22T01:39:20.822 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32396.log 2024-09-22T01:39:20.823 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33067.log 2024-09-22T01:39:20.823 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34024.log: /var/log/ceph/ceph-client.admin.32396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34024.log.gz 2024-09-22T01:39:20.824 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32396.log.gz 2024-09-22T01:39:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41077.log 2024-09-22T01:39:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39917.log 2024-09-22T01:39:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33067.log: /var/log/ceph/ceph-client.admin.41077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33067.log.gz 2024-09-22T01:39:20.824 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41077.log.gz 2024-09-22T01:39:20.824 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31567.log 2024-09-22T01:39:20.825 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40673.log 2024-09-22T01:39:20.826 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39917.log.gz 2024-09-22T01:39:20.826 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31567.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39280.log 2024-09-22T01:39:20.826 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.826 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40673.log.gz 2024-09-22T01:39:20.826 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43430.log 2024-09-22T01:39:20.826 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35416.log 2024-09-22T01:39:20.827 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39280.log.gz 2024-09-22T01:39:20.827 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43430.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40074.log 2024-09-22T01:39:20.827 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.827 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35416.log.gz 2024-09-22T01:39:20.828 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39375.log 2024-09-22T01:39:20.829 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35781.log 2024-09-22T01:39:20.829 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40074.log.gz 2024-09-22T01:39:20.829 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39375.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31764.log 2024-09-22T01:39:20.829 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39375.log.gz 2024-09-22T01:39:20.829 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35781.log.gz 2024-09-22T01:39:20.830 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33329.log 2024-09-22T01:39:20.830 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38161.log 2024-09-22T01:39:20.830 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31764.log.gz 2024-09-22T01:39:20.830 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33329.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31966.log 2024-09-22T01:39:20.830 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.831 INFO:teuthology.orchestra.run.smithi179.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-22T01:39:20.832 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38161.log.gz 2024-09-22T01:39:20.832 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31776.log 2024-09-22T01:39:20.833 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40892.log 2024-09-22T01:39:20.833 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31966.log.gz 2024-09-22T01:39:20.833 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31776.log.gz 2024-09-22T01:39:20.833 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39070.log 2024-09-22T01:39:20.833 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40892.log.gz 2024-09-22T01:39:20.834 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42569.log 2024-09-22T01:39:20.835 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38969.log 2024-09-22T01:39:20.835 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39070.log.gz 2024-09-22T01:39:20.835 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42569.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37294.log 2024-09-22T01:39:20.835 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.835 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38969.log.gz 2024-09-22T01:39:20.836 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37566.log 2024-09-22T01:39:20.836 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31514.log 2024-09-22T01:39:20.836 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37294.log.gz 2024-09-22T01:39:20.836 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37566.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35946.log 2024-09-22T01:39:20.837 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.837 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31514.log.gz 2024-09-22T01:39:20.838 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39607.log 2024-09-22T01:39:20.838 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41672.log 2024-09-22T01:39:20.838 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35946.log.gz 2024-09-22T01:39:20.838 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39607.log.gz 2024-09-22T01:39:20.838 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32629.log 2024-09-22T01:39:20.839 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41672.log.gz 2024-09-22T01:39:20.839 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35822.log 2024-09-22T01:39:20.840 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37628.log 2024-09-22T01:39:20.840 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32629.log: /var/log/ceph/ceph-client.admin.35822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32629.log.gz 2024-09-22T01:39:20.840 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35822.log.gz 2024-09-22T01:39:20.840 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37438.log 2024-09-22T01:39:20.841 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37628.log.gz 2024-09-22T01:39:20.841 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32216.log 2024-09-22T01:39:20.842 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31750.log 2024-09-22T01:39:20.842 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37438.log.gz 2024-09-22T01:39:20.842 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32216.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32394.log 2024-09-22T01:39:20.842 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.843 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31750.log.gz 2024-09-22T01:39:20.843 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32164.log 2024-09-22T01:39:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38771.log 2024-09-22T01:39:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32394.log.gz 2024-09-22T01:39:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32164.log.gz 2024-09-22T01:39:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42182.log 2024-09-22T01:39:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38771.log.gz 2024-09-22T01:39:20.845 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42130.log 2024-09-22T01:39:20.845 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32268.log 2024-09-22T01:39:20.845 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42182.log.gz 2024-09-22T01:39:20.846 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42130.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31768.log 2024-09-22T01:39:20.846 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42130.log.gz 2024-09-22T01:39:20.847 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32268.log.gz 2024-09-22T01:39:20.847 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32383.log 2024-09-22T01:39:20.847 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34122.log 2024-09-22T01:39:20.847 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31768.log.gz 2024-09-22T01:39:20.848 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.32383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32702.log 2024-09-22T01:39:20.848 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34122.log.gz 2024-09-22T01:39:20.848 INFO:teuthology.orchestra.run.smithi018.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.0.32383.log.gz 2024-09-22T01:39:20.849 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33537.log 2024-09-22T01:39:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32350.log 2024-09-22T01:39:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32702.log.gz 2024-09-22T01:39:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33537.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36145.log 2024-09-22T01:39:20.850 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32350.log.gz 2024-09-22T01:39:20.851 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31984.log 2024-09-22T01:39:20.851 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34184.log 2024-09-22T01:39:20.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36145.log: /var/log/ceph/ceph-client.admin.31984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36145.log.gz 2024-09-22T01:39:20.851 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31984.log.gz 2024-09-22T01:39:20.852 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35528.log 2024-09-22T01:39:20.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34184.log.gz 2024-09-22T01:39:20.852 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35447.log 2024-09-22T01:39:20.853 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35656.log 2024-09-22T01:39:20.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35528.log: /var/log/ceph/ceph-client.admin.35447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35528.log.gz 2024-09-22T01:39:20.853 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35447.log.gz 2024-09-22T01:39:20.854 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42566.log 2024-09-22T01:39:20.854 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42555.log 2024-09-22T01:39:20.855 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35656.log: /var/log/ceph/ceph-client.admin.42566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35656.log.gz 2024-09-22T01:39:20.855 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42566.log.gz 2024-09-22T01:39:20.855 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33933.log 2024-09-22T01:39:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34089.log 2024-09-22T01:39:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42555.log: /var/log/ceph/ceph-client.admin.33933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42555.log.gz 2024-09-22T01:39:20.856 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33933.log.gz 2024-09-22T01:39:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34548.log 2024-09-22T01:39:20.857 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40314.log 2024-09-22T01:39:20.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34089.log.gz 2024-09-22T01:39:20.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34548.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37806.log 2024-09-22T01:39:20.857 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:20.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40314.log.gz 2024-09-22T01:39:20.858 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42572.log 2024-09-22T01:39:20.858 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42208.log 2024-09-22T01:39:20.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37806.log.gz 2024-09-22T01:39:20.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42572.log.gz 2024-09-22T01:39:20.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42208.log.gz 2024-09-22T01:39:20.955 INFO:teuthology.orchestra.run.smithi179.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-22T01:39:21.003 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-22T01:39:21.086 INFO:teuthology.orchestra.run.smithi018.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-22T01:39:21.721 INFO:teuthology.orchestra.run.smithi018.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-22T01:39:23.099 INFO:teuthology.orchestra.run.smithi179.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-22T01:39:23.157 INFO:teuthology.orchestra.run.smithi018.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-22T01:39:23.735 INFO:teuthology.orchestra.run.smithi018.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-22T01:39:23.746 INFO:teuthology.orchestra.run.smithi179.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-22T01:39:24.288 INFO:teuthology.orchestra.run.smithi179.stderr: 95.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-22T01:39:24.499 INFO:teuthology.orchestra.run.smithi018.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-22T01:39:24.502 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-22T01:39:24.502 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m3.843s 2024-09-22T01:39:24.502 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m10.702s 2024-09-22T01:39:24.502 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.515s 2024-09-22T01:39:24.537 INFO:teuthology.orchestra.run.smithi179.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-22T01:39:24.539 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-09-22T01:39:24.539 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m3.838s 2024-09-22T01:39:24.539 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m12.532s 2024-09-22T01:39:24.539 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m0.588s 2024-09-22T01:39:24.540 INFO:tasks.ceph:Archiving logs... 2024-09-22T01:39:24.540 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619/remote/smithi018/log 2024-09-22T01:39:24.542 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T01:39:25.865 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619/remote/smithi179/log 2024-09-22T01:39:25.866 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T01:39:27.159 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-22T01:39:27.168 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-22T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T01:39:27.171 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T01:39:27.240 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-22T01:39:27.249 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-22T01:39:27.250 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T01:39:27.252 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T01:39:27.262 INFO:teuthology.orchestra.run.smithi018.stdout: remote refid st t when poll reach delay offset jitter 2024-09-22T01:39:27.262 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================== 2024-09-22T01:39:27.262 INFO:teuthology.orchestra.run.smithi018.stdout:+hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.064 -0.703 0.628 2024-09-22T01:39:27.262 INFO:teuthology.orchestra.run.smithi018.stdout:+hv02.front.sepi 63.231.80.2 3 u 11 64 377 0.096 +0.748 0.863 2024-09-22T01:39:27.262 INFO:teuthology.orchestra.run.smithi018.stdout:*hv03.front.sepi 74.6.168.72 3 u 12 64 377 0.103 -0.893 0.672 2024-09-22T01:39:27.262 INFO:teuthology.orchestra.run.smithi018.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-22T01:39:27.265 INFO:teuthology.orchestra.run.smithi179.stdout: remote refid st t when poll reach delay offset jitter 2024-09-22T01:39:27.265 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================== 2024-09-22T01:39:27.265 INFO:teuthology.orchestra.run.smithi179.stdout:+hv01.front.sepi 67.205.162.81 3 u 16 64 377 0.076 -1.457 0.545 2024-09-22T01:39:27.265 INFO:teuthology.orchestra.run.smithi179.stdout:*hv02.front.sepi 63.231.80.2 3 u 16 64 377 0.124 -0.295 0.558 2024-09-22T01:39:27.265 INFO:teuthology.orchestra.run.smithi179.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.099 -1.596 0.578 2024-09-22T01:39:27.265 INFO:teuthology.orchestra.run.smithi179.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-22T01:39:27.266 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-22T01:39:27.316 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-22T01:39:27.317 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-22T01:39:27.350 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-22T01:39:27.381 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-22T01:39:27.417 INFO:teuthology.task.internal:Duration was 931.201883 seconds 2024-09-22T01:39:27.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-22T01:39:27.447 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-22T01:39:27.448 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T01:39:27.450 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T01:39:27.489 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-22T01:39:27.489 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-22T01:39:27.489 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T01:39:27.542 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-09-22T01:39:27.542 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T01:39:27.552 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-22T01:39:27.552 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T01:39:27.585 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T01:39:27.622 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-22T01:39:27.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T01:39:27.657 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T01:39:27.736 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-22T01:39:27.745 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-22T01:39:27.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T01:39:27.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T01:39:27.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-22T01:39:27.781 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T01:39:27.801 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T01:39:27.810 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-22T01:39:27.818 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-09-22T01:39:27.972 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T01:39:27.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:39:27.978 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T01:39:28.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T01:39:28.018 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-22T01:39:28.037 INFO:teuthology.task.internal:Transferring archived files... 2024-09-22T01:39:28.037 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619/remote/smithi018 2024-09-22T01:39:28.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T01:39:28.064 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_21:16:02-rbd-squid-distro-default-smithi/7914619/remote/smithi179 2024-09-22T01:39:28.064 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T01:39:28.085 INFO:teuthology.task.internal:Removing archive directory... 2024-09-22T01:39:28.086 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T01:39:28.109 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T01:39:28.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-22T01:39:28.145 INFO:teuthology.task.internal:Not uploading archives. 2024-09-22T01:39:28.145 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-22T01:39:28.174 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-22T01:39:28.174 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T01:39:28.176 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T01:39:28.180 INFO:teuthology.orchestra.run.smithi018.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 01:39 /home/ubuntu/cephtest 2024-09-22T01:39:28.182 INFO:teuthology.orchestra.run.smithi179.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 01:39 /home/ubuntu/cephtest 2024-09-22T01:39:28.183 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-22T01:39:28.210 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-22T01:39:28.282 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} duration: 931.2018828392029 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-22T01:39:28.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T01:39:28.372 INFO:teuthology.run:pass